Advanced User Interface Construction via Multiple Visual Examples

(1)通过多个用户示例交互式构建GUI：我们已经构建了一个框架，用户可以通过提供多个用户界面示例来构建声明性规则。特别是，系统推断用户修改的意图，因此系统表示与用户修改的循环改进了界面。(2)声明式动画界面：我们扩展了之前提出的GUI模型，称为“抽象数据和图片的双向转换”，通过合并时间的概念，从而实现了应用程序数据结构动态行为的半自动可视化。用户只需声明程序在数据结构上的动作与期望的动画效果之间的对应关系，其余的动画由插值生成。该系统还被扩展为包含3-D接口。(3)广义局部传播理论：将局部传播理论推广到求解层次约束系统中的约束问题。首先，我们改进了Alan Borning等人对分层约束的定义。;然后，我们在解图中定义了局部半单调性和全局单调性的概念，得到了用局部传播算法得到的解是“正确”的充要条件。然后，我们对不同的求解器和比较器进行了分类。最后，在此基础上开发了约束求解器DETAIL，并将其应用于原型系统中。(4)笔计算的新交互技术：我们提出了一种局部结构的识别模型，称为“链接模型”。然后，我们在Pegasus原型笔系统中开发了笔交互技术。它在绘图中为每个用户动作提供多个候选，实现快速灵活的绘图交互。(5)交互式半影：我们提出了半影在三维交互中的一种新用法，称为“交互式半影”。在三维空间中人工绘制的半影增强了用户对投影平面的高度和位置的感知。开发了一种快速绘制算法，使该技术可用于三维空间的实时交互。少

(1) Interactive constructionof GUI via multiple user examples : We have constructed a framework where a user can construct declarative rules of by providing multiple examples of user interfaces. In particular, the system infers the intentions of user corrections, whereby a cycle of system presentation versus user correction refines the interface.(2) Declarative Animation Interface : We extended our previously proposed model of GUI called "bidirectional translation of abstract data and pictures" by incorporating the notion of time, thereby achieving semi-automated visualization of dynamic behavior of application data structures. The user merely declares the correspondence between the program's actions on the data structure and the desired animation effects, and the rest of the animation is generated by interpolation. The system has also been extended to incorporate 3-D interfaces.(3) A theory of Generalized Local Propagation : We generalized the theory of local propagation in solving th … More e constraints in a hierarchical constraint system. First, we refined the definition of hierarchical constraints by Alan Borning et.al. ; then, we defined the notion of local semi-monotonicity and global-monotonicity in the solution graph, obtaining the necessary and sufficient condition under which the solution obtained by the local propagation algorithm can be considered "correct". We then categorized different solvers and comparators. Finally, we developed a constraint solver DETAIL based on the theory, and used it in our prototype systems.(4) New interaction techniques for pen computing : We proposed a model of recognition in local structures called the "Link Model". We then developed a pen-interaction techniques in a prototype pen-system Pegasus. Which presents multiple candidates per user actions in drawing, achieving fast and flexible drawing interactions.(5) Interactive Penumbrae : We proposed a new use of penumbrae in 3-D interaction, called the "Interactive Penumbrae". An artificially-drawing penumbrae in 3-D space enhances user perception of height and location from the projection plane. A fast rendering algorithm has been developed which makes the technique useful for real-time interaction in 3-D space. Less