ITR: Environment Management for Hybrid User Interfaces

这是一个为期三年的连续奖励的第一年资助。混合用户界面联合收割机将多个显示器和交互设备组合在一起，以从每个显示器和交互设备的优点中受益。 例如，可以构建混合用户界面，其中多个用户查看一个或多个公共显示器，诸如壁挂式数据可视化和桌面虚拟工作台3D模型。 与此同时，每个用户都可以看到互补的私人材料，定制自己的信息需求，并覆盖在公共显示器上并与之注册-一种增强现实，呈现在个人，跟踪，手持或头戴式的透视显示器上。比当前窗口管理中涉及的任务更复杂的是，如果要解决未来移动的协作用户的需求，环境管理将特别具有挑战性，这些用户与其他用户、显示器和交互设备的接近度可能随着用户的移动而快速且不可预测地改变。这项工作探讨了一种替代直接操纵的方法，其中基于知识的环境管理工具接管许多低级别的任务，以避免压倒用户。 其目标是通过使用户能够对其个人和共享工作环境的布局和内容施加更高级别的控制来提高用户的效率。该项目将开发混合用户界面和有效环境管理设施的基本概念，并将设计，演示和测试体现这些概念的研究原型。 特别强调的是协作，3D增强环境，利用广泛的显示器（持有，佩戴和固定），包括头跟踪的透视显示器，创建增强现实，其中虚拟对象共存于相同的周围空间作为用户和其他物理对象所提出的问题。用户界面设计方法，可以促进更短的任务执行时间，更低的错误率，或更高的用户满意度，将是至关重要的，以提高我们的能力，与信息和彼此在非传统的协作移动的计算世界。

This is the first year funding of a three-year continuing award. Hybrid user interfaces combine together multiple displays and interaction devices to benefit from the advantages of each. For example, a hybrid user interface could be constructed in which multiple users view one or more common displays, such as a wall-mounted data visualization and a desk-top virtual workbench 3D model. At the same time, each user might see complementary private material, customized to her own information needs, and overlaid on and registered with the common displays---an augmented reality that is presented on personal, tracked, hand-held or head-worn see-through displays.This project addresses environment management, the task of managing large numbers of virtual objects on large numbers of displays in hybrid user interfaces. More complex than the tasks involved in current window management, environment management will be especially challenging if it is to address the needs of future mobile, collaborating users, whose proximity to other users, displays, and interaction devices may change rapidly and unpredictably as users move about. This work explores an alternative to direct manipulation approaches, in which knowledge-based environment management tools take over many low-level tasks to avoid overwhelming the user. The goal is to increase a user's effectiveness by making it possible for her to exert higher-level control over the layout and contents of her personal and shared work environment. This project will develop the underlying concepts for hybrid user interfaces and effective environment management facilities, and will design, demonstrate, and test research prototypes that embody these concepts. Special emphasis is placed on issues raised by collaborative, 3D augmented environments that exploit a wide range of displays (held, worn, and stationary), including head-tracked see-through displays that create augmented realities, in which virtual objects coexist in the same surrounding space as users and other physical objects. User interface design approaches that can promote shorter task performance time, lower error rate, or greater user satisfaction, will be vital for improving our ability to interact with information and with each other in the nontraditional world of collaborative mobile computing.