HCC: Medium: Collaborative Research: Generating Effective Dynamic Explanations in Augmented Reality

为了生存和繁荣，人们必须以有组织的方式与环境互动。要做到这一点，他们需要学习，想象，并在世界上和世界中进行各种各样的转换。其中主要是操纵物体和空间导航。该项目整合了计算机科学和认知科学的研究，开发和评估增强现实工具，以创建有效的动态解释，增强操作和导航，结合识别和可视化。增强现实是指用户界面，其中虚拟材料是集成和覆盖在用户？的经验，真实的世界;例如，通过使用跟踪头戴式和手持显示器。动态解释是与任务相适应的动作序列，以交互方式呈现，并添加适当的信息。这些工具将与主题专家合作创建，用于室内和室外真实的世界领域的探索性使用：在树木繁茂的公园区域导航和识别地标，组装一件家具，以及导航和可视化规划新的城市校园。认知科学研究将确定向人们传达解释和信息的最佳方式。计算机科学研究将解决系统的设计和实现，这些系统体现了识别对象和位置，指定动作以及添加不可见信息的最佳候选方法。现场实验将用于评估和改进系统。 操纵、导航、识别和可视化是人们每天都要做的重要事情的代表，从修理损坏的设备到在不熟悉的环境中到达期望的目的地。我们执行这些任务的方式可能会通过使用该项目开发的原则设计的增强现实系统得到显着改善。认知原理和增强现实工具都将具有广泛的适用性。开发的系统将为未来系统的设计提供信息，这些系统可以帮助公众，用于教育和娱乐目的，以及可以帮助听觉，视觉或身体障碍的人的系统。

To survive and flourish, people must interact with their environment in an organized fashion. To do so, they need to learn, imagine, and perform an assortment of transformations on and in the world. Primary among these are manipulation of objects and navigation in space. This project integrates research in computer science and cognitive science to develop and evaluate augmented reality tools to create effective dynamic explanations that enhance manipulation and navigation, in conjunction with identification and visualization. Augmented reality refers to user interfaces in which virtual material is integrated with and overlaid on the user?s experience of the real world; for example, by using tracked head-worn and hand-held displays. Dynamic explanations are task-appropriate sequences of actions, presented interactively, with appropriate added information. The tools will be created in collaboration with subject matter experts for exploratory use in indoor and outdoor real world domains: navigating and identifying landmarks in a wooded park area, assembling a piece of furniture, and navigating and visualizing for planning the site of a new urban campus. Cognitive science research will determine the best ways to convey explanations and information to people. Computer science research will address the design and implementation of systems that embody the best candidate approaches for identifying objects and locations, specifying actions, and adding non-visible information. In situ experiments will be used to assess and refine the systems. Manipulation, navigation, identification, and visualization are representative of important things that people do every day, ranging from fixing broken equipment to reaching a desired destination in an unfamiliar environment. The ways in which we perform these tasks could potentially be improved significantly through augmented reality systems designed using the principles to be developed by this project. Both the cognitive principles and the augmented reality tools will have broad applicability. The systems developed will inform the design of future systems that can aid the general public, for educational and recreational ends, as well as systems that can assist people with auditory, visual, or physical impairments.