CAREER: Anywhere Augmentation: Practical Mobile Augmented Reality in Unprepared Physical Environments

PI引入了术语随处增强，指的是将特定于位置的计算服务与物理世界联系起来，使它们在任何情况和位置都可以方便和直接地使用。该项目体现了一种新的方法，通过手持设备上基于草图的界面和直接覆盖的3D用户界面，基于可穿戴计算和增强现实(AR)的高效人类输入，实现随处增强。移动增强现实是可穿戴计算的强大界面。如果计算机用户能够在3D空间中随时随地添加任意注释，那么物理世界就成了用户界面。不是像普适计算那样在环境中嵌入计算和显示设备，而是通过光学透明眼镜或视频覆盖将图形注释覆盖在环境的顶部。在现实世界和扩展之间进行稳健的注册是必要的。目前的方法依赖于环境的3D模型的可用性，或者依赖于具有主动或被动标记的仪器。PI的方法是新颖的，因为他建议强调、支持和利用循环中人的专业知识，使任何地方的增强都是可行的。人类用户一般对眼前场景的布局有清晰的把握，可以很容易地识别出信息应该链接到的物理对象。PI计划使用户能够通过智能约束和辅助用户界面将他们对场景的直观理解转移到计算机上。当前的实时计算机视觉技术和算法，虽然远远不能促进自动场景理解，但非常适合于约束和指导用户？S为场景分析和增强提供了知情输入，以几个简单的点选择、笔势和常见分类的形式提供。作为输入的主要来源，PI将使用小型头戴式或掌上设备摄像头的视频馈送。这些设备、算法和交互技术将适用于新的设置和应用场景(例如，遮挡基础设施的可视化、导航导航以及高中生的社交和教育应用)。广泛的影响：PI将把这项研究作为支持人机交互基础教学的项目的案例研究和平台。作为积极推动少数族裔学生受益于这项研究的第一步，PI已与密歇根州杰克逊州立大学合作，并将与支持当地未被充分代表的K-12学生的外展项目合作，在那里他将通过精心规划的AR实验和指导来加强课外项目和实地考察。随时随地增强的目标将通过在各种环境中向学生和现场科学家提供研究产品(新设备、工具和界面)进行测试(例如，作为校园导航和库存工具、用于紧急响应场景、在UCSB实验室开放日和国际会议上)。PI还将在UCSB计算机科学系课程中的三门课程(他设立的关于人机界面的本科选修课、本科高级CS设计项目课程周期和新的3D用户界面研究生课程)中引入创新，因此它们包括移动设备(包括移动AR界面)的有效UI设计和编程的实践经验。为此，PI还将使用UCSB Allphere作为移动AR模拟器，这是一个3层的球形环绕视3D沉浸式空间。

The PI introduces the term Anywhere Augmentation to refer to the idea of linking location-specific computing services with the physical world, making them readily and directly available in any situation and location. This project embodies a novel approach to Anywhere Augmentation based on efficient human input for wearable computing and augmented reality (AR), through both sketch-based interfaces on hand-held devices and direct-overlay 3D user interfaces. Mobile augmented reality is a powerful interface for wearable computing. If computer users are enabled to place arbitrary annotations in 3D space wherever they go, the physical world becomes the user interface. Instead of embedding computing and display equipment in the environment as in the case of ubiquitous computing, graphical annotations are overlaid on top of the environment by means of optical see-through glasses or video overlay. Robust registration between the physical world and the augmentations is necessary. Current approaches rely on the availability of a 3D model of the environment or on its instrumentation with active or passive markers. The PI's approach is novel in that he proposes to emphasize, support, and utilize the expertise of the human in the loop to make Anywhere Augmentation feasible. Human users generally have a clear grasp of the layout of the scene in front of them, and they can easily identify the physical objects with which information should be linked. The PI plans to enable users to transfer their intuitional scene understanding to the computer through intelligently constrained and assisted user interfaces. Current real-time computer vision techniques and algorithms, while far from being able to facilitate automatic scene understanding, are very well suited to constrain and guide a user?s informed input for scene analysis and augmentation, delivered in the form of a few simple point selections, stroke gestures, and common classifications. As a main source of input, the PI will employ video feeds from small head-worn or palm-top-device cameras. The devices, algorithms and interaction techniques will be applicable to novel settings and application scenarios (e.g., visualization of occluded infrastructure, navigational guidance, and social and educational applications for high-school students).Broader Impact: The PI will use this research as a case study and platform for projects supporting the teaching of human-computer interaction fundamentals. As a first step towards actively furthering the inclusion of minority students in the benefits of the research, the PI has partnered with Jackson State University, MS, and will also collaborate with outreach programs supporting local underrepresented K-12 students, where he will enhance the after-school programs and field trips with carefully planned AR experimentation and mentoring. The goal of Anywhere Augmentation will be tested by making research products (new devices, tools, and interfaces) available to students and field scientists in a wide variety of environments (e.g., as a campus navigation and inventory tool, for an emergency response scenario, at UCSB lab open houses, and at international conferences). The PI will also introduce innovations in three courses in the curriculum of the UCSB Computer Science Department (an undergraduate elective on HCI which he established, the undergraduate senior CS design project course cycle, and a new graduate course on 3D user interfaces), so they include hands-on experiences on effective UI design and programming for mobile devices, including mobile AR interfaces. To this end, the PI will also involve the UCSB Allosphere, a 3-story spherical surround-view 3D immersive space, as a mobile AR simulator.