CAREER: Anywhere Augmentation: Practical Mobile Augmented Reality in Unprepared Physical Environments

职业：随时随地增强：在未准备好的物理环境中实用的移动增强现实

• 批准号: 0747520
• 负责人: Tobias Hollerer
• 金额: $ 50万
• 依托单位: University of California-Santa Barbara
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-04-01 至 2015-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0747520&HistoricalAwards=false
• 关键词: CAREER; Anywhere; Augmentation; Practical; Mobile

The PI introduces the term Anywhere Augmentation to refer to the idea of linking location-specific computing services with the physical world, making them readily and directly available in any situation and location. This project embodies a novel approach to Anywhere Augmentation based on efficient human input for wearable computing and augmented reality (AR), through both sketch-based interfaces on hand-held devices and direct-overlay 3D user interfaces. Mobile augmented reality is a powerful interface for wearable computing. If computer users are enabled to place arbitrary annotations in 3D space wherever they go, the physical world becomes the user interface. Instead of embedding computing and display equipment in the environment as in the case of ubiquitous computing, graphical annotations are overlaid on top of the environment by means of optical see-through glasses or video overlay. Robust registration between the physical world and the augmentations is necessary. Current approaches rely on the availability of a 3D model of the environment or on its instrumentation with active or passive markers. The PI's approach is novel in that he proposes to emphasize, support, and utilize the expertise of the human in the loop to make Anywhere Augmentation feasible. Human users generally have a clear grasp of the layout of the scene in front of them, and they can easily identify the physical objects with which information should be linked. The PI plans to enable users to transfer their intuitional scene understanding to the computer through intelligently constrained and assisted user interfaces. Current real-time computer vision techniques and algorithms, while far from being able to facilitate automatic scene understanding, are very well suited to constrain and guide a user?s informed input for scene analysis and augmentation, delivered in the form of a few simple point selections, stroke gestures, and common classifications. As a main source of input, the PI will employ video feeds from small head-worn or palm-top-device cameras. The devices, algorithms and interaction techniques will be applicable to novel settings and application scenarios (e.g., visualization of occluded infrastructure, navigational guidance, and social and educational applications for high-school students).Broader Impact: The PI will use this research as a case study and platform for projects supporting the teaching of human-computer interaction fundamentals. As a first step towards actively furthering the inclusion of minority students in the benefits of the research, the PI has partnered with Jackson State University, MS, and will also collaborate with outreach programs supporting local underrepresented K-12 students, where he will enhance the after-school programs and field trips with carefully planned AR experimentation and mentoring. The goal of Anywhere Augmentation will be tested by making research products (new devices, tools, and interfaces) available to students and field scientists in a wide variety of environments (e.g., as a campus navigation and inventory tool, for an emergency response scenario, at UCSB lab open houses, and at international conferences). The PI will also introduce innovations in three courses in the curriculum of the UCSB Computer Science Department (an undergraduate elective on HCI which he established, the undergraduate senior CS design project course cycle, and a new graduate course on 3D user interfaces), so they include hands-on experiences on effective UI design and programming for mobile devices, including mobile AR interfaces. To this end, the PI will also involve the UCSB Allosphere, a 3-story spherical surround-view 3D immersive space, as a mobile AR simulator.

PI引入了“Anywhere Augmentation”一词，指的是将特定位置的计算服务与物理世界联系起来的想法，使它们在任何情况和位置都可以直接使用。 该项目体现了一种基于可穿戴计算和增强现实（AR）的有效人类输入的新方法，通过手持设备上基于草图的界面和直接覆盖的3D用户界面。 移动的增强现实是可穿戴计算的强大接口。 如果计算机用户能够在3D空间中放置任意注释，无论他们走到哪里，物理世界都将成为用户界面。 代替如在普适计算的情况下那样在环境中嵌入计算和显示设备，图形注释借助于光学透视眼镜或视频覆盖而覆盖在环境的顶部上。 物理世界和增强体之间的鲁棒配准是必要的。 目前的方法依赖于环境的3D模型的可用性或其具有有源或无源标记的仪器。 PI的方法是新颖的，因为他建议强调，支持和利用循环中人类的专业知识，使任何地方的增强都是可行的。 人类用户通常对他们面前的场景布局有清晰的把握，他们可以很容易地识别信息应该与之链接的物理对象。 PI计划使用户能够通过智能约束和辅助用户界面将其直观的场景理解转移到计算机上。 当前的实时计算机视觉技术和算法，虽然远远不能促进自动场景理解，但非常适合约束和引导用户？的知情输入场景分析和增强，交付的形式，一些简单的点选择，笔画手势，和共同的分类。 作为输入的主要来源，PI将采用来自小型头戴式或掌上设备摄像机的视频馈送。 设备、算法和交互技术将适用于新的设置和应用场景（例如，更广泛的影响：PI将利用这项研究作为案例研究和支持人机交互基础教学的项目平台。 作为积极促进少数民族学生参与研究的第一步，PI与杰克逊州立大学合作，并将与支持当地代表性不足的K-12学生的外展计划合作，在那里他将通过精心策划的AR实验和指导来加强课后计划和实地考察。 随处增强的目标将通过使研究产品（新设备，工具和界面）在各种环境中（例如，作为校园导航和库存工具，用于紧急响应场景，UCSB实验室开放日和国际会议）。 PI还将在UCSB计算机科学系的课程中引入三门课程的创新（他建立的HCI本科选修课，本科高年级CS设计项目课程周期，以及关于3D用户界面的新研究生课程），因此它们包括有效的UI设计和移动的设备编程的实践经验，包括移动的AR界面。 为此，PI还将涉及UCSB Allosphere，这是一个3层楼高的球形环绕视角3D沉浸式空间，作为移动的AR模拟器。