CAREER: Advancing Interaction Paradigms in Mobile Augmented Reality using Eye Tracking

在这个项目中，PI将开发所需的科学，以增强(A)眼睛跟踪和(B)凝视方向的移动增强现实应用程序。移动增强现实使用手持设备来提供物理世界的透视图，其中物理世界的图像与该视图中事物的信息叠加在一起。这就好比你向世界举起一块玻璃，那块玻璃上出现了文字，上面标着你通过玻璃看到的东西。这个项目将研究如何使用移动眼球跟踪来确定人们对视觉场景中的哪些对象感兴趣，从而可能希望在他们的增强现实视图中进行注释。移动眼球跟踪可以监控一个人在移动中看什么地方。这个项目将研究如何让这些场景注释以既不分散注意力也不引人注目的方式出现和消失，方法是进行实验，测试一个人在看到不同大小、透明度和距离凝视点(一个人正在观看的点)的文本注释时完成视觉任务的能力。该项目将开发自动管理这些标签的密度和放置的算法，以最好地支持人工任务，同时避免产生令人分心的“视觉混乱”。该项目还将开发通过用于移动增强现实系统的新可视化技术来引导人们在物理世界中凝视所需的科学。在这种情况下，就好像你用来观察世界的那块玻璃周期性地发生了轻微的变化，以悄悄地激励你更仔细地观察场景中不同的、特定的、与任务相关的部分。该项目的这一方面将与休斯顿美术馆合作进行。广泛的影响：该项目将推进可视化技术的发现，使移动应用程序能够增强对物理世界的观看，同时促进在多种背景下的科学教学。与休斯顿美术馆合作，该项目将开发一个可免费下载的iPhone应用程序，该应用程序将增强博物馆参观者的艺术学习，并提供一个概念证明，说明在该项目中开发的技术如何用于其他环境。该项目在科学教育中寻求一些具体的新机会，包括：(A)为德克萨斯州A&AMP的初中生科学夏令营开发与项目相关的课程；(B)关于增强现实编程以及照明和电影摄影的人的表现方面的新的大学一级课程；(C)关于计算机图形学中的实验设计、眼球跟踪和感知的会议教程。

In this project the PI will develop the science needed to enhance mobile augmented reality applications with (a) eye tracking and (b) gaze direction. Mobile augmented reality uses a hand-held device to provide a see-through view of the physical world in which an image of the physical world is superimposed with information about the things in that view. It is as if you held a piece of glass up to the world, and text appeared on that piece of glass labeling the things you see through the glass. This project will investigate how mobile eye tracking, which monitors where a person is looking while on the go, can be used to determine what objects in a visual scene a person is interested in, and thus might like to have annotated in their augmented reality view. This project will investigate how to make these scene annotations appear and disappear in a manner that is neither distracting nor obtrusive by conducting experiments that measure a person's ability to accomplish visual tasks while presented with text annotations in different sizes, transparency levels, and distances from the point-of-gaze (the point where a person is looking). The project will develop algorithms to automatically manage the density and placement of these labels to best support human tasks while avoiding the creation of distracting "visual clutter".The project will also develop the science that is needed to direct a person's gaze in the physical world by means of new visualization techniques for use in mobile augmented reality systems. In this case, it is as if the piece of glass through which you are viewing the world periodically changed slightly to unobtrusively motivate you to look more closely at different, specific, task-relevant parts of the scene. This aspect of the project will be conducted in collaboration with the Houston Museum of Fine Arts.Broader Impacts: The project will advance discovery of visualization techniques to permit mobile applications to enhance the viewing of the physical world, while promoting the teaching and learning of science in multiple contexts. Collaborating with the Houston Museum of Fine Arts, the project will develop a freely-downloadable iPhone application that will enhance museum-goers' learning in the arts, and provide a proof-of-concept of how the techniques developed in this project could be used in other contexts.The project pursues a number of specific new opportunities in science education, including the development of (a) project-related curriculum for a science-based summer camp for junior high school students at Texas A&M University, (b) new University-level courses on the programming for augmented reality and the human performance aspects of lighting and cinematography, and (c) conference tutorials on experimental design, eye tracking, and perception in computer graphics.