CAREER: Advancing Interaction Paradigms in Mobile Augmented Reality using Eye Tracking

在该项目中，PI将开发增强移动的增强现实应用所需的科学，包括（a）眼球跟踪和（B）注视方向。 移动的增强现实使用手持设备来提供物理世界的透视视图，其中物理世界的图像与关于该视图中的事物的信息叠加。 这就好像你把一块玻璃举到世界上，文字出现在那块玻璃上，标记着你透过玻璃看到的东西。 该项目将研究如何使用移动的眼动跟踪来确定人们对视觉场景中的哪些对象感兴趣，从而可能希望在其增强现实视图中进行注释。 这个项目将研究如何使这些场景注释出现和消失的方式，既不分散注意力，也不突兀，通过进行实验，测量一个人的能力，完成视觉任务，同时呈现不同大小的文本注释，透明度水平，和距离的凝视点（一个人正在看的点）。 该项目将开发算法来自动管理这些标签的密度和位置，以最好地支持人类任务，同时避免产生分散注意力的“视觉混乱”。该项目还将开发通过新的可视化技术在移动的增强现实系统中使用的方式来引导人们在物理世界中的视线所需的科学。 在这种情况下，就好像你观察世界的那块玻璃周期性地发生轻微变化，以不引人注目地激励你更仔细地观察场景中不同的、特定的、与任务相关的部分。 更广泛的影响：该项目将促进可视化技术的发现，使移动的应用程序能够增强对物理世界的观察，同时促进在多种背景下的科学教学。 该项目将与休斯顿美术博物馆合作，开发一个可免费下载的iPhone应用程序，以增强博物馆参观者在艺术方面的学习，并提供一个概念验证，说明该项目开发的技术如何在其他环境中使用。该项目寻求科学教育方面的一些具体新机会，包括为得克萨斯州农工大学的初中生科学夏令营制定与项目有关的课程&，（B）关于增强现实编程以及照明和电影摄影的人类表演方面的新的大学课程，以及（c）关于计算机图形学中的实验设计、眼动跟踪和感知的会议教程。

In this project the PI will develop the science needed to enhance mobile augmented reality applications with (a) eye tracking and (b) gaze direction. Mobile augmented reality uses a hand-held device to provide a see-through view of the physical world in which an image of the physical world is superimposed with information about the things in that view. It is as if you held a piece of glass up to the world, and text appeared on that piece of glass labeling the things you see through the glass. This project will investigate how mobile eye tracking, which monitors where a person is looking while on the go, can be used to determine what objects in a visual scene a person is interested in, and thus might like to have annotated in their augmented reality view. This project will investigate how to make these scene annotations appear and disappear in a manner that is neither distracting nor obtrusive by conducting experiments that measure a person's ability to accomplish visual tasks while presented with text annotations in different sizes, transparency levels, and distances from the point-of-gaze (the point where a person is looking). The project will develop algorithms to automatically manage the density and placement of these labels to best support human tasks while avoiding the creation of distracting "visual clutter".The project will also develop the science that is needed to direct a person's gaze in the physical world by means of new visualization techniques for use in mobile augmented reality systems. In this case, it is as if the piece of glass through which you are viewing the world periodically changed slightly to unobtrusively motivate you to look more closely at different, specific, task-relevant parts of the scene. This aspect of the project will be conducted in collaboration with the Houston Museum of Fine Arts.Broader Impacts: The project will advance discovery of visualization techniques to permit mobile applications to enhance the viewing of the physical world, while promoting the teaching and learning of science in multiple contexts. Collaborating with the Houston Museum of Fine Arts, the project will develop a freely-downloadable iPhone application that will enhance museum-goers' learning in the arts, and provide a proof-of-concept of how the techniques developed in this project could be used in other contexts.The project pursues a number of specific new opportunities in science education, including the development of (a) project-related curriculum for a science-based summer camp for junior high school students at Texas A&M University, (b) new University-level courses on the programming for augmented reality and the human performance aspects of lighting and cinematography, and (c) conference tutorials on experimental design, eye tracking, and perception in computer graphics.