IIS/HCI: Collaborative Research: Development and Assessment of Head-Mounted Fovea-Contingent Display Technology

IIS/HCI：合作研究：头戴式中央凹视情况显示技术的开发和评估

• 批准号: 0307227
• 负责人: Hong Hua
• 金额: $ 37.58万
• 依托单位: University of Hawaii
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2003
• 资助国家: 美国
• 起止时间: 2003-05-01 至 2004-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0307227&HistoricalAwards=false
• 关键词: IIS; HCI; Collaborative; Research; Development

While head-mounted display (HMD) technologies have undergone significant developments and their functional benefits for 3D visualization have been recognized, they have suffered from tradeoffs and limitations in capability, which impose critical affects on visualization accuracy, user performance, and user safety. Chief among these problems is an ignorance of eye movement. Most state-of-the-art HMDs use head pose to approximate line-of-sight, which may cause a significant disparity between what users are intended to look at and what they actually see. The integration of eye tracking capability into HMDs would significantly improve display quality and user interface. In this project, the PIs will optimize the conceptual design of HMD-eye tracker integration from low-level optical configurations; the PIs expect to achieve by this means a more compact, comfortable, easy-to-use, and dependable system than would result from integration of off-the-shelf commercially available displays and eye trackers. The PIs will set up a comprehensive methodology to calibrate and quantitatively assess the testbed, and to quantify rendered and perceived depth/size representations of virtual objects with and without eye tracking capability in the HMD; the PIs expect thereby to determine whether integration can significantly improve the performance of both eye tracking accuracy and display quality as it relates to accuracy and precision of registration of real and virtual objects in augmented environments. Finally, two pilot studies will be pursued. The first of these will explore the concept of a unique fovea-contingent display scheme which utilizes photonics technology to position a high resolution inset at the gaze point, innovatively with no moving parts, in order to address the trade-off between field of view and resolution existing in conventional HMDs. The second pilot study will investigate a "pointing by looking" visual interface in remote collaborative environments in which the focus of attention of a participant follows the point-of-regard of a remote collaborator, or vice versa.Broader Impacts: This research will not only advance display quality and the user interface, but most importantly it will drive new and thrilling applications of augmented reality technology. In particular, the new HDM-eye tracker technology will lead to novel interactive interfaces for information retrieval, will provide more accurate eye-movement monitoring for human factors and vision research, will support improved assessment of behavior in virtual environments, and will afford new methods of interaction and communication for people with certain types of disabilities. The mixture of basic optical science and engineering, computer graphics, human factors, and hands-on experience with building a testbed will be an excellent interdisciplinary training ground for the graduate and undergraduate students involved.

虽然头戴式显示器 (HMD) 技术已经取得了重大发展，并且其 3D 可视化的功能优势已得到认可，但它们在功能上存在权衡和限制，这对可视化准确性、用户性能和用户安全产生了关键影响。 这些问题中最主要的是对眼球运动的无知。 大多数最先进的头戴式显示器使用头部姿势来近似视线，这可能会导致用户想要看到的内容与他们实际看到的内容之间存在显着差异。 将眼动追踪功能集成到 HMD 中将显着改善显示质量和用户界面。 在该项目中，PI将从低级光学配置优化HMD眼动追踪器集成的概念设计； PI 希望通过这种方式实现比集成现成的商用显示器和眼动仪更紧凑、舒适、易于使用且可靠的系统。 PI 将建立一套全面的方法来校准和定量评估测试平台，并量化 HMD 中具有或不具有眼动追踪功能的虚拟对象的渲染和感知深度/大小表示； PI 希望借此确定集成是否可以显着提高眼动追踪准确性和显示质量的性能，因为它关系到增强环境中真实和虚拟对象注册的准确性和精度。 最后，将进行两项试点研究。 其中第一个将探索独特的中央凹偶然显示方案的概念，该方案利用光子技术在凝视点处创新地定位高分辨率嵌入物，没有移动部件，以解决传统头显中存在的视野和分辨率之间的权衡问题。 第二项试点研究将调查远程协作环境中的“通过观看来指点”视觉界面，其中参与者的注意力焦点跟随远程协作者的关注点，反之亦然。更广泛的影响：这项研究不仅将提高显示质量和用户界面，而且最重要的是，它将推动增强现实技术的新的、令人兴奋的应用。 特别是，新的HDM眼动仪技术将为信息检索带来新颖的交互界面，为人为因素和视觉研究提供更准确的眼动监测，支持改进虚拟环境中的行为评估，并为某些类型的残疾人提供新的交互和沟通方法。 基础光学科学与工程、计算机图形学、人为因素以及构建测试平台的实践经验的结合将成为所涉及的研究生和本科生的绝佳跨学科训练场。