IIS/HCI: Collaborative Research: Development and Assessment of Head-Mounted Fovea-Contingent Display Technology

虽然头戴式显示器（HMD）技术已经经历了显著的发展，并且它们对于3D可视化的功能益处已经被认识到，但是它们受到能力的权衡和限制，这对可视化准确性、用户性能和用户安全造成了关键影响。 这些问题中最主要的是对眼球运动的无知。 大多数最先进的HMD使用头部姿势来近似视线，这可能导致用户想要看的东西和他们实际看到的东西之间的显著差异。 将眼动跟踪能力集成到HMD中将显著改善显示质量和用户界面。 在该项目中，PI将从低级别光学配置优化HMD-眼动仪集成的概念设计; PI希望通过这种方式实现比现成的商用显示器和眼动仪集成更紧凑、舒适、易于使用和可靠的系统。 PI将建立一个全面的方法来校准和定量评估测试平台，并量化虚拟物体的渲染和感知深度/大小表示，无论是否具有HMD中的眼动跟踪功能; PI期望由此确定整合是否可以显著改善眼睛跟踪准确度和显示质量的性能，因为它涉及真实的和虚拟的配准的准确度和精度。增强环境中的物体。 最后，将开展两项试点研究。 其中第一个将探索独特的视中央凹为条件的显示方案的概念，该方案利用光子技术在注视点处定位高分辨率的插入物，创新地没有移动部件，以便解决传统HMD中存在的视场和分辨率之间的权衡。 第二项试点研究将研究远程协作环境中的“通过观看来指向”视觉界面，在这种环境中，参与者的注意力焦点跟随远程协作者的关注点，反之亦然。更广泛的影响：这项研究不仅将提高显示质量和用户界面，最重要的是它将推动增强现实技术的新的令人兴奋的应用。 特别是，新的HDM眼动仪技术将为信息检索带来新的交互界面，为人为因素和视觉研究提供更准确的眼动监测，支持改善虚拟环境中的行为评估，并为某些类型的残疾人提供新的交互和交流方法。 基础光学科学和工程，计算机图形学，人为因素和实践经验的混合物与建设一个试验台将是一个很好的跨学科的研究生和本科生参与培训的基础。

While head-mounted display (HMD) technologies have undergone significant developments and their functional benefits for 3D visualization have been recognized, they have suffered from tradeoffs and limitations in capability, which impose critical affects on visualization accuracy, user performance, and user safety. Chief among these problems is an ignorance of eye movement. Most state-of-the-art HMDs use head pose to approximate line-of-sight, which may cause a significant disparity between what users are intended to look at and what they actually see. The integration of eye tracking capability into HMDs would significantly improve display quality and user interface. In this project, the PIs will optimize the conceptual design of HMD-eye tracker integration from low-level optical configurations; the PIs expect to achieve by this means a more compact, comfortable, easy-to-use, and dependable system than would result from integration of off-the-shelf commercially available displays and eye trackers. The PIs will set up a comprehensive methodology to calibrate and quantitatively assess the testbed, and to quantify rendered and perceived depth/size representations of virtual objects with and without eye tracking capability in the HMD; the PIs expect thereby to determine whether integration can significantly improve the performance of both eye tracking accuracy and display quality as it relates to accuracy and precision of registration of real and virtual objects in augmented environments. Finally, two pilot studies will be pursued. The first of these will explore the concept of a unique fovea-contingent display scheme which utilizes photonics technology to position a high resolution inset at the gaze point, innovatively with no moving parts, in order to address the trade-off between field of view and resolution existing in conventional HMDs. The second pilot study will investigate a "pointing by looking" visual interface in remote collaborative environments in which the focus of attention of a participant follows the point-of-regard of a remote collaborator, or vice versa.Broader Impacts: This research will not only advance display quality and the user interface, but most importantly it will drive new and thrilling applications of augmented reality technology. In particular, the new HDM-eye tracker technology will lead to novel interactive interfaces for information retrieval, will provide more accurate eye-movement monitoring for human factors and vision research, will support improved assessment of behavior in virtual environments, and will afford new methods of interaction and communication for people with certain types of disabilities. The mixture of basic optical science and engineering, computer graphics, human factors, and hands-on experience with building a testbed will be an excellent interdisciplinary training ground for the graduate and undergraduate students involved.