HCC: Small: Effective Augmented Reality Depth Representation Methods and Accuracy Evaluations Inspired by Medical Applications

增强现实(AR)系统是利用计算机数据增强对世界中的物理对象的观看的计算机系统，由于如何准确地向人传达计算机生成的对象想要出现在该人的多远这一未解决的人-机交互问题，许多真实世界应用目前阻碍了其广泛使用。使用AR系统的人经常误判AR呈现对象的深度。对于看起来应该位于不透明遮挡表面后面的AR对象来说尤其如此；在这种情况下，AR应该产生一种使遮挡表面看起来变得透明的“x射线视觉”感知体验。这个问题背后的知觉现象涉及(A)AR技术自然产生的相互冲突的深度线索，特别是光学“X-射线视觉”AR中不正确的遮挡线索，(B)已开发的测量到达距离内的深度知觉的技术得出的相互矛盾的结果，以及(C)练习和反馈在纠正这些深度错误判断方面的作用。本项目将评估AR深度表示方法并解释潜在现象，重点放在医学AR任务和应用上。该项目将开发和评估一种头戴式单向镜，以允许研究人员研究调节和收敛AR的深度线索。该项目将创建和评估基于融合的方法来深度呈现AR信息；即，人们可以根据需要旋转眼睛来控制物理对象内部计算机数据的外观，以查看近距离和远距离的对象。该项目的研究人员将与专家合作，将AR用于医疗应用，以开发医疗领域基于融合的AR“X-射线视觉”的新技术。更广泛的影响：基于Version的AR应用程序有可能改善一系列医疗程序的健康结果，还可以提高制造和设备维护等任务领域的人类能力。该项目将加快成功开发和部署此类应用程序的时间框架。从事这个项目的学生将在跨学科的背景下接受培训，严格研究计算机图形和人类感知之间的密切相互作用。该项目的跨学科和以人为本的方面将有助于招收那些本来可能不太可能对计算机科学感兴趣的学生。

Augmented reality (AR) systems, which are computer systems that enhance the viewing of physical objects in the world with computer data, are currently held back from widespread use for many real-world applications because of the unsolved human-computer interaction problem of how to accurately convey to a person how far away from that person a computer-generated object is intended to appear. People using AR systems routinely misjudge the depth of AR-presented objects. This is especially true for AR objects that should appear to be located behind opaque occluding surfaces; in this case AR should produce an "x-ray vision" perceptual experience that makes the occluding surface appear to become transparent. The perceptual phenomena that underlie this problem relate to (a) conflicting depth cues that naturally arise with AR technology, especially incorrect occlusion cues in optical "x-ray vision" AR, (b) conflicting findings from techniques that have been developed to measure depth perception within reaching distance, and (c) the role of practice and feedback in training to correct these depth misjudgments.This project will evaluate AR depth representation methods and explain the underlying phenomena, with an emphasis on medical AR tasks and applications. The project will develop and evaluate a head-worn haploscope to allow researchers to study the depth cues of accommodation and vergence AR. The project will create and evaluate vergence-based methods for rendering AR information in depth; that is, techniques in which people can control the appearance of computer data inside of a physical object by rotating their eyes as is needed to look at near and far objects. The researchers on this project will collaborate with experts on the use of AR for medical applications to develop new vergence-based techniques for AR "x-ray vision" in the medical domain. Broader Impacts: Vergence-based AR applications have the potential to improve health outcomes for a broad array of medical procedures, and also to improve human capabilities in task domains such as manufacturing and equipment maintenance. This project will hasten the timeframe for successfully developing and deploying such applications. Students working on this project will be trained in an interdisciplinary context that rigorously studies the intimate interplay between computer graphics and human perception. The interdisciplinary and human-centered aspects of the project will help to recruit students who might otherwise be less likely to gravitate to computer science.