A Robust Method for Resolving Incorrect Visual Occlusion in Dynamic Augmented Reality Environments of Animated Engineering Operations

该项目的目标是研究和设计一种功能准确的遮挡处理方法，可以轻松集成到任何增强现实（AR）应用程序中。AR是一种新兴的可视化技术，它以CAD对象的形式将计算机生成的场景与真实环境的视图融合在一起。从AR场景的观察者的角度来看，当真实物体的一部分或整个必须阻挡观察者时，就会发生不正确的视觉遮挡。一个虚拟（即CAD）对象的视图。如果不能准确地解决，不正确的遮挡会导致不令人信服的视觉伪影，从而降低观察者的注意力。在AR视觉模拟中的可信度和可靠性，从而阻止他们和其他决策者舒适地使用模拟结果做出关键决策。本研究提出了一种新的几何捕获、遥感和数据通信技术的集成，以实现工程操作的AR动画的真实、可靠和视觉上令人信服的结果。研究目标将通过开发一种自动化方法来获取、记录和检索工程操作的AR动画场景中虚拟和真实实体的深度信息，并使用遥感设备和z缓冲技术来实时检测和解决任何识别出的不正确的视觉遮挡实例，从而实现。通过使用先进的AR可视化技术，更好地了解项目发生的工程环境，研究的成功将显著提高作业的生产率、准确性和安全性。研究结果将适用于解决建筑、土木工程、制造、机械设计、医药、造船、运输等领域的广泛工程问题。解决遮挡问题对于未来的工作也是必要的，例如碰撞检测，运动抢占，以及AR中真实和虚拟物体之间的物理干扰，所有这些都是长期存在的问题，阻碍了动态AR在几个工程和科学领域的广泛应用。该项目将极大地帮助研究生和本科生的职业发展，包括女性和少数民族工程师，他们将积极参与研究活动，准备成为明天？年代工程师。该项目将导致新的软件工具和培训材料，它们将被广泛地分发给工程、教育、研究和专业团体，以增强科学和技术的理解。

The objective of this project is to investigate and design a functional and accurate occlusion handling method that can be easily integrated into any Augmented Reality (AR) application. AR is an emerging visualization technology which blends computer generated scenes in the form of CAD objects with the views of the real environment. From the point of view of an observer of an AR scene, incorrect visual occlusion occurs when part or whole of a real object must block the observer?s view of a virtual (i.e. CAD) object. If not resolved accurately, incorrect occlusion leads to unconvincing visual artifacts that reduce the observer?s confidence and reliability in the AR visual simulations, and consequently prevents them and other decision makers from comfortably using the simulation results for making crucial decisions. This research proposes a novel integration of geometry capture, remote sensing, and data communication technologies to enable realistic, reliable, and visually convincing results in AR animations of engineering operations. The research objective will be achieved by developing an automated method to obtain, record, and retrieve the depth information for both virtual and real entities in an AR animated scene of an engineering operation using remote sensing devices, and a z-buffering technique to detect and resolve any identified incorrect visual occlusion instances in real-time. Success in the research will lead to significant increases in productivity, accuracy, and safety in performance of operations due to better understanding of the engineering environment in which projects take place, through the use of advanced AR visualization technology. The results will be applicable to solve a wide range of engineering problems in construction, civil engineering, manufacturing, mechanical design, medicine, shipbuilding, transportation, and other domains. Solving the occlusion problem is also necessary to enable future work on subjects such as collision detection, motion preemption, and physical interference between real and virtual objects in AR, all of which have been long standing problems that prevent the widespread application of dynamic AR in several engineering and scientific domains. This project will significantly help the career development of graduate and undergraduate students, including women and minority engineers who will actively participate in the research activities and prepare to become tomorrow?s engineers. The project will lead to new software tools and training materials that will be widely distributed to the engineering, education, research, and professional communities to enhance scientific and technological understanding.