Restoring the Awareness in the Occluded Visual Field for Optical See-Through Head-Mounted Displays
Restoring the Awareness in the Occluded Visual Field for Optical See-Through Head-Mounted Displays
复制标题
DOI：
10.1109/tvcg.2018.2868559
复制
发表时间：
2018-09
影响因子：
5.2
通讯作者：
Long Qian;Alexander Plopski;Nassir Navab;P. Kazanzides
中科院分区：
文献类型：
--
作者：
Long Qian;Alexander Plopski;Nassir Navab;P. Kazanzides
最近的技术进步支持光学透明头戴式显示器（ost - hmd）在导航和制造等关键情况下的应用。然而，虽然OST-HMD的外形因素比过去占用用户视野的面积更小，但它仍然会导致严重的疏忽，例如，在驾驶汽车时错过行人。在本文中，我们设计并比较了两种方法来补偿由于ost - hmd引起的遮挡而导致的意识损失。我们不是将遮挡的内容呈现给用户，而是检测用户不可见的运动，并在HMD屏幕的边缘突出显示其方向，或者通过激活放置在用户周边视觉中的led。这些方法包括一个离线阶段，其中确定被遮挡的视野和每个指示器及其相关的遮挡感兴趣区域（OROI）的位置，以及一个在线阶段，其中增强光流算法跟踪被遮挡的视野中的运动。我们已经在微软HoloLens和ODG R-9上实现了这两种方法。我们的原型系统在客观评估中达到100%的成功率，在试点用户研究中达到98.90%。我们的方法能够弥补最先进的ost - hmd遮挡视野中安全关键信息的损失，并可以扩展到他们的后代。
Recent technical advancements support the application of Optical See-Through Head-Mounted Displays (OST-HMDs) in critical situations like navigation and manufacturing. However, while the form-factor of an OST-HMD occupies less of the user's visual field than in the past, it can still result in critical oversights, e.g., missing a pedestrian while driving a car. In this paper, we design and compare two methods to compensate for the loss of awareness due to the occlusion caused by OST-HMDs. Instead of presenting the occluded content to the user, we detect motion that is not visible to the user and highlight its direction either on the edge of the HMD screen, or by activating LEDs placed in the user's peripheral vision. The methods involve an offline stage, where the occluded visual field and location of each indicator and its associated occluded region of interest (OROI) are determined, and an online stage, where an enhanced optical flow algorithm tracks the motion in the occluded visual field. We have implemented both methods on a Microsoft HoloLens and an ODG R-9. Our prototype systems achieved success rates of 100% in an objective evaluation, and 98.90% in a pilot user study. Our methods are able to compensate for the loss of safety-critical information in the occluded visual field for state-of-the-art OST-HMDs and can be extended for their future generations.