Factored Occlusion: Single Spatial Light Modulator Occlusion-capable Optical See-through Augmented Reality Display
Factored Occlusion: Single Spatial Light Modulator Occlusion-capable Optical See-through Augmented Reality Display
复制标题
因子遮挡：单空间光调制器支持遮挡的光学透视增强现实显示器
DOI：
--
复制
发表时间：
2020
影响因子：
5.2
通讯作者：
Gordon Wetzstein
中科院分区：
文献类型：
--
作者：
Brooke Krajancich;Nitish Padmanaban;Gordon Wetzstein
遮挡是一种强大的视觉线索，对于光学透视增强现实（OST-AR）中的深度感知和真实感至关重要。然而，现有的OST-AR系统通过光束组合器叠加物理和数字内容-这种方法不容易支持相互遮挡，导致虚拟对象看起来半透明和不真实。在这项工作中，我们提出了一种新型的闭塞能力的OST-AR系统。而不是添加组合的真实的和虚拟世界，我们采用一个单一的数字放大器设备（DMD）合并各自的光路在乘法的方式。这种独特的方法使我们能够在逐像素的基础上同时阻挡来自物理场景的光入射，同时还调制发光二极管（LED）发出的光以显示数字内容。我们的技术建立在混合二进制/连续分解算法的基础上，以优化时分复用二进制DMD图案及其相应的LED颜色，以近似目标增强现实（AR）场景。在模拟和一个原型台式显示器，我们证明了硬边缘遮挡，合理的阴影，也凝视这种新的显示模式，它只需要一个单一的空间光调制器的条件优化。
Occlusion is a powerful visual cue that is crucial for depth perception and realism in optical see-through augmented reality (OST-AR). However, existing OST-AR systems additively overlay physical and digital content with beam combiners – an approach that does not easily support mutual occlusion, resulting in virtual objects that appear semi-transparent and unrealistic. In this work, we propose a new type of occlusion-capable OST-AR system. Rather than additively combining the real and virtual worlds, we employ a single digital micromirror device (DMD) to merge the respective light paths in a multiplicative manner. This unique approach allows us to simultaneously block light incident from the physical scene on a pixel-by-pixel basis while also modulating the light emitted by a light-emitting diode (LED) to display digital content. Our technique builds on mixed binary/continuous factorization algorithms to optimize time-multiplexed binary DMD patterns and their corresponding LED colors to approximate a target augmented reality (AR) scene. In simulations and with a prototype benchtop display, we demonstrate hard-edge occlusions, plausible shadows, and also gaze-contingent optimization of this novel display mode, which only requires a single spatial light modulator.