HySAR: Hybrid Material Rendering by an Optical See-Through Head-Mounted Display with Spatial Augmented Reality Projection
HySAR: Hybrid Material Rendering by an Optical See-Through Head-Mounted Display with Spatial Augmented Reality Projection
复制标题
DOI：
10.1109/tvcg.2018.2793659
复制
发表时间：
2018-04-01
影响因子：
5.2
通讯作者：
Sugimoto, Maki
中科院分区：
文献类型：
--
作者：
Hamasaki, Takumi;Itoh, Yuta;Sugimoto, Maki
空间增强现实（SAR）在渲染材料和物体时追求真实感。为了实现这一目标，我们提出了一种混合SAR (HySAR)，它结合了投影仪和光学透明头戴式显示器（OST-HMD）。在同一位置观看者的普通SAR场景中，观看者在物理表面上感知到相同的虚拟材料。一般来说，材料由两个组件组成：一个视图无关（VI）组件，如漫反射，和一个视图相关（VD）组件，如镜面反射。VI组件在视点上是静态的，而VD应该在每个视点上改变，即使投影仪一次只能模拟一个视点。在HySAR中，投影仪只渲染静态的VI组件。此外，OST-HMD根据观看者当前的视点呈现动态VD组件。与传统的SAR不同，HySAR概念理论上允许无限数量的共同定位的观看者在不同的视点上看到正确的材料。此外，该组合还提高了感知材料的总动态范围、最大强度和分辨率。通过概念验证系统，我们用真实物体定性和定量地演示了HySAR。首先，我们通过从不同角度在真实物体上渲染合成材料属性来演示HySAR。定量评价表明，与普通SAR系统相比，该系统的动态范围提高了2.24倍，最大强度提高了2.12倍。其次，我们通过SAR和HySAR复制真实物体的材料属性，并表明HySAR在渲染VD镜面组件方面优于SAR。
Spatial augmented reality (SAR) pursues realism in rendering materials and objects. To advance this goal, we propose a hybrid SAR (HySAR) that combines a projector with optical see-through head-mounted displays (OST-HMD). In an ordinary SAR scenario with co-located viewers, the viewers perceive the same virtual material on physical surfaces. In general, the material consists of two components: a view-independent (VI) component such as diffuse reflection, and a view-dependent (VD) component such as specular reflection. The VI component is static over viewpoints, whereas the VD should change for each viewpoint even if a projector can simulate only one viewpoint at one time. In HySAR, a projector only renders the static VI components. In addition, the OST-HMD renders the dynamic VD components according to the viewer's current viewpoint. Unlike conventional SAR, the HySAR concept theoretically allows an unlimited number of co-located viewers to see the correct material over different viewpoints. Furthermore, the combination enhances the total dynamic range, the maximum intensity, and the resolution of perceived materials. With proof-of-concept systems, we demonstrate HySAR both qualitatively and quantitatively with real objects. First, we demonstrate HySAR by rendering synthetic material properties on a real object from different viewpoints. Our quantitative evaluation shows that our system increases the dynamic range by 2.24 times and the maximum intensity by 2.12 times compared to an ordinary SAR system. Second, we replicate the material properties of a real object by SAR and HySAR, and show that HySAR outperforms SAR in rendering VD specular components.