MIDAS Projection: Markerless and Modelless Dynamic Projection Mapping for Material Representation
MIDAS Projection: Markerless and Modelless Dynamic Projection Mapping for Material Representation
复制标题
DOI：
10.1145/3272127.3275045
复制
发表时间：
2018-11-01
影响因子：
6.2
通讯作者：
Ishikawa, Masatoshi
中科院分区：
文献类型：
--
作者：
Miyashita, Leo;Watanabe, Yoshihiro;Ishikawa, Masatoshi
可以通过投影虚拟阴影来伪装对象的视觉外观，就像覆盖材质一样。然而，传统的投影映射方法依赖于目标上的标记或目标形状的模型，这限制了目标的类型和视觉质量。在本文中，我们关注虚拟场景中虚拟材质的着色主要由目标的表面法线来表征的事实，并尝试实现材质表示的无标记和无模型投影映射。为了在不干扰可见光的情况下处理各种目标，包括静态、动态、刚性、柔软和流体物体，我们实时测量红外区域的表面法线，并使用新型高速纹理算法在屏幕空间中投影材质阴影。我们的系统以毫秒级延迟实现了均匀材质和可平铺纹理材质的 500 fps 高速投影映射，并实现了未知物体的动态灵活的材质表示。我们还演示了先进的应用程序，并展示了我们技术的富有表现力的着色性能。
The visual appearance of an object can be disguised by projecting virtual shading as if overwriting the material. However, conventional projection-mapping methods depend on markers on a target or a model of the target shape, which limits the types of targets and the visual quality. In this paper, we focus on the fact that the shading of a virtual material in a virtual scene is mainly characterized by surface normals of the target, and we attempt to realize markerless and modelless projection mapping for material representation. In order to deal with various targets, including static, dynamic, rigid, soft, and fluid objects, without any interference with visible light, we measure surface normals in the infrared region in real time and project material shading with a novel high-speed texturing algorithm in screen space. Our system achieved 500-fps high-speed projection mapping of a uniform material and a tileable-textured material with millisecond-order latency, and it realized dynamic and flexible material representation for unknown objects. We also demonstrated advanced applications and showed the expressive shading performance of our technique.