Towards Mobile Diminished Reality
Towards Mobile Diminished Reality
复制标题
迈向移动缩小现实
DOI：
--
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
Mohammad Rouhani
中科院分区：
文献类型：
--
作者：
Glen Queguiner;Matthieu Fradet;Mohammad Rouhani
我们提出了一个减少现实的应用程序上运行的消费者移动的设备。在我们的基于预观察的方法中，干净的3D场景，没有不需要的对象，被预先扫描并重建为高分辨率纹理3D模型。在运行时，通过投影先前捕获的背景来有效地移除在感兴趣区域中添加的对象。扫描时间和运行时间之间的照明条件的差异进行补偿，以获得无缝的结果。所提出的方法不需要分割或手动输入以外的3D感兴趣区域的定义要减少，并且不基于任何特定的假设的背景几何形状。我们通过处理各种具有挑战性的未知3D场景，包括纹理背景，动态照明条件和前景物体部分遮挡缩小区域，展示了我们的方法的潜力。我们提供了计算着色器实现的详细信息，以使社区尽可能容易地重新实现。
We present a diminished reality application running live on consumer mobile devices. In our pre-observation-based approach, the clean 3D scene, free of undesired objects, is scanned beforehand and reconstructed as a high resolution textured 3D model. At runtime, objects added in a region of interest are efficiently removed by projecting the previously captured background. Differences of illumination conditions between scan time and run-time are compensated to obtain seamless results. The proposed approach requires no segmentation or manual input other than the definition of the 3D region of interest to be diminished, and is not based on any particular assumption on the background geometry. We show the potential of our approach by processing a variety of challenging unknown 3D scenes including textured backgrounds, dynamic illumination conditions and foreground objects partially occluding the diminished region. We provide details on our compute shader implementation to make as easy as possible the reimplementation by the community.