High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin Deformation
High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin Deformation
复制标题
具有真实皮肤变形的高速动态投影映射到人体手臂上
作者：
Hao;Yoshihiro Watanabe
根据运动物体的位置和形状对运动物体进行动态投影映射是增强现实模拟目标表面变化的基础。例如，通过动态投影映射增强人类手臂表面可以增强时尚、用户界面、原型设计、教育、医疗援助和其他领域的应用。然而，对于这样的应用，常规方法忽略皮肤变形，并且在运动和投影之间具有高延迟，导致目标手臂表面和投影图像之间的显著未对准。这些问题降低了用户体验并限制了更多应用程序的开发。我们提出了一个系统的高速动态投影映射到一个快速移动的人的手臂与现实的皮肤变形。使用所开发的系统，用户不会感觉到手臂表面和投影图像之间的任何未对准。首先，我们结合联合收割机一个国家的最先进的参数化可变形表面模型与有效的基于回归的精度补偿来表示皮肤变形。通过补偿，我们修改纹理坐标，以实现快速和准确的图像生成的投影映射的联合跟踪。其次，我们开发了一个高速系统，它提供了一个运动和投影之间的延迟低于10毫秒，这是人类视觉通常无法察觉的。与传统方法相比，该系统提供了更真实的经验，并增加了动态投影映射的适用性。
Dynamic projection mapping for a moving object according to its position and shape is fundamental for augmented reality to resemble changes on a target surface. For instance, augmenting the human arm surface via dynamic projection mapping can enhance applications in fashion, user interfaces, prototyping, education, medical assistance, and other fields. For such applications, however, conventional methods neglect skin deformation and have a high latency between motion and projection, causing noticeable misalignment between the target arm surface and projected images. These problems degrade the user experience and limit the development of more applications. We propose a system for high-speed dynamic projection mapping onto a rapidly moving human arm with realistic skin deformation. With the developed system, the user does not perceive any misalignment between the arm surface and projected images. First, we combine a state-of-the-art parametric deformable surface model with efficient regression-based accuracy compensation to represent skin deformation. Through compensation, we modify the texture coordinates to achieve fast and accurate image generation for projection mapping based on joint tracking. Second, we develop a high-speed system that provides a latency between motion and projection below 10 ms, which is generally imperceptible by human vision. Compared with conventional methods, the proposed system provides more realistic experiences and increases the applicability of dynamic projection mapping.
登录
查看更多内容
DOI：
10.1007/978-3-030-58517-4_16
发表时间：
2020-07
期刊：
--
影响因子：
--
作者：
Chao Li;Xiaohu Guo
通讯作者：
Chao Li;Xiaohu Guo
DOI：
10.1109/tvcg.2017.2734428
发表时间：
2017-08
影响因子：
5.2
作者：
C. Siegl;Vanessa Lange;M. Stamminger;F. Bauer;Justus Thies
通讯作者：
C. Siegl;Vanessa Lange;M. Stamminger;F. Bauer;Justus Thies
DOI：
10.1145/2816795.2818111
发表时间：
2015
期刊：
ACM Transactions on Graphics (TOG)
影响因子：
--
作者：
C. Siegl;M. Colaianni;L. Thies;J. Thies;M. Zollhöfer;S. Izadi;M. Stamminger;F. Bauer
通讯作者：
F. Bauer
影响因子：
6.2
作者：
Zollhoefer, Michael;Niessner, Matthias;Stamminger, Marc
通讯作者：
Stamminger, Marc