Sticky projections — A new approach to interactive shader lamp tracking
Sticky projections — A new approach to interactive shader lamp tracking
复制标题
粘性投影 - 交互式着色器灯跟踪的新方法
DOI：
--
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
G. Klinker
中科院分区：
文献类型：
--
作者：
Christoph Resch;P. Keitler;G. Klinker
着色器灯可以增强物理对象与投影虚拟复制使用相机投影仪系统，提供物理和虚拟对象很好地注册。在过去，精确的登记和跟踪是一个繁琐和侵入性的过程。本文提出了一种交互式跟踪任意形状物理对象的新方法。与之前的方法相比，我们的系统是可移动的，并且只使用虚拟复制的投影来跟踪物理对象并“粘贴”投影。我们的方法包括两个阶段，基于结构光模式的快速姿态初始化和基于投影中检测到的特征的非侵入式逐帧跟踪。在初始化阶段，重建物理对象的密集点云，并与虚拟模型精确匹配，以完美覆盖投影。在跟踪阶段，基于当前姿态预测的辐射校正虚拟摄像机视图被渲染并与捕获的图像进行比较。匹配的特征被三角化，提供一组稀疏的表面点，这些点与虚拟模型对齐。对准变换作为新姿态预测的输入。定量实验表明，该方法能够以交互速率鲁棒地跟踪复杂目标。
Shader lamps can augment physical objects with projected virtual replications using a camera-projector system, provided that the physical and virtual object are well registered. Precise registration and tracking has been a cumbersome and intrusive process in the past. In this paper, we present a new method for tracking arbitrarily shaped physical objects interactively. In contrast to previous approaches our system is mobile and makes solely use of the projection of the virtual replication to track the physical object and “stick” the projection to it. Our method consists of two stages, a fast pose initialization based on structured light patterns and a non-intrusive frame-by-frame tracking based on features detected in the projection. In the initialization phase a dense point cloud of the physical object is reconstructed and precisely matched to the virtual model to perfectly overlay the projection. During the tracking phase, a radiometrically corrected virtual camera view based on the current pose prediction is rendered and compared to the captured image. Matched features are triangulated providing a sparse set of surface points that is robustly aligned to the virtual model. The alignment transformation serves as an input for the new pose prediction. Quantitative experiments show that our approach can robustly track complex objects at interactive rates.