Multiple planes based registration using 3D Projective Space for Augmented Reality

Multiple planes based registration using 3D Projective Space for Augmented Reality
复制标题

DOI:
10.1016/j.imavis.2009.01.003
复制
发表时间:
2009-09
期刊:
Image Vis. Comput.
影响因子:
--
通讯作者:
Yuko Uematsu;H. Saito
Yuko Uematsu;H. Saito
中科院分区:
其他
文献类型:
--
作者:
Yuko Uematsu;H. Saito

文献摘要

被引文献

相似文献

提出了一种基于视觉的增强现实(AR)注册方法,使用包含多个平面结构的真实的场景。我们的方法为用户提供了一个增强的视图的真实的场景覆盖计算机生成的虚拟对象上捕获的图像与一个可移动的相机。虚拟对象与3D平面结构相关联,并且看起来随该结构移动。为了将虚拟物体的坐标与相机捕获的图像的坐标对准,应该通过跟踪和整合多个平面来估计相机的运动。与相关工作相比,该方法不需要多个平面之间的几何关系的先验知识,因为几何关系是由“投影空间”自动估计的。该空间是3D的,并且通过两个参考图像的投影重建来定义。使用投影空间的自动估计可以消除测量平面的耗时任务以及平面布置的限制,例如仅垂直或共面。因此,所提出的方法可以适用于复杂的多平面场景。
We propose a vision-based registration method for Augmented Reality (AR) that uses real scenes containing multiple planar structures. Our method provides users with an enhanced view of a real scene by overlaying computer-generated virtual objects onto images captured with a movable camera. The virtual objects are associated with a 3D planar structure and appeared to move with that structure. To align the coordinates of the virtual objects with the coordinates of the images captured with the camera, the camera’s motion should be estimated for every frame by tracking and integrating the multiple planes. In contrast with related work, the proposed method does not require a priori knowledge about the geometrical relationships among the multiple planes because the geometrical relationship is automatically estimated by “Projective Space”. This space is 3D and is defined by projective reconstruction of two reference images. Automatic estimation using the Projective Space can eliminate the time-consuming task of measuring the planes and the constraints of plane arrangement, e.g. only vertical or co-planar. Therefore, the proposed method can be applied even to complicated multi-planar scenes.