Structure of Multiple Mirror System From Kaleidoscopic Projections of Single 3D Point
Structure of Multiple Mirror System From Kaleidoscopic Projections of Single 3D Point
复制标题
DOI：
10.1109/tpami.2021.3070347
复制
发表时间：
2021-03
影响因子：
23.6
通讯作者：
Kosuke Takahashi;S. Nobuhara
中科院分区：
文献类型：
--
作者：
Kosuke Takahashi;S. Nobuhara
本文提出了一种新的算法来发现由多个平面镜和一个摄像机组成的万花筒成像系统的结构。万花筒成像系统可以被认为是虚拟多摄像机系统，并且具有很强的优势，因为虚拟摄像机是严格同步的，并且具有相同的内参数。本文主要研究虚拟多摄像机系统的外定标问题。本文要解决的问题是双重的。第一个问题是识别镜像的3D点的每个2D投影属于哪个镜室。第二个问题是估计所有镜参数，即，法线和镜子的距离。本文的主要贡献是提出了新的算法，这些问题使用一个单一的三维点的未知几何形状，利用万花筒投影约束，这是一个极线约束镜面反射。我们证明了所提出的算法的室分配和估计的反射镜参数的定性和定量评价使用合成和真实的数据的性能。
This paper proposes a novel algorithm of discovering the structure of a kaleidoscopic imaging system that consists of multiple planar mirrors and a camera. The kaleidoscopic imaging system can be recognized as the virtual multi-camera system and has strong advantages in that the virtual cameras are strictly synchronized and have the same intrinsic parameters. In this paper, we focus on the extrinsic calibration of the virtual multi-camera system. The problems to be solved in this paper are two-fold. The first problem is to identify to which mirror chamber each of the 2D projections of mirrored 3D points belongs. The second problem is to estimate all mirror parameters, i.e., normals, and distances of the mirrors. The key contribution of this paper is to propose novel algorithms for these problems using a single 3D point of unknown geometry by utilizing a kaleidoscopic projection constraint, which is an epipolar constraint on mirror reflections. We demonstrate the performance of the proposed algorithm of chamber assignment and estimation of mirror parameters with qualitative and quantitative evaluations using synthesized and real data.