Omnidirectional Panoramic Video System With Frame-by-Frame Ultrafast Viewpoint Control
Omnidirectional Panoramic Video System With Frame-by-Frame Ultrafast Viewpoint Control
复制标题
DOI：
10.1109/lra.2022.3150484
复制
发表时间：
2022-04-01
影响因子：
5.2
通讯作者：
Ishii，Idaku
中科院分区：
文献类型：
--
作者：
Hu，Shaopeng;Dong，Hongyu;Ishii，Idaku
本研究发展一个全方位全景影像系统，借由每秒数百帧的同步摄影，以每秒数十转的转镜旋转器，可同时观察视野内数十个不同视角的放大影像。当利用镜旋转器以特定曝光拍摄场景时，由于其高速旋转，所捕获图像中的视在运动变得太大而无法观察到非模糊图像。为了减少由镜旋转器的旋转引起的运动模糊，我们的系统引入了超快云台镜机制，该机制可以通过执行逐帧视点控制来消除图像中的视运动，使得当相机快门打开时图像中的视速度变为零，并且当快门关闭时返回到其原始位置。我们的系统可以捕捉40个全方位不同的视图图像在10 fps的真实的时间同步400 fps的视频拍摄与帧的超快云台镜控制运动模糊减少时，镜旋转器旋转在10 rps。通过对多个全方位真实的场景的实验结果验证了该系统的性能，在对数十米远的室外场景进行全方位观测时，该系统能够在不降低摄像机曝光的情况下拍摄到清晰明亮的全景放大图像。
This study developsan omnidirectional panoramic video system that can simultaneously observe zoom-in images at dozens of different viewpoints in afield of view by synchronizing hundreds of frames per second video shooting, with a rotation of tens-of-rotation-per-second mirror-rotator. When video shooting a scene with a certain exposure utilizing a mirror-rotator, apparent motion in the captured images becomes too large to observe non-blurred images, owing to its high-speed rotation. To reduce motion blurs caused by the rotation of a mirror-rotator, our system introduces an ultrafast pan-tilt mirror mechanism that can cancel apparent motion in images by executing frame-by-frame viewpoint control, so that the apparent speed in images becomes zero when the camera shutter is open, and it returns to its home position when the shutter is closed. Our system can capture 40 omnidirectionally different view images at 10 fps in real time by synchronizing 400-fps video shooting with frame-by-frame ultrafast pan-tilt mirror control for motion blur reduction when a mirror-rotator rotates at 10 rps. Its performance is verified by experimental results for several omnidirectional real scenes, and our system can capture clear and bright panoramic zoom-in images without decreasing the camera exposure when omnidirectionally observing dozens-of-meters-distance outdoor scenes.