SpinCam: High-Speed Imaging via a Rotating Point-Spread Function

SpinCam: High-Speed Imaging via a Rotating Point-Spread Function
复制标题

DOI:
10.1109/iccv51070.2023.00990
复制
发表时间:
2023-10
期刊:
2023 IEEE/CVF International Conference on Computer Vision (ICCV)
影响因子:
--
通讯作者:
D. Chan;Mark Sheinin;Matthew O'Toole
D. Chan;Mark Sheinin;Matthew O'Toole
中科院分区:
其他
文献类型:
--
作者:
D. Chan;Mark Sheinin;Matthew O'Toole

文献摘要

相似文献

高速摄像机是用于场景慢动作分析的不可或缺的工具。然而,任何成像系统的固定带宽很快就会成为瓶颈,导致相机的空间和时间分辨率之间的根本权衡。近年来,压缩高速成像系统已被提出通过对信号进行光学编码并使用重建过程来恢复视频来绕过这些问题。我们的工作提出了一种基于对相机的点扩展函数(PSF)进行时间编码的压缩高速成像的新方法。通过在相机前机械旋转衍射光栅,传感器可以整合因PSF随着时间不断旋转而变得模糊的图像。我们还提出了一种基于去卷积的重建算法来根据这些测量数据重建视频。与以前的方法相比,我们的方法获得了更高的光效,并且处理的场景类别更广。此外,我们的机械设计产生了灵活的时间分辨率,可以很容易地提高,潜在地允许捕获192 kHz-远远高于以前的工作。我们演示了一个用于各种应用的原型,包括运动捕捉和粒子图像测速(PIV)。
High-speed cameras are an indispensable tool used for the slow-motion analysis of scenes. However, the fixed bandwidth of any imaging system quickly becomes a bottleneck, resulting in a fundamental trade-off between the camera’s spatial and temporal resolutions. In recent years, compressive high-speed imaging systems have been proposed to circumvent these issues by optically encoding the signal and using a reconstruction procedure to recover a video. Our work proposes a novel approach for compressive high-speed imaging based on temporally coding the camera’s point-spread function (PSF). By mechanically spinning a diffraction grating in front of a camera, the sensor integrates an image blurred by a PSF that continuously rotates over time. We also propose a deconvolution-based reconstruction algorithm to reconstruct videos from these measurements. Our method achieves superior light efficiency and handles a wider scene class than prior methods. Also, our mechanical design yields flexible temporal resolution that can be easily increased, potentially allowing capture at 192 kHz—far higher than prior works. We demonstrate a prototype for various applications, including motion capture and particle image velocimetry (PIV).