Mitigating AC and DC Interference in Multi-ToF-Camera Environments
Mitigating AC and DC Interference in Multi-ToF-Camera Environments
复制标题
DOI：
10.1109/tpami.2023.3307564
复制
发表时间：
2023-08
影响因子：
23.6
通讯作者：
Jongho Lee;Mohit Gupta
中科院分区：
文献类型：
--
作者：
Jongho Lee;Mohit Gupta
多相机干扰（MCI）是连续波飞行时间（C-ToF）相机面临的重要挑战。在存在其他相机的情况下，C-ToF 相机可能会接收来自其他相机光源的光，从而导致潜在的较大深度误差。我们提出随机暴露编码（SEC），这是一种减轻 MCI 的新方法。在SEC中，相机积分时间被分为多个时隙。每个摄像头都会在一个时段内以最佳概率打开，以避免干扰，同时保持高信噪比 (SNR)。所提出的方法具有以下优点。首先，SEC 可以有效滤除干扰信号的交流和直流分量，从而同时实现高信噪比和减轻深度误差。其次，SEC 中的时隙可以实现 3D 成像，而不会在高光子通量区域出现饱和。第三，由于相机仅在一小部分积分时间内打开而节省的能源可用于放大源峰值功率，从而提高 SEC 对环境光的鲁棒性。最后，SEC可以在不修改C-ToF相机的编码功能的情况下实现，因此可以通过最小的改变与广泛的相机一起使用。我们通过全面的理论分析、模拟和真实实验，在各种成像场景中展示了 SEC 的性能优势。
Multi-camera interference (MCI) is an important challenge faced by continuous-wave time-of-flight (C-ToF) cameras. In the presence of other cameras, a C-ToF camera may receive light from other cameras’ sources, resulting in potentially large depth errors. We propose stochastic exposure coding (SEC), a novel approach to mitigate MCI. In SEC, the camera integration time is divided into multiple time slots. Each camera is turned on during a slot with an optimal probability to avoid interference while maintaining high signal-to-noise ratio (SNR). The proposed approach has the following benefits. First, SEC can filter out both the AC and DC components of interfering signals effectively, which simultaneously achieves high SNR and mitigates depth errors. Second, time-slotting in SEC enables 3D imaging without saturation in the high photon flux regime. Third, the energy savings due to camera turning on during only a fraction of integration time can be utilized to amplify the source peak power, which increases the robustness of SEC to ambient light. Lastly, SEC can be implemented without modifying the C-ToF camera's coding functions, and thus, can be used with a wide range of cameras with minimal changes. We demonstrate the performance benefits of SEC with thorough theoretical analysis, simulations and real experiments, across a wide range of imaging scenarios.