Doppler Time-of-Flight Rendering

Doppler Time-of-Flight Rendering
复制标题

DOI:
10.1145/3618335
复制
发表时间:
2023-09
期刊:
ACM Transactions on Graphics (TOG)
影响因子:
--
通讯作者:
Juhyeon Kim;Wojciech Jarosz;Ioannis Gkioulekas;A. Pediredla
Juhyeon Kim;Wojciech Jarosz;Ioannis Gkioulekas;A. Pediredla
中科院分区:
其他
文献类型:
--
作者:
Juhyeon Kim;Wojciech Jarosz;Ioannis Gkioulekas;A. Pediredla

文献摘要

相似文献

我们介绍多普勒飞行时间(D-ToF)渲染,动态场景的ToF渲染的扩展,在模拟D-ToF相机的应用程序。D-ToF相机使用照明和曝光的高频调制,并测量多普勒频移来计算动态对象的径向速度。这种相机中使用的时变场景几何形状和高频调制函数使得使用现有ToF渲染算法准确有效地模拟其测量具有挑战性。我们以双重方式克服了这些挑战:为了实现准确性,我们推导出全局照明下D-ToF测量的路径积分表达式,并形成这些积分的无偏蒙特卡罗估计。为了实现效率,我们开发了一个量身定制的时间路径采样技术,结合了对偶时间采样与相关路径采样。我们的实验表明,我们的采样技术实现了高达两个数量级的低方差相比,天真的时间路径采样。我们提供了一个开源模拟器,作为D-ToF成像系统的数字孪生模型,使成像研究人员能够首次研究调制函数,材料特性和全局照明对D-ToF成像性能的影响。
We introduce Doppler time-of-flight (D-ToF) rendering, an extension of ToF rendering for dynamic scenes, with applications in simulating D-ToF cameras. D-ToF cameras use high-frequency modulation of illumination and exposure, and measure the Doppler frequency shift to compute the radial velocity of dynamic objects. The time-varying scene geometry and high-frequency modulation functions used in such cameras make it challenging to accurately and efficiently simulate their measurements with existing ToF rendering algorithms. We overcome these challenges in a twofold manner: To achieve accuracy, we derive path integral expressions for D-ToF measurements under global illumination and form unbiased Monte Carlo estimates of these integrals. To achieve efficiency, we develop a tailored time-path sampling technique that combines antithetic time sampling with correlated path sampling. We show experimentally that our sampling technique achieves up to two orders of magnitude lower variance compared to naive time-path sampling. We provide an open-source simulator that serves as a digital twin for D-ToF imaging systems, allowing imaging researchers, for the first time, to investigate the impact of modulation functions, material properties, and global illumination on D-ToF imaging performance.