Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflection
Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflection
复制标题
DOI：
10.1109/cvpr52729.2023.01206
复制
发表时间：
2023-05
期刊：
影响因子：
--
通讯作者：
Ruoshi Liu;Carl Vondrick
中科院分区：
文献类型：
--
作者：
Ruoshi Liu;Carl Vondrick
人体温度相对较高，导致人变成长波红外光源。由于这种发射的光具有比可见光更大的波长，因此在典型场景中，许多表面充当具有强烈镜面反射的红外镜。我们利用人对物体的热反射来定位它们的位置并重建它们的姿势，即使它们对于正常的相机来说是不可见的。我们提出了一种综合分析框架，对物体、人和他们的热反射进行联合建模，将生成模型与反射的可区分渲染相结合。定量和定性实验表明，我们的方法在极具挑战性的情况下有效，例如使用弯曲的镜子，或者在正常相机完全看不到人的情况下。
The relatively hot temperature of the human body causes people to turn into long-wave infrared light sources. Since this emitted light has a larger wavelength than visible light, many surfaces in typical scenes act as infrared mirrors with strong specular reflections. We exploit the thermal reflections of a person onto objects in order to locate their position and reconstruct their pose, even if they are not visible to a normal camera. We propose an analysis-by-synthesis framework that jointly models the objects, people, and their thermal reflections, which combines generative models with differentiable rendering of reflections. Quantitative and qualitative experiments show our approach works in highly challenging cases, such as with curved mirrors or when the person is completely unseen by a normal camera.