Head-Mounted Photometric Stereo for Performance Capture
Head-Mounted Photometric Stereo for Performance Capture
复制标题
DOI：
10.1145/1837026.1837088
复制
发表时间：
2010-07
期刊：
影响因子：
--
通讯作者：
Andrew Jones;Graham Fyffe;Xueming Yu;Alex Ma;Jay Busch;M. Bolas;P. Debevec
中科院分区：
文献类型：
--
作者：
Andrew Jones;Graham Fyffe;Xueming Yu;Alex Ma;Jay Busch;M. Bolas;P. Debevec
头盔摄像头是捕捉面部行为以驱动虚拟角色的越来越重要的工具。它们提供固定的、无遮挡的面视图，对于观察运动捕获点或作为视频分析的输入非常有用。然而，使用这些系统捕获的2D图像通常会受到环境光的影响，并且通常无法在面部表现时记录细微的3D形状变化。我们已经开发了一种系统，可以用基于LED的光度立体来增强头戴式相机。该系统允许独立于环境光观察面部，并生成每个像素的表面法线，以便以3D形式动态记录性能。得到的数据可以用于面部重新照明，或者作为机器学习算法的更好输入，以驱动动画人脸。
Head-mounted cameras are an increasingly important tool for capturing facial performances to drive virtual characters. They provide a fixed, unoccluded view of the face, useful for observing motion capture dots or as input to video analysis. However, the 2D imagery captured with these systems is typically affected by ambient light and generally fails to record subtle 3D shape changes as the face performs. We have developed a system that augments a head-mounted camera with LED-based photometric stereo. The system allows observation of the face independent of the ambient light and generates per-pixel surface normals so that the performance is recorded dynamically in 3D. The resulting data can be used for facial relighting or as better input to machine learning algorithms for driving an animated face.