I-Corps: Sensors For Relightable Images

工业检验、执法和博物馆保护专业人员都需要捕捉真实物品的数字表示。这些数字表示后来被用于证据和分析，从而能够更高效地制造产品，更快地进行刑事调查，并保存无价的文物。现有的摄像头可以在单一的光照条件下捕捉到单一的视角，3D扫描仪可以捕捉到物体的形状，但是现有的设备不能捕捉到表面的反射特性。在这项提议中，研究小组开发了一种捕捉照片的方法，允许在捕捉到光照后交互地改变光照。此外，对数据的计算可以揭示肉眼看不到的细节。各种传感器已经在研究实验室和商业中进行了研究。其中包括从根本上测量光线强度的相机，以及从根本上测量3D对象几何形状的深度传感器。这项建议考虑了一种相关但不同的传感器，它从根本上测量表面反射，即表面对来自不同入射角度的光的反应。这很重要，因为对象的表面反射属性可能包含重要信息，即使在使用标准相机或深度传感器测量表面没有明显细节的情况下也是如此。除了表面反射率，这种新型传感器还可以直接观察到表面方向的微小变化，当使用基于三角测量或基于飞行时间的3D深度传感器测量表面形状时，这些变化低于噪声阈值。

Industrial inspection, law enforcement, and museum preservation professionals all need to capture digital representations of real objects. These digital representations are later used for evidence and analysis that allows more efficient product manufacturing, faster criminal investigations, and preservation of priceless cultural objects. Existing cameras can capture a single view under a single lighting condition, and 3D scanners can capture the shape, but existing devices do not capture the surface reflectance properties.In this proposal, the team has developed a method to capture photographs which allow the lighting to be interactively changed after they are captured. In addition, computation on the data can reveal details which are not visible to the naked eye.A wide variety of sensors have been investigated in research labs and commercially. These include cameras that fundamentally measure light intensity, as well as depth sensors that fundamentally measure 3D object geometry. This proposal regards a related but different kind of sensor that fundamentally measures surface reflectance, how that surface reacts to light from different incident angles. This is important because the surface reflectance properties of an object may contain important information, even when the surface has no apparent detail when measured with a standard camera or depth sensor. In addition to surface reflectance, this new sensor can directly observe small changes in surface orientation which are below the noise threshold when measuring the surface shape with triangulation or time-of-flight based 3D depth sensors.