Complex Reflectance, Texture and Shape: Methods and Representations for Object Modeling

复杂的反射率、纹理和形状：对象建模的方法和表示

• 批准号: 0308185
• 负责人: Peter Belhumeur
• 金额: $ 43.99万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2003
• 资助国家: 美国
• 起止时间: 2003-07-01 至 2007-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0308185&HistoricalAwards=false
• 关键词: Complex; Reflectance; Texture; Shape; Methods

Proposal #: 308185Title: Complex Reflectance, Texture and Shape: Methods and Representations for Object ModelingPI: Belhumeur, PeterColumbia UniversityThis research is to investigate techniques for modeling objects with complex reflectance. Our aim is to develop methods for recovering both shape and reflectance properties of natural objects -- objects that due to their inherent complexity have proven elusive to traditional shape reconstruction techniques such as binocular stereo, structure from motion, photometric stereo, and even laser range finders. Understanding the interplay between shape and reflectance is critical to object modeling and is in many ways central to the field of computer vision. Yet this promising avenue of research has been overlooked in the past, either due to acquisition and storage limitations or, perhaps, due to a lack of appropriate techniques. Recently, the PI's have introduced and prototyped two novel methods for shape reconstruction and reflectance recovery thatessentially exploit two neglected physical principles. These two methods, named Helmholtz stereopsis and light field reconstruction, are able to recover surface shape regardless of the object's reflectance (BRDF), and they offer numerous advantages over conventional reconstruction techniques. The proposed research includes new shape reconstruction techniques, methods for constructing object models including their shape and BRDF on a point-by-point basis, and applications of these models to image-based rendering. In addition, these reconstruction techniques will serve as tools for a broad study of BRDF's in general as well as 3-D textures whose appearance varies with viewpoint and lighting. Unlike current shape estimation techniques, the proposed methods will produce object models with both geometric and BRDF data. This new capability in object modeling technology will be beneficial in areas such as industrial design, architecture, entertainment, robotics, and medicine. Estimation of the reflectance function across the reconstructed objects, surface normals, and shape, leads directly to new methods for image-based modeling and rendering for computer graphics applications. These modeling techniques will be used to study reflectance properties of 3-D textures and natural materials (including human skin), and this will help to produce more effective generative appearance models that can be used in security applications (e.g., face recognition), human computer interaction applications, entertainment, learning through visual simulation, communications, etc. In addition to the applications of the resulting research and its dissemination through peer-reviewed publications, funding will be used to support the training of two Ph.D. students over three years.

提案编号：308185标题：复反射率、纹理和形状：物体建模的方法和表示PI：Belhumeur，PeterColumbia大学本研究旨在研究具有复反射率的物体建模技术。 我们的目标是开发用于恢复自然对象的形状和反射特性的方法-对象，由于其固有的复杂性已被证明是难以捉摸的传统形状重建技术，如双目立体，结构从运动，光度立体，甚至激光测距仪。理解形状和反射率之间的相互作用对于物体建模至关重要，并且在许多方面都是计算机视觉领域的核心。然而，这一有前途的研究途径在过去一直被忽视，要么是由于获取和储存的限制，要么是由于缺乏适当的技术。最近，PI的介绍和原型的形状重建和反射率恢复的两个新的方法，基本上利用两个被忽视的物理原理。 这两种方法，命名为亥姆霍兹立体视觉和光场重建，能够恢复表面形状，无论物体的反射率（BRDF），他们提供了许多优势，传统的重建技术。建议的研究包括新的形状重建技术，方法构建对象模型，包括他们的形状和BRDF逐点的基础上，和这些模型的应用程序，基于图像的渲染。 此外，这些重建技术将作为工具，广泛研究BRDF的一般以及3-D纹理，其外观随视点和照明而变化。与目前的形状估计技术不同，所提出的方法将产生具有几何和BRDF数据的对象模型。对象建模技术的这种新功能将在工业设计、建筑、娱乐、机器人和医学等领域受益。 重建对象，表面法线和形状的反射函数的估计，直接导致基于图像的建模和渲染的计算机图形应用程序的新方法。这些建模技术将用于研究3D纹理和自然材料（包括人类皮肤）的反射特性，这将有助于产生更有效的生成外观模型，可用于安全应用（例如，人脸识别），人机交互应用，娱乐，通过视觉模拟学习，通信等，除了研究成果的应用及其通过同行评审的出版物的传播外，资金将用于支持两名博士的培训。学生三年以上。