Instrumentation for Empirical Studies in the Modeling of Visual Appearance

视觉外观建模实证研究仪器

• 批准号: 0224431
• 负责人: Peter Belhumeur
• 金额: $ 11.5万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2002
• 资助国家: 美国
• 起止时间: 2002-09-15 至 2006-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0224431&HistoricalAwards=false
• 关键词: Instrumentation; Empirical; Studies; Modeling; Visual

EIA 0224431Belhumeur, Peter N.Kriegman, David J.Columbia University Title: CISE RR: Instrumentation for Empirical Studies in the Modeling of Visual Appearance This project, supporting experimental validation of computer vision algorithms for shape modeling and analysis, aims at building two independent systems to support computer vision. Methods for shape reconstruction and reflectance recovery, termed Helmholtz reciprocity stereopsis and light field reconstruction that exploit previously neglected physical principles, are able to recover surface shape regardless of the object's BRDF. The two special purpose imaging systems will be built at Columbia University and the University of Illinois at Urbana-Champaign (UIUC). The Columbia rig, composed of sixteen imaging modules that can be arranged in different configurations, directly supports research in Helmholtz reciprocity stereopsis. The UIUC rig, consisting of two arms that move their endpoints over the surface of a sphere, directly supports the light field reconstruction method. The two new pieces of hardware will contribute to the following four projects:Helmholtz Stereopsis,Light Field Reconstruction,Image-Based Modeling and Rendering, andTexture and Reflectance Estimation from Small Datasets.The first project exploits the symmetries in an object's surface reflectance. The Helmholtz stereopsis method can reconstruct surfaces with complex reflectance, e.g., highly non-Lambertian. The Helmholtz rig will be used to gather datasets of objects in a manner such that they can be processed using the Helmholtz stereopsis shape recovery method. The second uses images gathered from a double covering of a surface's incident light field to reconstruct both the surface shape and an effective bi-directional reflectance distribution on a point-by-point basis. The illumination/viewpoint rig will be used to gather data in a manner such that it can be processed with the light field reconstruction method. The third utilizes the datasets gathered by both rigs for image-based and modeling projects to render photorealistic images of objects under novel viewpoint and arbitrary illuminations. Datasets of objects, with their 3-D shape reconstructed, are collected and their reflectance is modeled. These models of shape and reflectance are then used to synthesize novel images of the objects and composite them into still pictures and video footage. The objects will be catalogued by their visual appearance. The last project uses the datasets gathered by the light field rendering rig for developing low-dimensional models of texture and reflectance. These models are then used to estimate texture and reflectance properties from a small number of images. Thus, images characterizing reflectance properties of a wide variety of materials will be created and distributed satisfying the following goals to Develop, refine, analyze, and empirically validate the method of Helmholtz stereopsis,Develop, refine, and analyze the light field reconstruction method,Apply the reconstruction methods to image-based rendering, andDevelop and refine data-driven low-dimensional non-parametric models for surface reflection and textures that vary with viewpoint and lighting.

EIA 0224431Belhumeur、Peter N.Kriegman、David J.哥伦比亚大学 标题：CISE RR：视觉外观建模中的实证研究仪器 该项目支持用于形状建模和分析的计算机视觉算法的实验验证，旨在构建两个独立的系统来支持计算机视觉。形状重建和反射率恢复的方法，称为亥姆霍兹互易立体观测和光场重建，利用了以前被忽视的物理原理，无论物体的 BRDF 是什么，都能够恢复表面形状。这两个专用成像系统将在哥伦比亚大学和伊利诺伊大学厄巴纳-香槟分校 (UIUC) 建造。哥伦比亚装置由十六个成像模块组成，可以以不同的配置排列，直接支持亥姆霍兹互易立体观测的研究。 UIUC 装置由两个在球体表面移动端点的臂组成，直接支持光场重建方法。这两个新硬件将有助于以下四个项目：亥姆霍兹立体视觉、光场重建、基于图像的建模和渲染以及小数据集的纹理和反射率估计。第一个项目利用物体表面反射率的对称性。亥姆霍兹立体观测方法可以重建具有复杂反射率的表面，例如高度非朗伯的表面。亥姆霍兹装置将用于收集物体的数据集，以便可以使用亥姆霍兹立体形状恢复方法对其进行处理。第二种方法使用从表面入射光场的双重覆盖收集的图像来逐点重建表面形状和有效的双向反射率分布。照明/视点装置将用于收集数据，以便可以使用光场重建方法对其进行处理。第三种利用两个装置收集的数据集进行基于图像和建模项目，以在新颖的视点和任意照明下渲染物体的真实感图像。收集重建了 3D 形状的物体数据集，并对其反射率进行建模。然后使用这些形状和反射率模型来合成物体的新颖图像，并将它们合成为静态图片和视频片段。这些对象将根据其视觉外观进行分类。最后一个项目使用光场渲染装置收集的数据集来开发纹理和反射率的低维模型。然后使用这些模型来估计少量图像的纹理和反射率属性。因此，将创建和分发表征各种材料的反射特性的图像，以满足以下目标：开发、细化、分析和实证验证亥姆霍兹立体观测方法，开发、细化和分析光场重建方法，将重建方法应用于基于图像的渲染，以及开发和细化表面反射和纹理的数据驱动的低维非参数模型 随视角和照明的不同而变化。