Bayesian shape from shading

阴影的贝叶斯形状

• 批准号: 6808713
• 负责人: RICHARD F MURRAY
• 金额: $ 7.93万
• 依托单位: UNIVERSITY OF PENNSYLVANIA
• 依托单位国家: 美国
• 财政年份: 2004
• 资助国家: 美国
• 起止时间: 2004-08-01 至 2006-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/6808713
• 关键词: clinical research; digital imaging; form /pattern perception; human subject; mathematical model; model design /development; neural information processing; neuropsychological tests; visual perception

DESCRIPTION (provided by applicant): The long-term goal of this research is to understand the visual mechanisms that enable human observers to perceive the shapes of objects. These mechanisms are central to normal visual functioning, and understanding them would help to illuminate principles and limitations of normal vision, as well as the deficiencies that cause visual deficits, especially visual agnosias. The specific aim of these experiments is to investigate human observers' abilities to perceive the shapes of objects from the shading information in retinal images. This shading information is extremely ambiguous, because any given 2D image could have been generated by any of an infinite number of 3D arrangements of lighting sources and surfaces. Nevertheless, human observers rapidly arrive at a generally accurate interpretation of such images, which implies that the human visual system must incorporate accurate assumptions (at least implicitly) about which 3D scenes are more or less likely to occur in the real world. The hypothesis being tested here is that the visual system uses a statistical model of natural illumination and a statistical model of local surface shape and reflectance, in order to arrive at the most likely 3D interpretation of a 2D image. This research project has four components. (1) Using a multidirectional photometer, we will measure the illumination incident from all directions at many randomly selected locations, and use these measurements to construct a statistical model of natural illumination. (2) Using 3D digitizing scanners, we will digitize the shape and reflectance patterns of many natural objects, and use small surface patches extracted from this data to construct a statistical model of local surface shape and reflectance. (3) We will develop a Bayesian model observer that uses the measured illumination and surface statistics to infer the most likely 3D shape of objects depicted in 2D images. (4) We will compare the performance of human observers and the Bayesian model observer on a number of shape perception tasks. If the human and Bayesian observers find the same tasks easy or difficult, then we will conclude that human performance is limited by the same factor as the Bayesian observers performance, namely the extent to which the illumination and surface statistics in the various tasks match the statistics measured in the natural world. Otherwise, human observers must use constraints other than the measured natural statistics to arrive at accurate 3D interpretations of 2D images.

描述（由申请人提供）：本研究的长期目标是了解使人类观察者能够感知物体形状的视觉机制。这些机制是正常视觉功能的核心，了解它们将有助于阐明正常视觉的原理和局限性，以及导致视觉缺陷，特别是视觉失认症的缺陷。这些实验的具体目的是研究人类观察者从视网膜图像中的阴影信息感知物体形状的能力。这种阴影信息是非常模糊的，因为任何给定的2D图像都可能是由光源和表面的无限数量的3D布置中的任何一个产生的。然而，人类观察者迅速地达到对这样的图像的大致准确的解释，这意味着人类视觉系统必须结合关于哪些3D场景或多或少可能出现在真实的世界中的准确假设（至少隐含地）。这里测试的假设是，视觉系统使用自然照明的统计模型和局部表面形状和反射率的统计模型，以达到最有可能的2D图像的3D解释。该研究项目有四个组成部分。(1)使用多方向光度计，我们将测量从各个方向入射的照明在许多随机选择的位置，并使用这些测量来构建自然照明的统计模型。(2)使用3D数字化扫描仪，我们将模拟许多自然物体的形状和反射模式，并使用从这些数据中提取的小表面块来构建局部表面形状和反射率的统计模型。(3)我们将开发一个贝叶斯模型观察器，它使用测量的照明和表面统计来推断2D图像中描绘的对象的最可能的3D形状。(4)我们将比较人类观察员和贝叶斯模型观察员在一些形状感知任务上的表现。如果人类和贝叶斯观察者发现相同的任务容易或困难，那么我们将得出结论，人类的表现受到与贝叶斯观察者表现相同的因素的限制，即各种任务中的照明和表面统计与自然世界中测量的统计相匹配的程度。否则，人类观察者必须使用测量的自然统计以外的约束来达到2D图像的准确3D解释。