An integrated probabilistic framework for shape and surface interpretation

描述(申请人提供)：形状和表面解释的综合概率框架，罗格斯大学的雅各布·费尔德曼和曼尼什·辛格视觉形状的表示是感知的中心问题之一，影响到物体识别和场景理解的许多方面。但是，关于人脑如何计算形状表征的全面和原则性的描述还没有出现。一个关键的困难是理解大脑如何在不同的深度将图像划分为不同的表面，解释每个表面的3D形状，并将每个形状划分为不同的部分。在以前的工作中，PI已经开发了新的、原则性的数学方法来理解人体形状表示，基于形状骨架的贝叶斯估计的思想。形状骨架是形状的轴向结构的表示，虽然不同于经典的中轴表示，但与之相关。中轴表示将形状分解为它们的组件轴，形状围绕这些组件轴近似局部对称。PI的方法将其重塑为概率推理问题，这与大多数当代神经计算建模一致，但与大多数其他形状计算模型不同。这使得该方法的范围可以扩大，包括将图像分解成不同的表面和解释3D形状的更广泛的问题。该方法在理论上是统一的，在数学上适合在并行计算体系结构中实现，这使得它有可能成为神经形状编码的模型。这项研究计划的目的是将形状表示完全发展为一个概率估计问题，并测试从这个框架中产生的许多经验预测。具体目标包括扩展和测试形状表示的概率方法，并将其推广到关键的相关问题，包括图形/背景解释和3D形状。这一扩展将使形状表示与对视觉图像中表面的理解完全集成在一个连贯的数学框架中，该框架与已知的视觉皮层计算一致。 公共卫生相关性：该项目涉及对人类视觉系统关键功能的实证研究，包括对视觉形状和表面的解释。这项研究有助于对人类神经系统的基础性了解，从而帮助我们更好地从功能上理解知觉功能障碍和认知缺陷的疾病机制。

DESCRIPTION (provided by applicant): An integrated probabilistic framework for shape and surface interpretation Jacob Feldman and Manish Singh, Rutgers University The representation of visual shape is one of the central problems of perception, influencing many aspects of object recognition and scene understanding. But a comprehensive and principled account of how the human brain computes shape representationsdoes not yet exists. A key difficulty is in understanding how the brain divides the image into distinct surfaces at distinct depths, interprets the 3D shape of each surface, and divides each shape into distinct parts. In previous work the PIs have developed novel, principled mathematical methods for understanding human shape representation, based around the idea of Bayesian estimation of the shape skeleton. The shape skeleton is a representation of the axial structure of the shape, related to though different from classical medial axis representations. Medial axis representations break shapes down into their component axes, about which the shape is approximately locally symmetric. The PI's approach recasts this as a probabilistic inference problem, consistent with most contemporary neurocompuational modeling, but unlike most other computational models of shape. This allows the approach to be expanded in scope, encompassing the broader problem of the decomposition of the image into distinct surfaces and the interpretation of 3D shape. The approach is theoretically unified, and is mathematically suitable to be implemented in a parallel computational architecture, making it plausible as a model of neural shape coding. The aim of this research program is to fully develop shape representation as a probabilistic es- timation problem, and test the many empirical predictions that emanate from this framework. Specific aims include expanding and testing the probabilistic approach to shape representation, and generalizing it to critical related problems, including figure/ground interpretation and 3D shape. This expansion will make it possible to fully integrate shape representation with the comprehension of surfaces in the visual image, in a coherent mathematical framework consistent with what is known about computation in visual cortex. PUBLIC HEALTH RELEVANCE: This project involves empirical studies of critical functions of the human visual system, including the interpretation of visual shapes and surfaces. The research contributes to a foundational understanding of the human nervous system, thus helping us achieve better functional understanding of the mechanisms of disease in perceptual dysfunctions and cognitive deficits.