NEURAL BASIS OF SHAPE FROM TEXTURE

描述：人类视觉I使用几种类型的单眼线索，如 阴影，纹理和运动，以从2D图像中提取3D形状。这个项目 旨在提供一个帐户的形状知觉从纹理线索专门在 由真实的皮层神经元执行的可行的神经操作的术语。 拟议的工作建立在PI最近的结果基础上，这些结果表明，观察员 只有当图像包含以下内容时，才能感知纹理表面的真实3D形状 沿表面最大曲率的投影线的可见能量沿着。当地 波纹管凸、凹、斜部分的光谱分析 曲面显示沿主曲面投影线的轮廓沿着 曲率显示了方向和频率调制特征模式 与表面的3D形状系统地相关。现在的Pis 试图开发一种模型，将V1神经元的输出与感知的 形状从纹理线索。该模型的前端将由一系列 频率和方向选择性神经元。频率的模板模式， 取向调制将由稍后的细胞从一组 等频率和等方向输出。计算模型将 需要向量场数学的新用途。神经元的性质. 每种水平都将在清醒的猴子的单细胞记录中进行测试， 在一个单独的合作，从而提供了一个直接的联系， 和生理学。为了测试和扩展该模型，心理物理实验将 使用具有一般发生的方向干扰项的模式，对比 定义的轮廓和自然发生的纹理。该项目将提供 将天然纹理分类为有效或无效传送的规则 形状，这将是有用的计算机模拟现实场景。

Description: Human vision I uses several types of monocular cues such as shading, texture and motion to extract 3D shape from 2D images. This project aims to provide an account of shape perception from texture cues exclusively in terms of feasible neural operations performed by realistic cortical neurons. The proposed work builds on the PIs' recent results showing that observers perceive the true 3D shape of a textured surface only when the image contains visible energy along projected lines of maximum curvature of the surface. Local spectral analyses of convex, concave and slanted portions of corrugated surfaces reveal that contours along projected lines of principal surface curvature show characteristic patterns of orientation and frequency modulations that are systematically related to the 3D shape of the surface. The Pis now seek to develop a model that relates the outputs of V1 neurons to perceived shape from texture cues. The front end of the model will consist of arrays of frequency and orientation-selective neurons. Template patterns of frequency and orientation modulations will be extracted by later cells from set of iso-frequency and iso-orientation outputs. The computational modeling will require new uses of the mathematics of vector fields. Properties of neurons at each level will be tested in single-cell recordings from awake behaving monkeys in a separate collaboration, thus providing a direct link between computation and physiology. To test and extend the model, psychophysical experiments will use patterns with generically occurring orientation distractors, contrast defined contours and naturally occurring textures. The project will provide rules for classifying natural textures as effective or ineffective at conveying shape which will be useful in computer simulations of realistic scenes.