US-German Collaboration: Circuit models of form processing in primate V4

这项合作研究旨在通过结合电生理学、计算、建模和心理物理学来促进对视觉对象识别的理解，以探索新发现的视觉皮质区V4区神经元的特性的含义。V4区神经元对各种形状属性做出选择性反应，但最近的研究表明，它们也对刺激的对比度极性有选择性，根据它们对形状相对于均匀背景的亮度对比度的偏好，可以大致分为四类。具体地说，等亮度细胞对纯粹由没有亮度对比度的彩色对比度定义的刺激反应最好，而亮、暗和对比度细胞分别对正对比度、负对比度或两者都反应最好。由于这些类别是基于简单的刺激，目前尚不清楚这些细胞如何对更自然的刺激做出反应，其中边界很少通过固定的亮度对比度来定义，以及不同的细胞类别是否具有不同的编码对象的功能角色。用一组由严格的心理物理测试开发的自然刺激的参数集来表征V4神经元，将提供对潜在电路和功能的新见解，并开启对V4和腹侧流的新理解。大脑中视觉形式处理的计算模型也受到限制：它们没有考虑从视网膜到视觉皮质存在的现实生理细胞类型，它们主要针对处理非色差信号，并且严重依赖前馈处理。这项研究将产生克服这些限制的模型，对于深入了解表格处理的基础电路和机制是非常有价值的。这些模型将在一个开放的在线框架中提供，旨在为易用性和透明度设定一个标准，促进理论家和实验者之间的进一步合作，并促进教育。最后，在视觉科学中，在心理物理学文献的推动下，存在着一场长期的辩论，质疑颜色信号是否以及如何有助于表格处理。传统的观点认为，边界检测和分割完全基于亮度对比度。然后，COLOR会在标识的边界范围内绘制曲面。最近的心理物理和理论研究与这一观点不一致，他们认为颜色对于自然场景中的分割和形状处理非常重要，例如树叶中的水果，在这种场景中，基于亮度对比度的检测非常困难。这项研究中的实验将为这场辩论注入急需的生理学数据，这里开发的模型将阐明大脑皮质通路在多个阶段的功能组织，揭示我们自然视觉输入的不同方面如何有助于形成感知。该奖项由美国国家科学基金会国际科学与工程主任办公室共同资助。德国教育和研究部(BMBF)正在资助一个配套项目。

This collaborative study aims to advance the understanding of visual object recognition by combining electrophysiology, computational, modeling and psychophysics to probe the implications of newly discovered properties of neurons in visual cortical area V4, an important intermediate stage in the shape processing pathway of the brain.V4 neurons respond selectively to a variety of shape attributes, but recent studies demonstrate that they are also selective for the contrast polarity of stimuli and can be broadly classified into four categories based on their preference for the luminance contrast of shapes relative to a uniform background. Specifically, Equiluminance cells respond best to stimuli defined purely by a chromatic contrast with no luminance contrast while Bright, Dark and Contrast cells respond best to positive contrasts, negative contrasts or either, respectively. Because these categories are based on simple stimuli, it remains unknown how these cells respond to more naturalistic stimuli, where boundaries are seldom defined by a fixed luminance contrast, and whether the different cell classes have different functional roles for encoding objects. Characterizing V4 neurons with a parameterized set of naturalistic stimuli that are developed with rigorous psychophysical testing will provide novel insights into underlying circuitry and function and open new understanding about V4 and the ventral stream.Computational models of visual form processing in the brain have also been limited: they have not taken account of realistic physiological cell types known to exist from the retina to the visual cortex, they have been largely aimed at processing achromatic signals, and have relied heavily on feedfoward processing. This study will generate models that overcome these limitations and are invaluable for gaining insights into the circuits and mechanisms underlying form processing. These models will be available in an open, online framework designed to set a standard for ease of use and transparency, to spur further collaboration between theoreticians and experimentalists, and to facilitate education.Finally, there has been a longstanding debate in vision science, motivated from the psychophysical literature, that questions whether and how chromatic signals contribute to form processing. The traditional view has been that boundary detection and segmentation are solely based on luminance contrast. Color then paints a surface within the confines of the identified boundary. Recent psychophysical and theoretical studies are at odds with this view and argue that color is important for segmentation and form processing in natural scenes, for example, fruit amidst leaves, where detection based on luminance contrast is very difficult. The experiments in this study will inject much needed physiology data into this debate and the models developed here will shed light on the functional organization of cortical pathways at multiple stages, revealing how different aspects of our natural visual input contribute to form perception.This award is being co-funded by NSF's Office of the Director, International Science and Engineering. A companion project is being funded by the German Ministry of Education and Research (BMBF).