CONVERGENT PROCESSING ACROSS VISUAL AND HAPTIC CIRCUITS FOR 3D SHAPE PERCEPTION

跨视觉和触觉电路的融合处理，实现 3D 形状感知

• 批准号: 10720137
• 负责人: CHARLES E CONNOR
• 金额: $ 72.73万
• 依托单位: JOHNS HOPKINS UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-09-01 至 2025-08-31
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10720137
• 关键词: 3-Dimensional; Action Potentials; Acute; Animal Model; Anterior; Area; Behavioral; Brain; Calibration; Code; Cognitive; Complex; Cues; Darkness; Development; Dimensions; Discrimination; Elements; Force of Gravity; Functional Magnetic Resonance Imaging; Future; Goals; Human; Individual; Insula of Reil; Lateral; Learning; Mechanics; Medial; Mediating; Methods; Modality; Monitor; Monkeys; Neurons; Parietal; Pathway interactions; Pattern; Perception; Population; Positioning Attribute; Prosthesis; Resolution; Rest; Shapes; Signal Transduction; Stereognosis; Stimulus; Supervision; Surface; System; Tactile; Testing; Time; Touch sensation; Training; Vision; Visual; area V1; combinatorial; experience; experimental study; extrastriate visual cortex; grasp; haptics; high dimensionality; human imaging; inferotemporal cortex; neural; neural network; novel; object perception; object shape; response; sensory input; somatosensory; spatiotemporal; success; tool; virtual; visual coding

THEORETICAL FRAMEWORK: Vision and touch share a critical function—perception of 3D object shape. We use vision and touch both alternatively and simultaneously to recognize, understand, and interact physically with real world objects, based on detailed apprehension of their 3D shapes and mechanical functionality. METHODS, INNOVATION, SPECIES: We propose a novel exploration of visual/haptic circuit interactions underlying 3D object perception: (i) at the spatiotemporal resolution of individual neurons and action potentials, (ii) across the scope of local neural networks studied with linear array recording in monkey IT, and (iii) in the behavioral context of active grasp to discriminate unseen objects. AIM 1 TEST OF HYPOTHESIS: Haptic 3D object discrimination evokes distinct, shape-specific neural population response patterns in anterior monkey IT. This predicted result would provide strong evidence that the final stage in the visual object pathway also carries haptic-origin information sufficient to discriminate 3D shapes through touch, as suggested by human fMRI. AIM 2 TEST OF HYPOTHESIS: Haptic shape-dependent responses in monkey IT embody a compositional geometric code for 3D shape, analogous to the IT code for visual 3D shape. We have previously shown that IT neurons responding to 3D object stimuli encode volumetric shape fragments in a high-dimensional geometric space. These signals provide the essential elements for ensembles of IT neurons to represent objects as 3D spatial compositions. We predict analogous compositional coding for haptic 3D shape, showing that vision and touch converge on the same powerful coding solution. AIM 3 TEST OF HYPOTHESIS: Individual IT neurons carry identical 3D shape information about haptic and visual objects. This predicted result of congruent visual and haptic coding by the same neurons would demonstrate that anterior IT carries a unified, supramodal 3D object representation. ENABLING A FUTURE BCP R01, LONG-TERM GOAL: Success on any of these aims would justify a subsequent TargetedBCP R01 application to characterize HOW haptic and visual circuits interact to: (i) exchange information across circuits connecting multiple processing stages (visual areas V1, V2, V4, posterior IT, anterior IT; somatosensory areas SI, SII, superior parietal, insula). (ii) dynamically combine and refine 3D shape information across visual and haptic circuits as congruent, redundant, or conflicting information accumulates from the two modalities. (iii) interact in new object learning, since the two modalities almost certainly provide mutual supervision, especially during development, when vision must calibrate so many indirect cues for 3D shape information directly available to touch. The LONGTERM GOAL is to understand how visual and haptic cortical circuits refine, reconcile, and synthesize two very different sensory inputs to produce a unified cognitive appreciation of 3D shape.

理论框架：视觉和触觉共享一个关键功能——感知 3D 物体 形状。我们交替并同时使用视觉和触觉来识别、理解和理解 基于对 3D 形状的详细理解，与现实世界的物体进行物理交互 机械功能。方法、创新、物种：我们提出了一种新颖的探索 3D 物体感知的视觉/触觉回路交互：(i) 时空分辨率为 单个神经元和动作电位，（ii）在局部神经网络的范围内进行研究 猴子 IT 中的线性阵列记录，以及（iii）在主动抓取的行为背景下进行区分 看不见的物体。目标 1 假设检验：触觉 3D 物体辨别唤起独特的、 猴子前部 IT 中形状特异性的神经群体反应模式。这个预测结果将 提供强有力的证据表明视觉对象通路的最后阶段也带有触觉起源 正如人类功能磁共振成像所建议的那样，这些信息足以通过触摸来区分 3D 形状。 目标 2 假设检验：猴子 IT 的触觉形状依赖性反应体现了 3D 形状的组合几何代码，类似于视觉 3D 形状的 IT 代码。我们有 先前表明，IT 神经元响应 3D 物体刺激，编码体积形状片段 高维几何空间。这些信号为 IT 整体提供了基本要素 神经元将物体表示为 3D 空间组合。我们预测类似的组合编码 对于触觉 3D 形状，表明视觉和触觉汇聚在同一个强大的编码解决方案上。 目标 3 假设检验：单个 IT 神经元携带相同的 3D 形状信息 触觉和视觉对象。通过相同的方法预测一致的视觉和触觉编码的结果 神经元将证明前 IT 具有统一的超模态 3D 对象表示。 实现未来的 BCP R01 长期目标：任何这些目标的成功都将证明 随后的 TargetedBCP R01 应用程序可描述触觉和视觉电路如何相互作用： (i) 在连接多个处理阶段的电路之间交换信息（视觉区域 V1、V2、 V4，IT 后部，IT 前部；体感区 SI、SII、上顶叶、岛叶）。 (二) 动态地 将视觉和触觉电路中的 3D 形状信息组合并细化为一致、冗余或 两种方式积累了相互矛盾的信息。 (iii) 在新对象学习中进行交互，因为 这两种模式几乎肯定会提供相互监督，特别是在开发过程中，当 视觉必须校准如此多的间接线索，以获得可直接触摸的 3D 形状信息。 长期目标是了解视觉和触觉皮层回路如何完善、协调和 综合两种截然不同的感官输入，产生对 3D 形状的统一认知欣赏。