Multi-modal representation of the size of space in the human brain.
Multi-modal representation of the size of space in the human brain.
复制标题
人脑空间大小的多模态表示。
DOI：
10.1101/2023.07.24.550343
复制
发表时间：
2023
期刊：
影响因子：
--
通讯作者：
Park,Soojin
中科院分区：
文献类型：
--
作者：
Lee,Jaeeun;Park,Soojin
为了估计室内空间的大小，我们必须分析限制空间范围的视觉边界和来自反射的内部表面的声学线索。我们使用功能磁共振成像来研究当各种类型的感官线索单独或一起呈现时，大脑如何处理室内场景的几何尺寸。具体来说，我们问的空间的大小是代表在一个特定的方式或在一个综合的方式，结合多模态线索。在一个街区设计研究中，呈现了描绘小型和大型室内空间的图像或声音。视觉刺激是真实世界中的或大或小的空白空间的图片。听觉刺激是声音与不同混响的卷积。通过使用多体素模式分类器，我们问是否可以在视觉，听觉，视听结合的条件下分类的两个大小的空间。我们确定了空间大小的感官特异性和多模态表示。为了进一步研究多模态区域的性质，我们专门研究了它是否包含共存或整合形式的多模态信息。我们发现，角回和右额内侧回具有模态整合表征，对图像和声音传递的空间大小信息的匹配表现出敏感性。背景功能连接分析进一步表明，与单一模态条件相比，多模态条件下感觉特异性区域和模态整合区域之间的连接增加。我们的研究结果表明，空间大小知觉依赖于特定的感官和多模态的表示，以及它们之间的相互作用，在多模态感知。
To estimate the size of an indoor space, we must analyze the visual boundaries that limit the spatial extent and acoustic cues from reflected interior surfaces. We used fMRI to examine how the brain processes the geometric size of indoor scenes when various types of sensory cues are presented individually or together. Specifically, we asked whether the size of space is represented in a modality-specific way or in an integrative way that combines multimodal cues. In a block-design study, images or sounds that depict small- and large-sized indoor spaces were presented. Visual stimuli were real-world pictures of empty spaces that were small or large. Auditory stimuli were sounds convolved with different reverberations. By using a multivoxel pattern classifier, we asked whether the two sizes of space can be classified in visual, auditory, and visual–auditory combined conditions. We identified both sensory-specific and multimodal representations of the size of space. To further investigate the nature of the multimodal region, we specifically examined whether it contained multimodal information in a coexistent or integrated form. We found that angular gyrus and the right medial frontal gyrus had modality-integrated representation, displaying sensitivity to the match in the spatial size information conveyed through image and sound. Background functional connectivity analysis further demonstrated that the connection between sensory-specific regions and modality-integrated regions increases in the multimodal condition compared with single modality conditions. Our results suggest that spatial size perception relies on both sensory-specific and multimodal representations, as well as their interplay during multimodal perception.