The Cortical Representation of Language Timescales is Shared between Reading and Listening.
The Cortical Representation of Language Timescales is Shared between Reading and Listening.
复制标题
语言时间尺度的皮层表征在阅读和听力之间共享。
DOI：
10.1101/2023.01.06.522601
复制
发表时间：
2023
期刊：
影响因子：
--
通讯作者：
Deniz,Fatma
中科院分区：
文献类型：
--
作者：
Chen,Catherine;DuprélaTour,Tom;Gallant,JackL;Klein,Dan;Deniz,Fatma
语言理解涉及将低水平的感觉输入整合到一个由越来越高水平的特征组成的层次结构中。之前的工作研究了不同语言层次的大脑表征，但还没有确定这些大脑表征是否在书面语言和口语中共享。为了解决这个问题，我们分析了当参与者在每种模式下阅读和聆听相同的叙述时记录的fMRI大胆数据。语言层次的级别被操作为时间尺度，其中每个时间尺度指的是语言刺激的一组频谱成分。体素编码模型被用来确定不同的时间尺度在大脑皮层中的位置，分别针对每种通道。这些模型表明，在这两种模式之间，时间尺度表示在大脑皮层表面上的组织方式类似。我们的结果表明，在低水平的感觉加工之后，无论刺激通道如何，语言整合的过程都是相似的。
Language comprehension involves integrating low-level sensory inputs into a hierarchy of increasingly high-level features. Prior work studied brain representations of different levels of the language hierarchy, but has not determined whether these brain representations are shared between written and spoken language. To address this issue, we analyze fMRI BOLD data that were recorded while participants read and listened to the same narratives in each modality. Levels of the language hierarchy are operationalized as timescales, where each timescale refers to a set of spectral components of a language stimulus. Voxelwise encoding models are used to determine where different timescales are represented across the cerebral cortex, for each modality separately. These models reveal that between the two modalities timescale representations are organized similarly across the cortical surface. Our results suggest that, after low-level sensory processing, language integration proceeds similarly regardless of stimulus modality.