Semantically congruent audiovisual integration with modal-based attention accelerates auditory short-term memory retrieval
Semantically congruent audiovisual integration with modal-based attention accelerates auditory short-term memory retrieval
复制标题
语义一致的视听集成与基于模态的注意力加速听觉短期记忆检索
DOI：
10.3758/s13414-021-02437-4
复制
发表时间：
2022-05
期刊：
影响因子：
--
通讯作者：
Jinglong Wu
中科院分区：
文献类型：
--
作者：
Hongtao Yu;Aijun Wang;Ming Zhang;JiaJia Yang;Satoshi Takahashi;Yoshimichi Ejima;Jinglong Wu
有证据表明，多感官整合的好处unisensory知觉性能是不对称的，听觉知觉性能可以收到更多的多感官的好处，特别是当注意力集中在一个任务无关的视觉刺激。目前，是否语义一致的多感觉整合与基于模态的注意随后unisensory短期记忆（STM）检索的好处也是不对称的仍然不清楚。本研究采用延迟匹配样本范式，通过操纵多感觉记忆编码过程中的注意焦点来探讨这一问题。结果表明，在语义一致的多感觉记忆条件下，视觉和听觉短时记忆提取反应时间都比单感觉记忆编码条件下快。我们认为，连贯的多感觉表征的形成可能会优化限制多感觉编码，并可以迅速触发随后的unisensory记忆检索的需求。至关重要的是，听觉短时记忆提取是专门加速语义一致的多感觉记忆编码，这表明，不太有效的感官形式的记忆提取依赖于一致的先前形成的多感觉表征优化的模态为基础的注意。
Evidence has shown that multisensory integration benefits to unisensory perception performance are asymmetric and that auditory perception performance can receive more multisensory benefits, especially when the attention focus is directed toward a task-irrelevant visual stimulus. At present, whether the benefits of semantically (in)congruent multisensory integration with modal-based attention for subsequent unisensory short-term memory (STM) retrieval are also asymmetric remains unclear. Using a delayed matching-to-sample paradigm, the present study investigated this issue by manipulating the attention focus during multisensory memory encoding. The results revealed that both visual and auditory STM retrieval reaction times were faster under semantically congruent multisensory conditions than under unisensory memory encoding conditions. We suggest that coherent multisensory representation formation might be optimized by restricted multisensory encoding and can be rapidly triggered by subsequent unisensory memory retrieval demands. Crucially, auditory STM retrieval is exclusively accelerated by semantically congruent multisensory memory encoding, indicating that the less effective sensory modality of memory retrieval relies more on the coherent prior formation of a multisensory representation optimized by modal-based attention.
登录
查看更多内容
DOI：
10.4324/9780203773079
发表时间：
2013-05
期刊：
--
影响因子：
--
作者：
D. Lewkowicz;R. Lickliter
通讯作者：
D. Lewkowicz;R. Lickliter
选择性和分散注意力调节青少年的视听整合
影响因子：
1.8
作者：
Yang Weiping;Li Shengnan;Xu Jianping;Li Zimo;Yang Xiangfu;Ren Yanna
通讯作者：
Ren Yanna
DOI：
10.7551/mitpress/4877.003.0014
发表时间：
1999
期刊：
--
影响因子：
--
作者：
M. Kahana;G. Loftus
通讯作者：
M. Kahana;G. Loftus
视听语义整合和注意力调节的皮层网络：功能磁共振成像和基于图形的研究
影响因子：
3.7
作者：
Xi Yang;Li Qi;Gao Ning;He Siyuan;Tang Xiaoyu
通讯作者：
Tang Xiaoyu
工作记忆中复杂视听对象编码过程中的 Theta 振荡和源连接
影响因子：
2.9
作者：
Xie Y;Li Y;Duan H;Xu X;Zhang W;Fang P
通讯作者：
Fang P