Multisensory integration of speech signals: the relationship between space and time
Multisensory integration of speech signals: the relationship between space and time
复制标题
DOI：
10.1007/s00221-006-0634-0
复制
发表时间：
2006-10-01
影响因子：
2
通讯作者：
Jarick, Michelle
中科院分区：
文献类型：
--
作者：
Jones, Jeffery A.;Jarick, Michelle
当源在空间和时间上分离时，整合简单事件的视听线索会受到影响。相比之下，视听感知的讲话出现弹性时，无论是空间或时间的差异存在。我们研究了言语感知是否对空间和时间不一致的组合敏感。参与者听到双音节/阿坝/，同时看到一张脸产生不一致的双音节/ava/。我们测试了当声音与面部运动（从-360到+360 ms）不同步并从与参与者等距的五个位置发出时，视觉对听觉感知的影响程度。虽然观察到的相互作用，这是不相关的参与者的感知同步，也没有表明空间和时间差异的影响之间的线性关系。我们的结论是，无论是信号的复杂性或任务的性质，减少依赖视听语音感知的空间和时间的连续性。
Integrating audiovisual cues for simple events is affected when sources are separated in space and time. By contrast, audiovisual perception of speech appears resilient when either spatial or temporal disparities exist. We investigated whether speech perception is sensitive to the combination of spatial and temporal inconsistencies. Participants heard the bisyllable /aba/ while seeing a face produce the incongruent bisyllable /ava/. We tested the level of visual influence over auditory perception when the sound was asynchronous with respect to facial motion (from -360 to +360 ms) and emanated from five locations equidistant to the participant. Although an interaction was observed, it was not related to participants' perception of synchrony, nor did it indicate a linear relationship between the effect of spatial and temporal discrepancies. We conclude that either the complexity of the signal or the nature of the task reduces reliance on spatial and temporal contiguity for audiovisual speech perception.