Audiovisual speech is more than the sum of its parts: Auditory-visual superadditivity compensates for age-related declines in audible and lipread speech intelligibility.
Audiovisual speech is more than the sum of its parts: Auditory-visual superadditivity compensates for age-related declines in audible and lipread speech intelligibility.
复制标题
DOI：
10.1037/pag0000613
复制
发表时间：
2021-06
影响因子：
3.7
通讯作者：
Harris KC
中科院分区：
文献类型：
--
作者：
Dias JW;McClaskey CM;Harris KC
多感官输入可以改善模糊单感官信息的感知。例如，当听众看到说话者清晰的面部时，可以更准确地识别在噪音中听到的语音。重要的是，这些多感官效应可以对听者处理单感官语音的能力起到超加性作用，使得视听语音识别优于仅凭听觉和仅凭视觉的语音识别的总和。听觉和视觉言语感知的听觉和视觉相关下降被假设为伴随着对视听言语识别的更强的跨感官影响，但几乎没有证据支持这一点。目前，研究没有考虑到多感官的超加性的好处，视听输入在他们的听觉或视觉的影响视听言语感知的指标。在这里，我们把多感觉超加性作为独立于单感觉听觉和视觉处理。在目前的调查中，老年人和年轻人在嘈杂的听力条件下识别听觉，视觉和视听语音。在这些条件下的性能被用来计算视听语音识别的听觉和视觉的影响和一个度量的听觉-视觉superadditivity的常规指标。与过去的工作一致，听觉和视觉语音识别随着年龄的增长而下降，视听语音识别被保留，并且没有观察到听觉或视觉对视听语音识别的影响的年龄相关差异。然而，我们发现，随着年龄的增长，认知视觉超加性。新的发现表明，多感觉超可加性独立于单感觉加工。随着年龄的增长，听觉和视觉语言识别能力下降，多感觉超加性的补偿性变化可能会保护老年人的视听语言识别能力。
Multisensory input can improve perception of ambiguous unisensory information. For example, speech heard in noise can be more accurately identified when listeners see a speaker’s articulating face. Importantly, these multisensory effects can be superadditive to listeners’ ability to process unisensory speech, such that audiovisual speech identification is better than the sum of auditory-only and visual-only speech identification. Age-related declines in auditory and visual speech perception have been hypothesized to be concomitant with stronger cross-sensory influences on audiovisual speech identification, but little evidence exists to support this. Currently, studies do not account for the multisensory superadditive benefit of auditory-visual input in their metrics of the auditory or visual influence on audiovisual speech perception. Here we treat multisensory superadditivity as independent from unisensory auditory and visual processing. In the current investigation, older and younger adults identified auditory, visual, and audiovisual speech in noisy listening conditions. Performance across these conditions was used to compute conventional metrics of the auditory and visual influence on audiovisual speech identification and a metric of auditory-visual superadditivity. Consistent with past work, auditory and visual speech identification declined with age, audiovisual speech identification was preserved, and no age-related differences in the auditory or visual influence on audiovisual speech identification were observed. However, we found that auditory-visual superadditivity improved with age. The novel findings suggest that multisensory superadditivity is independent of unisensory processing. As auditory and visual speech identification decline with age, compensatory changes in multisensory superadditivity may preserve audiovisual speech identification in older adults.
登录
查看更多内容
影响因子：
3.7
作者：
DeLoss DJ;Pierce RS;Andersen GJ
通讯作者：
Andersen GJ
影响因子：
2.4
作者：
Altieri, Nicholas A.;Pisoni, David B.;Townsend, James T.
通讯作者：
Townsend, James T.
影响因子：
9.2
作者：
Calvert, GA;Campbell, R;Brammer, MJ
通讯作者：
Brammer, MJ
影响因子：
4.8
作者：
Füllgrabe C;Moore BC;Stone MA
通讯作者：
Stone MA
DOI：
10.1111/j.2517-6161.1995.tb02031.x
发表时间：
1995-01-01
影响因子：
5.8
作者：
BENJAMINI, Y;HOCHBERG, Y
通讯作者：
HOCHBERG, Y