A visual or tactile signal makes auditory speech detection more efficient by reducing uncertainty.
A visual or tactile signal makes auditory speech detection more efficient by reducing uncertainty.
复制标题
DOI：
10.1111/ejn.12471
复制
发表时间：
2014-04
期刊：
影响因子：
--
通讯作者：
Bernstein LE
中科院分区：
文献类型：
--
作者：
Tjan BS;Chao E;Bernstein LE
Acoustic speech is easier to detect in noise when the talker can be seen. This finding could be explained by integration of multisensory inputs or refinement of auditory processing from visual guidance. In two experiments, we studied two-interval forced choice detection of an auditory “ba” in acoustic noise, paired with various visual and tactile stimuli that were identically presented in both observation intervals. Detection thresholds were reduced under the multisensory conditions versus the auditory-only condition, even though the visual and/or tactile stimuli alone could not inform the correct response. Results were analyzed relative to an ideal observer for which intrinsic (internal) noise and efficiency were independent contributors to detection sensitivity. Across experiments, intrinsic noise was unaffected by the multisensory stimuli, arguing against the merging (integrating) of multisensory inputs into a unitary speech signal; but sampling efficiency was increased to varying degrees, supporting refinement of knowledge about the auditory stimulus. The steepness of the psychometric functions decreased with increasing sampling efficiency, suggesting that the “task-irrelevant” visual and tactile stimuli reduced uncertainty about the acoustic signal. Visible speech was not superior for enhancing auditory speech detection. Our results reject multisensory neuronal integration and speech-specific neural processing as explanations for enhanced auditory speech detection under noisy conditions. Instead, our results support a more rudimentary form of multisensory interaction – the otherwise task-irrelevant sensory systems inform the auditory system about when to listen.
登录
查看更多内容
影响因子：
9.8
作者：
Nahum M;Nelken I;Ahissar M
通讯作者：
Ahissar M
影响因子：
2.4
作者：
Grant, KW
通讯作者：
Grant, KW
影响因子：
2
作者：
Eskelund, Kasper;Tuomainen, Jyrki;Andersen, Tobias S.
通讯作者：
Andersen, Tobias S.
影响因子：
64.8
作者：
Gold, J;Bennett, PJ;Sekuler, AB
通讯作者：
Sekuler, AB
影响因子：
3.2
作者：
Bernstein, LE;Auer, ET;Takayanagi, S
通讯作者：
Takayanagi, S