The ventriloquist effect results from near-optimal bimodal integration
The ventriloquist effect results from near-optimal bimodal integration
复制标题
DOI：
10.1016/j.cub.2004.01.029
复制
发表时间：
2004-02-03
期刊：
影响因子：
9.2
通讯作者：
Burr, D
中科院分区：
文献类型：
--
作者：
Alais, D;Burr, D
腹语术是一种古老的艺术，使自己的声音看起来像是来自其他地方，这种艺术被希腊和罗马的神谕所利用，可能更早。我们经常在看电视和电影时体验到这种效果，在那里，声音似乎是从演员的嘴唇发出的，而不是从实际的声源发出的。最初，腹语被解释为表演者通过特殊技术向木偶投射声音b[1]，但最近人们认为腹语是视觉“捕捉”声音的结果[2-5]。在这项研究中，我们研究了视听刺激的空间定位。当视觉定位良好时，视觉确实会主导并捕捉声音。然而，对于严重模糊的视觉刺激（定位不良），情况正好相反：声音捕捉视觉。对于模糊程度较低的刺激，两种感觉都不占主导地位，而知觉遵循平均位置。双峰定位的精度通常优于视觉或听觉单峰定位。所有的结果都可以很好地解释，不是一种感觉捕捉到另一种感觉，而是视觉和听觉信息最佳组合的简单模型。
Ventriloquism is the ancient art of making one's voice appear to come from elsewhere, an art exploited by the Greek and Roman oracles, and possibly earlier [1]. We regularly experience the effect when watching television and movies, where the voices seem to emanate from the actors' lips rather than from the actual sound source. Originally, ventriloquism was explained by performers projecting sound to their puppets by special techniques [1], but more recently it is assumed that ventriloquism results from vision "capturing" sound [2-5]. In this study we investigate spatial localization of audio-visual stimuli. When visual localization is good, vision does indeed dominate and capture sound. However, for severely blurred visual stimuli (that are poorly localized), the reverse holds: sound captures vision. For less blurred stimuli, neither sense dominates and perception follows the mean position. Precision of bimodal localization is usually better than either the visual or the auditory unimodal presentation. All the results are well explained not by one sense capturing the other, but by a simple model of optimal combination of visual and auditory information.