Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task
Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task
复制标题
DOI：
10.1016/j.neulet.2005.09.032
复制
发表时间：
2006-01
影响因子：
2.5
通讯作者：
A. Vatakis;C. Spence
中科院分区：
文献类型：
--
作者：
A. Vatakis;C. Spence
本研究考察了人们在简短演讲和音乐视频中对视听不同步的敏感性。采用持续刺激的方法，随机呈现一系列语音（字母和音节）、吉他和钢琴音乐（单音符和双音符）视频片段。参与者对哪个流（听觉或视觉）似乎先出现进行了不快速的时间顺序判断。参与者的TOJ表现的准确性（根据可注意到的差异衡量；JND）对演讲的表现明显好于对吉他或钢琴音乐视频片段的表现，这表明人们对演讲的异步性比音乐刺激更敏感。在钢琴音乐片段中，视觉流必须引导听觉流才能达到主观同时性（PSS），而在吉他音乐片段中，听觉流通常需要引导。语音刺激获得的PSS值随着所呈现的特定语音的函数而变化很大。这些结果为人们对音乐刺激的视听非同步性的敏感性提供了第一个经验证据。我们的研究结果还表明，人们对语音刺激中的异步性的敏感性比以往使用连续语音流作为刺激的研究所提出的要好。
This study investigated people's sensitivity to audiovisual asynchrony in briefly-presented speech and musical videos. A series of speech (letters and syllables) and guitar and piano music (single and double notes) video clips were presented randomly at a range of stimulus onset asynchronies (SOAs) using the method of constant stimuli. Participants made unspeeded temporal order judgments (TOJs) regarding which stream (auditory or visual) appeared to have been presented first. The accuracy of participants’ TOJ performance (measured in terms of the just noticeable difference; JND) was significantly better for the speech than for either the guitar or piano music video clips, suggesting that people are more sensitive to asynchrony for speech than for music stimuli. The visual stream had to lead the auditory stream for the point of subjective simultaneity (PSS) to be achieved in the piano music clips while auditory leads were typically required for the guitar music clips. The PSS values obtained for the speech stimuli varied substantially as a function of the particular speech sound presented. These results provide the first empirical evidence regarding people's sensitivity to audiovisual asynchrony for musical stimuli. Our results also demonstrate that people's sensitivity to asynchrony in speech stimuli is better than has been suggested on the basis of previous research using continuous speech streams as stimuli.