The role of visual information in the processing of
The role of visual information in the processing of
复制标题
视觉信息在信息加工中的作用
DOI：
--
复制
发表时间：
1989
期刊：
影响因子：
--
通讯作者：
P. Kuhl
中科院分区：
文献类型：
--
作者：
K. Green;P. Kuhl
说话者的嘴部运动所提供的视觉信息可以影响对某些语言特征的感知。因此，“McGurk效应”表明，当音节/bi/与音节/gi/同时出现时，当它在视觉上出现时，一个人会认为说话者说的是/di/。此外，研究表明，在语音感知中，当信息被听觉呈现时，位置和语音特征之间会发生相互作用。在我们的第一个实验中，我们询问了当地点信息由听觉和视觉信息组合指定时，特征交互是否会发生。从/ibi/到/ipi/范围内的听觉连续体的成员与一个说话人说/igi/的视频配对。听觉标记在/ibi/到/ipi/之间，而听觉-视觉标记在/idi/到/iti/之间。结果表明，听觉-视觉标记的发声边界所处的VOT值明显长于不含视觉信息的听觉连续体的发声边界。这些结果表明，地点-语音交互并不局限于地点信息是可听的情况。在接下来的三个实验中，我们发现(1)即使存在不一致的视听信息，在全局感知没有变化的情况下，语音边界也不会移动；(2)为被试提供的反应选项数量不影响视听刺激的分类和VOT边界；(3)当受试者被指令强迫将/b-p/听觉刺激重新标记
为/d/或/t/时，VOT边界移动的原始效果不会被复制。受试者成功地重新标记刺激，但未观察到VOT边界的移位。
Visual information provided by a talker’s mouth movements can influence the perception of certain speech features. Thus, the “McGurk effect” shows that when the syllable /bi/ is presented audibly, in synchrony with the syllable /gi/, as it is presented visually, a person perceives the talker as saying /di/. Moreover, studies have shown that interactions occur between place and voicing features in phonetic perception, when information is presented audibly. In our first experiment, we asked whether feature interactions occur when place information is specified by a combination of auditory and visual information. Members of an auditory continuum ranging from /ibi/ to /ipi/ were paired with a video display of a talker saying /igi/. The auditory tokens were heard as ranging from /ibi/ to /ipi/, but the auditory-visual tokens were perceived as ranging from /idi/ to /iti/. The results demonstrated that the voicing boundary for the auditory-visual tokens was located at a significantly longer VOT value than the voicing boundary for the auditory continuum presented without the visual information. These results demonstrate that place-voice interactions are not limited to situations in which place information is specified audibly. In three follow-up experiments, we show that (1) the voicing boundary is not shifted in the absence of a change in the global percept, even when discrepant auditory-visual information is presented; (2) the number of response alternatives provided for the subjects does not affect the categorization or the VOT boundary of the auditory-visual stimuli; and (3) the original effect of a VOT boundary shift is not replicated when subjects are forced by instruction to ldrelabel
d the /b-p/auditory stimuli as/d/or/t/. The subjects successfully relabeled the stimuli, but no shift in the VOT boundary was observed.
动物实验对言语中特殊机制辩论的理论贡献。
DOI：
--
发表时间：
1986
期刊：
Experimental biology
影响因子：
--
作者：
Kuhl,PK
通讯作者：
Kuhl,PK