Development in auditory-visual speech perception

感觉间整合已经被研究，特别是在先天-后天问题方面。本研究考察了包括McGurk效应在内的言语知觉中听觉-视觉整合的发展变化。麦格克效应是一种视听错觉，表明听觉语言受到相互冲突的视觉唇读信息的影响。受试者包括3岁、7岁、11岁和20岁的以日语为母语的儿童。每个年龄组包括10名受试者。刺激是由一位日本女性说话者说的/ba/和/da/产生的。对录制的音节进行编辑，产生视听冲突的刺激(音频/ba/、视频/da/，反之亦然)以及视听匹配的刺激(音频/ba/、视频/ba/)。除了原始的完整刺激外，还准备了退化刺激。用截止频率为730 kHz的低通滤波产生退化的听觉刺激，用马赛克效应在…及其周围产生退化的视觉刺激更多的是嘴。根据初步实验，设定了退化的水平，以便在20岁时单峰表现的准确率约为80%。有几种通道条件：仅A通道(清晰和低通)，仅V通道(清晰和马赛克)，以及AV(单峰条件的组合)。受试者的任务是通过选择/ba/或/da/来报告他们感觉到了什么。在-A-和V-Only条件下，清晰的刺激被非常准确地感知到，没有年龄差异。在AV条件下，当听觉成分清晰时，McGurk效应的大小在各年龄组中是相同的。当听觉成分退化时，3岁儿童的McGurk效应显著小于其他年龄组，尽管3岁儿童表现出与其他年龄组一样强的McGurk效应。这些结果表明，视听冲突刺激的整合出现得相对较晚，而视听匹配刺激的整合在生命的非常早期就被知觉地整合了。较少

Inter-sensory integration has been investigated especially in terms of the nature-nurture problem. The present study examined developmental changes in auditory-visual integration in speech perception including the McGurk effect. The McGurk effect is an audiovisual illusion showing that hearing speech is influenced by conflicting visual lip-read information.The subjects Were 3-year-old, 7-year-old, 11-year-old, and 20-year-old native speakers of Japanese. Each age group included 10 subjects. Stimuli were created from/ba/and/da/spoken by a Japanese female talker. Videotaped syllables were edited, resulting in audiovisually conflicting stimuli (audio/ba/, video/da/, and vice versa) as well as audiovisually matching stimuli (audio/ba/, video/ba/). In addition to original intact stimuli, degraded stimuli were prepared. The degraded auditory stimuli were created by lowpass filtering with a cut-off frequency of 730 kHz, the degraded visual stimuli were obtained by mosaic effect at and around … More the mouth. Based on pilot experiments, the level of the degradation was set so that accuracy of the unimodal performance was about 80% in the 20-year-old. There were several modality conditions : A-only (clear and lowpass), V-only (clear and mosaic), and AV (combinations of the unimodal conditions). The task of the subjects were to report what they perceived by choosing either/ba/or/da/.In the-A- and V-only conditions, clear stimuli were perceived very accurately, showing no age differences. In the AV conditions, the size of the McGurk effect was the same across the age groups when the auditory component was clear. When the auditory component was degraded, the size of the McGurk effect was significantly smaller in the 3-year-old than in the other age groups, although the 3-year-old showed as strong a McGurk effect as the other age groups.These results suggest that the integration for audiovisually conflicting stimuli emerges relatively late, whereas audiovisually matching stimuli are perceptually integrated at a very early stage of life. Less