Development in auditory-visual speech perception

感官间整合已被研究，特别是在自然-培育问题方面。本研究考察了语音感知中听觉视觉整合的发展变化，包括麦格克效应。麦格克效应是一种视听错觉，表明听人说话受到相互冲突的视觉唇读信息的影响。研究对象分别为3岁、7岁、11岁和20岁的母语为日语的儿童。每个年龄组包括10名受试者。刺激是由一位日本女性说话者发出的/ba/和/da/产生的。对录制的音节进行编辑，产生视听冲突的刺激（音频/ba/，视频/da/，反之亦然）以及视听匹配的刺激（音频/ba/，视频/ba/）。除了原始完整的刺激外，还制备了退化的刺激。听觉退化刺激通过低通滤波产生，截止频率为730 kHz；视觉退化刺激通过在嘴部及嘴部周围的马赛克效应产生。基于前导实验，设置了退化水平，使20年单峰性能的精度约为80%。有几个模态条件：A-only（清晰和低通），V-only（清晰和马赛克）和AV（单峰条件的组合）。受试者的任务是通过选择/ba/或/da/来报告他们的感知。在只有a和v的条件下，清晰的刺激被非常准确地感知，没有显示出年龄差异。在AV条件下，当听觉成分清晰时，麦格克效应的大小在各年龄组中是相同的。当听觉部分退化时，3岁儿童的麦格克效应明显小于其他年龄组，尽管3岁儿童表现出与其他年龄组一样强的麦格克效应。这些结果表明，视听冲突刺激的知觉整合出现相对较晚，而视听匹配刺激的知觉整合则在生命的早期阶段就开始了。少

Inter-sensory integration has been investigated especially in terms of the nature-nurture problem. The present study examined developmental changes in auditory-visual integration in speech perception including the McGurk effect. The McGurk effect is an audiovisual illusion showing that hearing speech is influenced by conflicting visual lip-read information.The subjects Were 3-year-old, 7-year-old, 11-year-old, and 20-year-old native speakers of Japanese. Each age group included 10 subjects. Stimuli were created from/ba/and/da/spoken by a Japanese female talker. Videotaped syllables were edited, resulting in audiovisually conflicting stimuli (audio/ba/, video/da/, and vice versa) as well as audiovisually matching stimuli (audio/ba/, video/ba/). In addition to original intact stimuli, degraded stimuli were prepared. The degraded auditory stimuli were created by lowpass filtering with a cut-off frequency of 730 kHz, the degraded visual stimuli were obtained by mosaic effect at and around … More the mouth. Based on pilot experiments, the level of the degradation was set so that accuracy of the unimodal performance was about 80% in the 20-year-old. There were several modality conditions : A-only (clear and lowpass), V-only (clear and mosaic), and AV (combinations of the unimodal conditions). The task of the subjects were to report what they perceived by choosing either/ba/or/da/.In the-A- and V-only conditions, clear stimuli were perceived very accurately, showing no age differences. In the AV conditions, the size of the McGurk effect was the same across the age groups when the auditory component was clear. When the auditory component was degraded, the size of the McGurk effect was significantly smaller in the 3-year-old than in the other age groups, although the 3-year-old showed as strong a McGurk effect as the other age groups.These results suggest that the integration for audiovisually conflicting stimuli emerges relatively late, whereas audiovisually matching stimuli are perceptually integrated at a very early stage of life. Less