Development in auditory-visual speech perception

听觉视觉言语感知的发展

• 批准号: 10610070
• 负责人: SEKIYAMA Kaoru
• 金额: $ 2.18万
• 依托单位: Kanazawa University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 1998
• 资助国家: 日本
• 起止时间: 1998 至 1999
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-10610070/
• 关键词: auditory-visual; audiovisual speech perception; audiovisual integration; McGurk effect; development; 読唇; 視聴覚統合

Inter-sensory integration has been investigated especially in terms of the nature-nurture problem. The present study examined developmental changes in auditory-visual integration in speech perception including the McGurk effect. The McGurk effect is an audiovisual illusion showing that hearing speech is influenced by conflicting visual lip-read information.The subjects Were 3-year-old, 7-year-old, 11-year-old, and 20-year-old native speakers of Japanese. Each age group included 10 subjects. Stimuli were created from/ba/and/da/spoken by a Japanese female talker. Videotaped syllables were edited, resulting in audiovisually conflicting stimuli (audio/ba/, video/da/, and vice versa) as well as audiovisually matching stimuli (audio/ba/, video/ba/). In addition to original intact stimuli, degraded stimuli were prepared. The degraded auditory stimuli were created by lowpass filtering with a cut-off frequency of 730 kHz, the degraded visual stimuli were obtained by mosaic effect at and around … More the mouth. Based on pilot experiments, the level of the degradation was set so that accuracy of the unimodal performance was about 80% in the 20-year-old. There were several modality conditions : A-only (clear and lowpass), V-only (clear and mosaic), and AV (combinations of the unimodal conditions). The task of the subjects were to report what they perceived by choosing either/ba/or/da/.In the-A- and V-only conditions, clear stimuli were perceived very accurately, showing no age differences. In the AV conditions, the size of the McGurk effect was the same across the age groups when the auditory component was clear. When the auditory component was degraded, the size of the McGurk effect was significantly smaller in the 3-year-old than in the other age groups, although the 3-year-old showed as strong a McGurk effect as the other age groups.These results suggest that the integration for audiovisually conflicting stimuli emerges relatively late, whereas audiovisually matching stimuli are perceptually integrated at a very early stage of life. Less

特别是在先天-后天问题方面，已经对感觉间整合进行了研究。本研究探讨了言语知觉中认知-视觉整合的发展变化，包括McGurk效应。McGurk效应是一种视听错觉，表现出听觉言语受到相互冲突的视觉唇读信息的影响。每个年龄组包括10名受试者。刺激由日本女性说话者说的/ba/和/da/创建。对录制的音节进行编辑，产生视听冲突的刺激（音频/ba/，视频/da/，反之亦然）以及视听匹配的刺激（音频/ba/，视频/ba/）。除了原始的完整刺激，降解的刺激准备。通过截止频率为730 kHz的低通滤波产生退化听觉刺激，通过在 ...更多信息 嘴基于试点实验，退化的水平被设置为使得在20岁的单峰性能的准确度为约80%。有几种模态条件：仅A（清晰和低通）、仅V（清晰和马赛克）和AV（单峰条件的组合）。受试者的任务是报告他们所认为的选择/ba/或/da/。在A和V的条件下，清晰的刺激感知非常准确，没有表现出年龄差异。在AV条件下，当听觉成分清晰时，McGurk效应的大小在各年龄组中是相同的。当听觉成分被降级，麦格克效应的大小是显着小于3岁的比在其他年龄组，虽然3岁的表现出强烈的麦格克效应作为其他年龄组。这些结果表明，整合视听冲突的刺激出现相对较晚，而视听匹配的刺激感知整合在一个非常早期的生命阶段。少

项目成果

積山 薫: "視覚と聴覚の接点" 日本音響学会誌. 54. 450-456 (1998)

Kaoru Tsukiyama：“视觉和听觉之间的接口”日本声学学会杂志 54. 450-456 (1998)。

Amano, J. & Sekiyama, K.: "The McGurk effect is influenced by the stimulus set size"Proceedings of AVSP'98 (Burnham et al.(Eds.)). 43-48 (1998)

天野，J.

Amano, J.& Sekiyama, K.: "The McGurK effect is influenced by the stimulus set size." Proceedings of AVSP'98 (Burnham et.al (Ed.)). 43-48 (1998)

天野，J.

Sekiyama, K.: "Face or voice? Determinant of compellingness to the McGurk effect"Proceedings of AVSP'98 (Burnham et al.(Eds.)). 33-36 (1998)

Sekiyama, K.：“面部还是声音？麦格克效应的吸引力的决定因素”AVSP98 会议记录（Burnham 等人（编辑））。

Sekiyama, K.: "Face or voice? Determinant of compellingness to the McGurk effect. (in English)"Proceedings of International Conference on Auditory-Visual Speech Processing '98 (Edited by Burnham, D. et al). 33-36 (1998)

Sekiyama, K.：“面部还是声音？麦格克效应的吸引力的决定因素。（英文）”听觉视觉语音处理国际会议 98 的会议记录（由 Burnham，D. 等人编辑）。