視覚と聴覚による音声知覚―言語/文化による差とその発達―
視覚と聴覚による音声知覚―言語/文化による差とその発達―
复制标题
DOI：
10.11225/jcss.18.387
复制
发表时间：
2011-09
期刊：
影响因子：
--
通讯作者：
薫 積山
中科院分区：
文献类型：
--
作者：
薫 積山
多感官交流的一个众所周知的方面是面对面言语感知中的听觉和视觉整合，这在McGurk效应中得到了证明，在该效应中，听到的言语被不匹配的视觉嘴部运动所改变。麦格克效应的易感性取决于各种因素，包括听觉语言的可理解性。在这里，我将重点研究感知者的语言背景作为视觉言语使用程度的影响因素。当听觉言语具有高度可理解性时，以日语为母语的人倾向于依赖听觉言语，与以英语为母语的人相比，视觉影响较小。这种中介语差异在6岁时并不明显，但在8岁时由于母语为英语的人视觉影响的增加而发展起来。似乎以英语为母语的人在发展过程中获得了强有力的唇读能力，以至于成年英语人士的单音节唇读速度比他们听到的要快，而以日语为母语的人却没有这种视觉上的优先。事件相关电位和功能磁共振成像证实了这种中介语差异。
One of well-known aspects of multisensory communication is auditory and visual integration in face-to-face speech perception as demonstrated in the McGurk effect in which heard speech is altered by mismatching visual mouth movements. The susceptibility to the McGurk effect varies depending on various factors including the intelligibility of auditory speech. Here I focus on the language background of perceivers as an influencing factor on the degree of use of visual speech. When the auditory speech is highly intelligible, native Japanese speakers tend to depend on auditory speech, showing less visual influence compared with native English speakers. Such interlanguage differences are not apparent at 6 years of age, but are developed by 8 years due to increasing visual influence in native English speakers. It seems that native English speakers developmentally acquire vigorous lipreading ability such that adult English speakers can lipread monosyllables faster than they can hear them, while such visual precedence is not observed in native Japanese speakers. This kind of interlanguage difference is being confirmed by event-related potentials and functional magnetic resonance imaging.