Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects

Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects
复制标题

DOI:
10.3758/bf03206849
复制
发表时间:
1997-01-01
期刊:
PERCEPTION & PSYCHOPHYSICS
影响因子:
--
通讯作者:
Sekiyama, K
Sekiyama, K
中科院分区:
其他
文献类型:
--
作者:
Sekiyama, K

文献摘要

被引文献

相似文献

“麦格克效应”表明,视觉(唇读)信息在言语感知过程中被使用,即使它与听觉信息不一致。虽然这在西方文化的受试者中已经被确立为一种强大的影响,但我们自己的早期结果表明,日本受试者使用视觉信息的次数比美国受试者少得多(Sekiyama & Tohkura,1993)。本研究考察了中国被试是否也会表现出减少麦格克效应,由于他们的文化相似性与日本。研究对象为14名居住在日本的中国人。刺激由10个音节(/ba/,/pa/,/ma/,/wa/,/da/,/ta/,/na/,/ga/,/ka/,/ra/)组成,由两个说话者(一个日本人和一个美国人)发音。每个听觉音节都被配音到一个扬声器内的每个视觉音节上,导致每种语言的100个视听刺激。受试者的主要任务是报告他们认为他们听到了什么,同时看着和听着说话者,而刺激被说出。与以往美国被试的结果相比,中国被试表现出较弱的McGurk效应。结果还表明,麦格克效应的大小取决于中国受试者在日本生活的时间长短。本文还讨论了中国被试对听觉信息依赖的形成和改变因素。
The ''McGurk effect'' demonstrates that visual (lip-read) information is used during speech perception even when it is discrepant with auditory information. While this has been established as a robust effect in subjects from Western cultures, our own earlier results had suggested that Japanese subjects use visual information much less than American subjects do (Sekiyama & Tohkura, 1993). The present study examined whether Chinese subjects would also show a reduced McGurk effect due to their cultural similarities with the Japanese. The subjects were 14 native speakers of Chinese living in Japan. Stimuli consisted of 10 syllables (/ba/, /pa/, /ma/, /wa/, /da/, /ta/, /na/, /ga/, /ka/, /ra/) pronounced by two speakers, one Japanese and one American. Each auditory syllable was dubbed onto every visual syllable within one speaker, resulting in 100 audiovisual stimuli in each language. The subjects' main task was to report what they thought they had heard while looking at and listening to the speaker while the stimuli were being uttered. Compared with previous results obtained with American subjects, the Chinese subjects showed a weaker McGurk effect. The results also showed that the magnitude of the McGurk effect depends on the length of time the Chinese subjects had lived in Japan. Factors that foster and alter the Chinese subjects' reliance on auditory information are discussed.