Differences in auditory-visual speech perception between Japanese and Americans: McGurk effect as a function of incompatibility.

Differences in auditory-visual speech perception between Japanese and Americans: McGurk effect as a function of incompatibility.
复制标题

日本人和美国人之间听觉视觉言语感知的差异:麦格克效应是不相容性的函数。

DOI:
10.1250/ast.15.143
复制
发表时间:
1994
期刊:
The Journal of The Acoustical Society of Japan (e)
影响因子:
--
通讯作者:
K. Sekiyama
K. Sekiyama
中科院分区:
--
文献类型:
--
作者:
K. Sekiyama

文献摘要

参考文献

被引文献

相似文献

据报道,在英语文化中,当听觉言语与差异视觉(唇读)言语同步呈现时,受试者经常报告听到的声音整合了两种模式的信息(“麦格克效应”)。然而,Sekiyama 和 Tohkura 最近表明,与美国人相比,日本受试者受差异视觉线索的影响较小。这项研究从麦格克效应的大小和不兼容频率之间的关系来检验中介语的差异。刺激材料是由日本人和美国人发音的十个音节(/ba、pa、ma、wa、da、ta、na、ga、ka、ra/)。说话者发出的 10 个听觉音节和 10 个视觉音节被交叉配音,产生 100 个听觉-视觉刺激。向 14 名日本人和 10 名美国人展示了日语音节。英语音节被呈现给不同的受试者组,其中 12 名日本人和 10 名美国人。刺激在安静和添加噪音的条件下呈现。受试者被要求检查他们所听到的和他们所看到的之间的不一致性,并报告他们所听到的。结果表明,麦格克效应的大小与不相容的频率呈高度负相关。有人认为,日本人听日语语音时出现的小麦格克效应是由于日本人对听觉和视觉差异的敏感度较高。
In English speaking cultures, it has been reported that when auditory speech is presented in synchrony with discrepant visual (lip-read) speech, the subjects often report hearing sounds that integrate information from the two modalities (the “McGurk effect”). However, Sekiyama and Tohkura recently showed that Japanese subjects are less influenced by discrepant visual cues than Americans. This study examined the interlanguage differences in terms of the relationship between the magnitude of the McGurk effect and the frequency of incompatibility. The stimulus materials were ten syllables (/ba, pa, ma, wa, da, ta, na, ga, ka, ra/) pronounced by a Japanese and an American speaker. The ten auditory and ten visual syllables pronounced by a speaker were cross-dubbed resulting in 100 auditory-visual stimuli. Japanese syllables were presented to 14 Japanese and 10 American subjects. English syllables were presented to different groups of subjects, 12 Japanese and 10 American. The stimuli were presented in both quiet and noise-added conditions. The subjects were asked to check incompatibility between what they heard and what they saw as well as to report what they heard. The results showed that the magnitude of the McGurk effect correlated highly negatively with the frequency of incompatibility. It was suggested that the small McGurk effect in the Japanese subjects listening to Japanese speech is due to the higher sensitivity of the Japanese to auditory-visual discrepancy.
语音感知过程中视觉位置和听觉发声信息的整体处理。
DOI: 10.1037//0096-1523.17.1.278
发表时间: 1991
期刊: Journal of experimental psychology. Human perception and performance
影响因子: --
作者:
Green,KP;Kuhl,PK
通讯作者: Kuhl,PK