Seeing and hearing rotated faces: Influences of facial orientation on visual and audiovisual speech recognition
Seeing and hearing rotated faces: Influences of facial orientation on visual and audiovisual speech recognition
复制标题
DOI：
10.1037/0096-1523.23.2.388
复制
发表时间：
1997-04-01
影响因子：
2.1
通讯作者：
Bevan, K
中科院分区：
文献类型：
--
作者：
Jordan, TR;Bevan, K
面部方位对静态面部信息的加工有影响，但对视觉言语加工的影响还没有得到充分的研究。三个实验中，面部取向的视觉语音处理的影响进行了研究，使用一个说话的脸，通过360度的8个方向。听觉和视觉形式的音节/ba/，/bi/，/ga/，/gi/，/ma/，/mi/，/ta/和/ti/被用来产生以下语音刺激类型：听觉，视觉，一致的视听，和不一致的视听。面部取向并不影响识别的视觉速度本身或接近完美的准确性听觉语音报告一致的视听语音刺激。然而，面孔朝向确实会影响听觉言语报告的准确性与不一致的视听言语刺激。此外，这种影响的性质取决于所使用的不一致的视觉语言的类型。视觉和视听语音处理的影响进行了讨论。
It is well-known that facial orientation affects the processing of static facial information, but similar effects on the processing of visual speech have yet to be explored fully. Three experiments are reported in which the effects of facial orientation on visual speech processing were examined using a talking face presented at 8 orientations through 360 degrees. Auditory and visual forms of the syllables /ba/, /bi/, /ga/, /gi/, /ma/, /mi/, /ta/, and /ti/ were used to produce the following speech stimulus types: auditory, visual, congruent audiovisual, and incongruent audiovisual. Facial orientation did not affect identification of visual speed per se or the near-perfect accuracy of auditory speech report with congruent audiovisual speech stimuli. However, facial orientation did affect the accuracy of auditory speech report with incongruent audiovisual speech stimuli. Moreover, the nature of this effect depended on the type of incongruent visual speech used. Implications for the processing of visual and audiovisual speech are discussed.