Audio-Visual interaction in speech perceptionn in subjects with hearing

有听力受试者言语感知中的视听交互

• 批准号: 11671668
• 负责人: KAWASE Tetsuaki
• 金额: $ 2.3万
• 依托单位: Tohoku University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 1999
• 资助国家: 日本
• 起止时间: 1999 至 2000
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-11671668/
• 关键词: McGurk effect; hearing impairment; multimodality; speech pereception 11; 可塑性

Audio-Visual interaction in the speech perception for subjects with deteriorated hearing was examined through the measurements of McGurk effects. In the McGurk effect, perceptual identification of auditory speech syllables is influenced by simultaneous presentation of discrepant visible speech syllables. This effect has been found in subjects of different ages and with various native language backgrounds.In the present study, the effects of deteriarated auditory stimulus on McGurk effects were examined. Although this effects were infuluenced by the deteriorated audio-stimuli, the results obtained appeared to reflect that the visual cue for speech recognition played more important role when the auditory cue for speech recognition was degraded.The obtained results suggest that McGurk effects possibly can be use as an indicator for the audio-visual interaction in the speech perception.

通过测量McGurk效应，研究了听力下降者言语知觉中的视听交互作用。在McGurk效应中，听觉语音音节的感知识别受到同时呈现不一致的可见语音音节的影响。这种效应存在于不同年龄和不同母语背景的被试中。虽然这种效应会受到听觉刺激劣化的影响，但这一结果似乎反映了听觉线索劣化时，视觉线索在言语识别中的作用更为重要，提示McGurk效应可能可以作为言语知觉中视听交互作用的一个指标。

项目成果

吉川智子,川瀬哲明,鈴木陽一 他: "音声認識における聴覚・視覚情報処理の統合"日本耳鼻咽喉科学会会報. 103. 473 (2000)

Tomoko Yoshikawa、Tetsuaki Kawase、Yoichi Suzuki 等人：“语音识别中的听觉和视觉信息处理的集成”日本耳鼻喉科协会通报 103. 473 (2000)。

Abe K,Suzuki Y et al.: "The effects of visual information on the impression of environmental sounds"Inter-Noise 2000. 1177-1182 (2000)

Abe K、Suzuki Y 等人：“视觉信息对环境声音印象的影响”Inter-Noise 2000. 1177-1182 (2000)

Suzuki Y et al.: "Comparison between the effects of addtional verbal and visual information on the perception of environmental sounds"Inter-Noise 2000. 2285-2291 (2000)

铃木 Y 等人：“附加言语和视觉信息对环境声音感知的影响的比较”Inter-Noise 2000. 2285-2291 (2000)

Kawase T, Suzuki Y et al.: "The effects of background noise on McGurk effcts."Audiology Japan. 43. 471-472 (2000)

Kawase T、Suzuki Y 等人：“背景噪声对麦格克效应的影响。”日本听力学。

川瀬哲明,鈴木陽一 他: "マガーク効果における背景雑音の影響に関する検討"Audiology Japan. 43. 471-472 (2000)

Tetsuaki Kawase、Yoichi Suzuki 等：“背景噪声对 McGurk 效应的影响的研究”Audiology Japan，43. 471-472 (2000)。