Development of advanced audio-visual speech communication system for transfer Kanseiinformation

点击翻译按钮获取中文摘要

The aim of this study is to develop next generation audio-visual communication system. For this purpose, I investigated how people integrate speech sound and moving image of talker's face not only for understanding speech signal but also for perceiving a kind of sensational and emotional (Kansei) information. I focused on the effect of speech-rate for audio-visual speech understanding, because "speaking slowly" is very good way to talk to older adults, especially hearing impaired listeners. I used speech-rate conversion technique to slow down speech-rate and synthesized signal was combined with original movie. The results of experiment suggested that older adults are tolerant of audio-visual asynchrony. This fact implies the possibility of new audio-visual communication system, which enhance speech understanding by slowing down auditory information.