Prosody enhanced TTS for Dysarthric Speakers

描述（由申请人提供）：这个可行性项目研究有复杂交流需求的人是否可以在一个独特的语音感知单词预测程序中控制文本语音合成器的韵律。研究小组计划开发能够判断说话者是否强调说话内容的第二代语音识别系统。说话者强调的单词将被文本-语音合成器强调。我们将把这种语音识别技术整合到一个“韵律感知”的单词预测程序中，这样构音障碍患者就可以使用他们的语音，结合其他技术，来控制计算机生成语音的韵律。有复杂沟通需求的人、他们的伴侣和第三方听众会评估这个系统，以确定韵律控制是否能改善沟通过程。公共卫生相关性：本研究的目的是提高具有复杂沟通需求的人的沟通有效性。我们建议通过开发技术，使他们能够控制商业文本语音合成器的韵律，使用他们的诵读困难的语音和书面线索。

DESCRIPTION (provided by applicant): This feasibility project investigates whether people with complex communication needs can control the prosody of a text-to-speech synthesizer within a unique speech-aware word prediction program. The research team will design a second-generation speech recognition system for dysarthric speakers that includes the ability to measure whether the speaker emphasizes a spoken word. Words that are emphasized by the speaker will then be emphasized by a text-to-speech synthesizer. We will incorporate this speech recognition technology into a "prosody aware" word prediction program so that people with dysarthria can use their speech, in combination with other techniques, to control the prosody of computer generated speech. People with complex communication needs, their partners, and third party listeners will evaluate this system to determine if prosody control improves the communication process. PUBLIC HEALTH RELEVANCE: The aim of this research is to increase the communication effectiveness of persons who have complex communication needs. We propose to do this by developing technology that enables them to control the prosody of a commercial text-to-speech synthesizer using their dysarthric speech and written cues.