The analysis of unclear vocal articulations of auditory-impaired and the construction of an interactive training system using a talking robot

在本研究中，应用一个会说话的机器人构建了一个听障人士发声训练系统，该机器人具有像人类一样的机械器官。利用听觉反馈控制的自适应学习策略，机器人自主学习人类的发声，然后从输入的语音中复制语音发音。通过分析获得的语音清晰度与存储在机器人中的语音之间的关系，对听障人士发出的模糊语音进行分类，提取与机器人再现的语音清晰度相关联的特定特征。将该机器人应用于听障人士的语音训练，训练结果验证了使用该机器人进行交互训练的有效性。

In this study, a vocalization training system for the auditory-impaired was constructed by applying a talking robot, which has mechanical organs like a human. With an adaptive learning strategy using an auditory feedback control, the robot autonomously learned the human vocalizations, and then reproduced the speech articulations from inputted vocal sounds. By analyzing the acquired relations between vocal articulations and the generated vocal sounds stored in the robot, unclear vocal sounds given by auditory-impaired people were classified, and then particular features were extracted, which were associated with vocal articulations reproduced by the robot. The robot was employed in the speech training for auditory-impaired, and the training results verified the effectiveness of the interactive training employing the robot.