The analysis of unclear vocal articulations of auditory-impaired and the construction of an interactive training system using a talking robot

本研究利用具有类似人的机械器官的会说话机器人，构建了一个听觉受损者发声训练系统。机器人采用听觉反馈控制的自适应学习策略，自主学习人类的发声，然后根据输入的声音再现语音发音。通过分析习得的声音发音与存储在机器人中的生成的声音之间的关系，对听障人士发出的不清晰的声音进行分类，然后提取特定的特征，这些特征与机器人再现的声音发音相关联。将机器人应用于听障人群的语音训练，训练结果验证了机器人交互式训练的有效性。

In this study, a vocalization training system for the auditory-impaired was constructed by applying a talking robot, which has mechanical organs like a human. With an adaptive learning strategy using an auditory feedback control, the robot autonomously learned the human vocalizations, and then reproduced the speech articulations from inputted vocal sounds. By analyzing the acquired relations between vocal articulations and the generated vocal sounds stored in the robot, unclear vocal sounds given by auditory-impaired people were classified, and then particular features were extracted, which were associated with vocal articulations reproduced by the robot. The robot was employed in the speech training for auditory-impaired, and the training results verified the effectiveness of the interactive training employing the robot.