The analysis of unclear vocal articulations of auditory-impaired and the construction of an interactive training system using a talking robot

听障者发声不清的分析及语音机器人交互训练系统的构建

• 批准号: 21500517
• 负责人: SAWADA Hideyuki
• 金额: $ 2.83万
• 依托单位: Kagawa University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2009
• 资助国家: 日本
• 起止时间: 2009 至 2011
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-21500517/
• 关键词: 発話ロボット; 発話訓練; 聴覚障がい者; 支援技術; 音声; 聴覚フィードバック; 自己組織化ニューラルネットワーク; 構音障害; 自己組織化NN; 聴覚障碍者; 構音障碍

In this study, a vocalization training system for the auditory-impaired was constructed by applying a talking robot, which has mechanical organs like a human. With an adaptive learning strategy using an auditory feedback control, the robot autonomously learned the human vocalizations, and then reproduced the speech articulations from inputted vocal sounds. By analyzing the acquired relations between vocal articulations and the generated vocal sounds stored in the robot, unclear vocal sounds given by auditory-impaired people were classified, and then particular features were extracted, which were associated with vocal articulations reproduced by the robot. The robot was employed in the speech training for auditory-impaired, and the training results verified the effectiveness of the interactive training employing the robot.

在本研究中，应用一个会说话的机器人构建了一个听障人士发声训练系统，该机器人具有像人类一样的机械器官。利用听觉反馈控制的自适应学习策略，机器人自主学习人类的发声，然后从输入的语音中复制语音发音。通过分析获得的语音清晰度与存储在机器人中的语音之间的关系，对听障人士发出的模糊语音进行分类，提取与机器人再现的语音清晰度相关联的特定特征。将该机器人应用于听障人士的语音训练，训练结果验证了使用该机器人进行交互训练的有效性。

项目成果

A Talking Robot and the Auditory Feedback Learning for Natural Vocalization

会说话的机器人和自然发声的听觉反馈学习

• 发表时间: 2010
• 作者: IEEE Best Award;Mitsuki Kitani;Tatsuya Hara;Hiroki Hanada and Hideyuki Sawada
• 通讯作者: Hiroki Hanada and Hideyuki Sawada

Dual-SOMの位相構造学習に基づく発話ロボットの自律的音声獲得

基于Dual-SOM相结构学习的说话机器人自主语音采集

• 发表时间: 2011
• 期刊: 日本機械学会論文集(C編)
• 作者: 木谷光来;他
• 通讯作者: 他

優秀発表賞:Estimation of Sound Source Direction using a Robotic Arm

优秀演讲奖：使用机械臂估计声源方向

• 发表时间: 2010
• 作者: Chika Udaka;et al.
• 通讯作者: et al.

A talking robot for the vocal communication by the mimicry of human voice

一种模仿人声进行声音交流的说话机器人

• 发表时间: 2010
• 作者: Best Paper Award;Mitsuki Kitani;Tatsuya Hara;Hiroki Hanada and Hideyuki Sawada
• 通讯作者: Hiroki Hanada and Hideyuki Sawada

Voice articulatory training with a talking robot for the auditory impaired

使用会说话的机器人为听觉障碍者进行语音发音训练

• 发表时间: 2011
• 期刊: International Journal on disability and human development
• 作者: Mitsuki Kitani;et al.
• 通讯作者: et al.