Improvement of animated articulatory gesture extracted from speech for pronunciation training
Improvement of animated articulatory gesture extracted from speech for pronunciation training
复制标题
DOI：
10.1109/icassp.2012.6289076
复制
发表时间：
2012-03
期刊：
影响因子：
--
通讯作者：
Y. Iribe;Silasak Manosavanh;Kouichi Katsurada;R. Hayashi;Chunyue Zhu;T. Nitta
中科院分区：
文献类型：
--
作者：
Y. Iribe;Silasak Manosavanh;Kouichi Katsurada;R. Hayashi;Chunyue Zhu;T. Nitta
近年来，计算机辅助发音训练(CAPT)被引入到语言教育中。CAPT使用语音识别技术对学习者的发音质量进行评分，并指出错误的音素。然而，尽管学习者可以意识到他/她的语言与教师的不同，但学习者仍然无法控制发音器官正确发音。学习者无法理解如何准确纠正错误的发音手势。我们通过用CG动画可视化学习者错误的发音动作和正确的发音动作来表明这些差异。我们提出了一个通过从学习者的语音中自动估计其发音动作来生成动画发音的系统。所提出的系统通过使用多层感知器神经网络(MLP)将语音映射到生成动画所需的坐标值。我们使用核磁共振数据来生成流畅的动画发音。此外，我们还通过实验评估验证了声道面积和发音特征是否适合作为发音运动的特征。
Computer-assisted pronunciation training (CAPT) was introduced for language education in recent years. CAPT scores the learner's pronunciation quality and points out wrong phonemes by using speech recognition technology. However, although the learner can thus realize that his/her speech is different from the teacher's, the learner still cannot control the articulation organs to pronounce correctly. The learner cannot understand how to correct the wrong articulatory gestures precisely. We indicate these differences by visualizing a learner's wrong pronunciation movements and the correct pronunciation movements with CG animation. We propose a system for generating animated pronunciation by estimating a learner's pronunciation movements from his/her speech automatically. The proposed system maps speech to coordinate values that are needed to generate the animations by using multilayer perceptron neural networks (MLP). We use MRI data to generate smooth animated pronunciations. Additionally, we verify whether the vocal tract area and articulatory features are suitable as characteristics of pronunciation movement through experimental evaluation.