Development of a Pronunciation Practice CAI System Based on Lip Reading Techniques for Deaf Children Using Computer Graphics Animated Mouth Movement

利用计算机图形动画嘴部运动开发基于聋儿唇​​读技术的发音练习CAI系统

• 批准号: 20500860
• 负责人: ODA Mariko
• 金额: $ 2.33万
• 依托单位: Kurume Institute of Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2008
• 资助国家: 日本
• 起止时间: 2008 至 2010
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-20500860/
• 关键词: e-learning; CG; 口唇動作; Lip Reading; 聴覚障害児教育; e-ラーニング

We have developed the pronunciation practice CAI system called "Lip Readingあい" for deaf children. This system is based on bimodality of human speech and lip reading techniques. It enables a learner to practice pronunciation by looking at a model speaker's mouth movements, and allows him/her to compare them with his/her own mouth movements. A video camera connected to the computer simultaneously shows the mouth movements of the model speaker and those of the learner's own, so that the learner can compare mouth movements. This system also provides a study unit to practice pronunciation by looking at computer graphics animation of mouth movements of the model speaker. In order to evaluate the effectiveness of the CAI system by using CG animation, Japanese vowel and consonant sounds were read by a group of infants. Their mouth movements before and after practicing with the CAI system were videotaped and evaluated. The rate of correctly perceived mouth movements was greater after practicing with the system than that without practicing. The results show that correcting of mouth movements by using CG animation is effective for improvements of pronunciation.

我们开发了适合聋儿的发音练习计算机辅助教学系统--《唇读あい》。该系统基于人类语音和唇读技术的双峰性。它使学习者能够通过观察说话者的嘴部动作来练习发音，并允许他/她将这些动作与他/她自己的嘴部动作进行比较。与计算机相连的摄像机同时显示模型演讲者的嘴部动作和学习者自己的嘴部动作，以便学习者可以比较嘴部动作。该系统还提供了通过观看模型说话者嘴部运动的计算机图形动画来练习发音的学习单元。为了评价计算机辅助教学系统使用CG动画的效果，对一组婴儿进行了日语元音和辅音的朗读。对使用计算机辅助教学系统练习前后的口腔运动进行录像和评价。使用该系统练习后，正确感知口腔运动的比率比没有练习的要高。结果表明，利用CG动画纠正口部动作对提高发音效果是有效的。

项目成果

見真似発音練習システムにおける口唇動作の誤り指摘

指出模仿发音练习系统中嘴唇动作的错误

• 发表时间: 2009
• 期刊: 情報研報 No. 15, Vol. 2009 (2009年2月) NO. 15
• 作者: 小田まり子;他
• 通讯作者: 他