DEVELOPMENT OF THE SPEECH TRAINING SOFTWARE FOR HEARING IMPAIRED CHILDREN USING THE NETWORK ENVIRONMENT

我们（梅崎实验室）3年的研究成果如下。开发了集成了三种识别方法（DP匹配、隐马尔可夫模型、人工神经网络）的混合型识别系统。我们利用Open GL库开发了三维版本的发音训练软件，可以在游戏感中进行训练。一个智力训练元素被纳入这个软件。该软件的标题包括陷阱射击和陨石碰撞（射击游戏），烟花（幻想游戏）等。我们在互联网教育系统中增加了以下功能，1）记录训练结果的数据管理功能，2）将累积的训练结果通过互联网累积到服务器的通信功能，3）在服务器端积累的训练结果的基础上，利用报表功能指导后续的训练，开发了唇读阅读训练软件，该软件可与小型数据库相结合。在这个软件中，我们不需要复杂的规则设置。在该软件中，这是由语音合成库和Kohonen型神经网络产生的图像被使用。由此生成接近视频图像的合成图像。孩子们可以在家里单独训练唇读阅读。我们正在免费分发开发软件的光盘。目前，爱知县聋人学校等约60个关系组织已经使用了该系统。特别是，在千草和冈崎聋人学校的教师积极合作。

Our (Umezaki Lab) research result of 3 years is as follows.The recognition system of the hybrid type to have integrated three kinds of recognition methods (DP matching, hidden Markov model, artificial neural networks) was developed. With this, the recognition rate of the consonant improved so far more.We developed the utterance training software of the three dimensional version which can be trained in the game sense using the Open GL library. An intellectual training element is incorporated into this software. The title of the software includes the trapshooting and meteorite collision (shooting game), the firework (fantasy game) and so on.We added the following feature to the Internet education system, 1)the data management feature to record a training result, 2)the communication feature that the accumulated training result accumulates to the server through the internet, 3)the report feature to guide the following training based on the training result which, was accumulated by the server.We developed the lip reading training software which can be built with the small-scale database. In this software, we don' t need complicated rule setting. In this software, the image which was produced by the speech synthesis library and the Kohonen-type neural networks is used. The synthesized image which is near the video image is generated by this. The children can train lip reading alone at the house.We are distributing the CD-ROM of the developed software for free. At present, it is already used, in about 60 relation organizations such as the school for the deaf under Aichi Prefecture. Especially, the teachers at the Chikusa and Okazaki schools for the deaf cooperated aggressively.