Development of a Dictionary System to Convert Japanese Sentences into CG Sign Language Animations for Aiding Hearing- and Speaking-Disabled Person

主要研究成果如下：（1）通过扩展Lisp和Forth的后代语言Lifo语言的功能，开发了一个手语CG动画演示实验系统，用于辅助听力和语言障碍者进行高速处理。通过手语CG动画的制作实例，验证了所开发系统的有效性。(2)为了简化手语手势的设计和易于保存的软件，我们使用MATLAB，最近有一个优秀的GUI功能，从而开发了一个字典系统的原型。(3)提出了一种基于Au（Action Units）的人脸情感表情生成方法，并通过改变表情进行了人脸表情的绘制实验，证明了二维简单人脸可以在一定程度上传递情感。(4)除了残疾人的使用之外，还提出了处于语言障碍的普通人之间的手语交流，并讨论了具有相似语言和文化体系的日本和韩国之间的非语言交流系统。(5)我们得到的知识，我们开发的系统可以应用到漫画聊天，预计在不久的将来广泛使用。(6)我们引入了“意义场”的新概念，通过对过去的表达的思考来表达手语。我们还从“化身”一词中引入了“化身语言”的概念。“化身”一词源于梵语，用来表达上帝的象征，并在互联网上使用。作为一种表达自我的技巧由于手语对听力和语言残疾人的语言有一个固定的概念，我们引入了化身语言，以表达我们研究中讨论的技术不仅适用于残疾人，也适用于普通人的事实。

The research results are listed as follows ;(1) We developed a trial system to display CG animations of sign language for aiding hearing- and speaking-disabled person with high-speed processing by extending the functions of Lifo language, which was developed as a descendent language of Lisp and Forth. We confirmed the validity of the developed system by producing examples of CG animation of sign language.(2) For simplicity of designing gesture of sign language and for easiness of keeping software, we use MATLAB which recently has an excellent GUI functions, resulting in development of a prototype of a dictionary system.(3) A method to generate emotional expression of a face is developed using AU (Action Units) and an experiment was done to draw a face by changing emotional expressions, resulting in proving the fact that emotion can be transmitted to fair extent by using two-dimensional simple faces.(4) Beside the use by disabled person, a sign language communication among ordinary person who are in the circumstances separated by the linguistic barrier, is proposed and a non-verbal communication system between Japan and Korea was discussed, where these two countries have the similar linguistic and cultural systems.(5) We obtained knowledge that our developed system can be applied to the comic chat which is expected widely used in near future.(6) We introduced a new concept of "field of meaning" in order to express sign language by considering the expression of past. We also introduced a concept of "avatar language" from the term "avatar" which originally came from Sanskrit to express the symbol of God, and is used in Internet. as a technique to express ourselves. Because sign language has a fixed idea of the language for the hearing-and speaking-disabled person, we introduced avatar language for expressing the fact that the technique discussed in our research is not only for disabled people but for ordinary person.