Development of a Dictionary System to Convert Japanese Sentences into CG Sign Language Animations for Aiding Hearing- and Speaking-Disabled Person

主要研究成果如下：(1)通过扩展LIFO语言的功能，开发了一个手语CG动画显示系统，以辅助听障和言语障碍者的高速处理。通过制作手语的CG动画实例，验证了所开发系统的有效性。(2)为了简化手语手势的设计和软件的维护，我们使用了最近推出的优秀的图形用户界面功能的MatLab，开发了一个词典系统的原型。(3)利用AU(Action Units)开发了一种生成人脸情感表情的方法，并通过改变表情来绘制人脸，从而证明了利用二维简单人脸可以在一定程度上传递情感。(4)除了适用于残疾人，提出了在语言障碍隔开的情况下，普通人之间的手语交流，并讨论了日韩两国之间的非语言交流系统，这两个国家有着相似的语言和文化系统。(5)了解到我们开发的系统可以应用于可望在不久的将来得到广泛应用的相声聊天。(6)为了表达手语，我们引入了意义场的新概念，通过考虑过去的表达来表达手语。我们还引入了“阿凡达”一词的概念，“阿凡达”最初来自梵语，用来表达上帝的象征，并被用于互联网。作为一种表达自我的技术。由于手语对聋哑人的语言有一个固定的概念，我们引入化身语言是为了表达我们研究中讨论的技术不仅适用于残疾人，也适用于普通人的事实。

The research results are listed as follows ;(1) We developed a trial system to display CG animations of sign language for aiding hearing- and speaking-disabled person with high-speed processing by extending the functions of Lifo language, which was developed as a descendent language of Lisp and Forth. We confirmed the validity of the developed system by producing examples of CG animation of sign language.(2) For simplicity of designing gesture of sign language and for easiness of keeping software, we use MATLAB which recently has an excellent GUI functions, resulting in development of a prototype of a dictionary system.(3) A method to generate emotional expression of a face is developed using AU (Action Units) and an experiment was done to draw a face by changing emotional expressions, resulting in proving the fact that emotion can be transmitted to fair extent by using two-dimensional simple faces.(4) Beside the use by disabled person, a sign language communication among ordinary person who are in the circumstances separated by the linguistic barrier, is proposed and a non-verbal communication system between Japan and Korea was discussed, where these two countries have the similar linguistic and cultural systems.(5) We obtained knowledge that our developed system can be applied to the comic chat which is expected widely used in near future.(6) We introduced a new concept of "field of meaning" in order to express sign language by considering the expression of past. We also introduced a concept of "avatar language" from the term "avatar" which originally came from Sanskrit to express the symbol of God, and is used in Internet. as a technique to express ourselves. Because sign language has a fixed idea of the language for the hearing-and speaking-disabled person, we introduced avatar language for expressing the fact that the technique discussed in our research is not only for disabled people but for ordinary person.