A Study on Construction of Japanese Sign Language Electronic Dictionary using 3D Animation

本研究目的是建立一个综合考虑手语识别、动画自动生成的电子词典系统。本研究通过研究周期，对手语识别部分、语音分析部分、发音生成部分、图像库部分在构建三维动画电子词典系统中的各个功能进行了考察。1.在识别部分，提出了利用单目摄像机模型对HMM模型、手形识别进行无约束的全局发音识别技术；2.在语言分析部分，提出了NVGS模型，使超段音素的语素和记号成为可能；提出了音标符号用于手语的发音描述。3.在发音生成部分，我提出了由发音符号进行完全合成的规则方法，并使非人工信号的表示成为可能。我能够在…上使用它在图像数据库部分，我记录了电子词典的图像数据库KOSIGN Ver.2，它包含了大约1100个词汇。这个数据库考虑到我将其用于教育，它是从左对角线正面和正面用两个相机模型构建的一男一女的数据。并将各部分的功能进行整合，在多媒体环境下通过交互3D动画构建了手语电子词典系统的原型，取得了较好的效果，基本达到了本研究和执法调度的目的。并于1998年1月18日星期日与NHK电视台News7关于动画自动生成的结果进行了介绍。并针对去年的调度，对本研究提供的整个调度结果进行了汇报。进一步总结本研究的成果是设备的工作状态。通过对手语的形态分析，获取与数据处理设备进行多通道接口的要素技术。从本研究成果出发，对其进行了研究，并继续感到发展的重要性。较少

It is that purpose of this research builds the electronic dictionary system which considered recognition of sign language, automatic generation of animation. In this research, I examined it in each function of sign language recognition part, speech analysis part, articulation generation part, image database part on construction of electronic dictionary system by 3D animation through research period.1.In recognition part, I proposed technique of no restriction by grobal articulation recognition by using monocular camera model for HMM model, hand configuration recognition.2.In linguistic analysis part, I proposed NVGS model that made a morpheme and notation of suprasegmental phoneme possible.And I proposed phonetic sign notation for articulation description of sign language.3.In articulation generation part, I proposed complete synthesis by rule method from articulation notation symbol proposed and made representation of a non-manual signal possible. I was able to have been to utilize it … More on Internet furthermore.4.I recorded image database KOSIGN Ver.2 for the electronic dictionary which consisted for about 1,100 vocabulary in image database part. This database considered that I used it in education, and it was constructed data of a man and a woman with two camera model from the left diagonal front and from the front. And this integrated function of each part and built prototype of sign language electronic dictionary system by interactive 3D animation in multi-media environment.A good result was provided as above, and purpose of this research and enforcement scheduling were almost achieved. And this were introduced with NEWS7 of NHK television on animation automatic generation among result on Sunday, January 18,1998. And, for the scheduling last year, I made report of result provided from this research scheduling whole. It is equipment working state to summarize result of this research in an article furthermore.Toward acquisition of factor technique of multimodal interface with data processing equipment by analyzing modality of sign language from this research result, I researched it, and continuation felt importance to let develop. Less