A Study of Interactive Electronic Dictionary System Construction Based on Automatic Synthesis Function of Sign Language Articulators

本研究的目的在于建构一个支援多媒体的电子辞典系统。该电子词典的功能是自动生成动画图像。附有嘴形的动画图像的发音器满足组合结构。本研究以3D动画建构电子辞典系统，在研究期间，分别从手语会话语料库部分、语言分析部分、发音产生部分、影像资料库部分等各个功能进行检视.在手语会话语料部分，笔者考察了语料收集中提出的去除日语影响的方法。采用本文提出的数据采集方法，从KOSIGN Ver.2中选取994个手语词，对约3,800个手语会话语料进行了采集和录像。在此基础上，构建了手语对话视频图像分割分析的支持系统.该系统能够轻松设置 ...更多信息 在各种分析项目中的一个标签，在其页上具有框架单元。在语言分析部分，利用该分析支持系统对一个手语会话语料库进行了分析。分析的对象是手语的区别特征和语素的提取。根据分析结果提出了NVGS句子层面的语素描述模型.在动画图像生成部分，提出了从描述中生成动画图像的发音器官的方法。发音器采用NVGS语素模型和sIGNDEX对非手动信号进行语言构建。此外，本系统还具有15个基本口型函数的生成，提高了手语动画图像的识别精度.在电子词典部分，构建了一个交互式手语电子词典。本词典具有手语例句库检索功能和动画图像与口型生成功能。此外，本词典的总词汇量为1,142个符号词，基本达到了上述研究目的和实施计划。此外，本研究成果发表于Journal of IEICE、Transactions of Human Interface Society、International Conference等期刊上，其中的“嘴巴形状动画系统的建构”（HIS 2000）于2001年3月获得Human Interface Society科学鼓励奖。在此研究成果的基础上，笔者从认知科学的角度，通过手语的会话分析，继续进行分析工作。少

It is for a purpose of this research to construct an electronic dictionary system supporting multi-media. Function of this electronic dictionary is automatic generation of an animated image. An articulator of the animated image attached with mouth shape satisfies syntagmatic structure. In this research, I examined it in each function of sign language conversation corpus part, linguistic analysis part, articulation generation part, image database part on construction of electronic dictionary system by 3D animation through research period.1. In sign language conversation corpus part, I examined proposed in the corpus collection method which removed influence from Japanese. With the data collection method which I proposed, I chose 994 sign words from KOSIGN Ver.2 and had been collection and a video recording of about 3,800 sign language conversation corpus. Furthermore, I constructed support system to analyze segmentation of sign conversation video image. This system is able to easily set … More a tag in various analyses item with frame unit on its sheet.2. In language analysis part, I analyzed a sign language conversation corpus with this analysis support system. The analysis subject matter is extract of distinctive feature and a morpheme of sign language. I proposed of NVGS morpheme descriptive model of sentence level from an analysis result.3. In animated image generation part, I proposed in the method that generated an articulator of an animated image from description. The articulator described language construction by NVGS morpheme model with sIGNDEX for non-manual signals. Furthermore, this system has 15 basic mouth-shaped function to generate to improve recognition accuracy of a sign language animated image.4. In electronic dictionary part, I constructed an interactive sign language electronic dictionary. In this dictionary, there are sign language example sentences database retrieval function and an animated image with the mouth shape generated function. In addition, total vocabulary number of this dictionary is 1,142 sign words.This research purpose and the execution plan were almost achieved as above. In addition, results of research are presented in Journal of IEICE, Transactions of Human Interface Society, International Conference, etc. " Construction of the Mouth Shape Animation System" (HIS2000) of these result got the sciences encouragement prize from Human Interface Society in March 2001.I feel necessity to develop this research. On the basis of result of this research, I continue analysis work from the side of cognitive science through conversation analysis of sign language. Less