Fundamentals Studies about Recognition Mechanism Analysis for a Description Method of Sign language as Interaction Language

本研究的目的是科学地阐明非手动信号的语言功能和手语交流的识别功能的机制。本研究通过一段时间的研究，取得了以下主要成果：1.在再认机制分析中，分析了基于事件相关电位N400测量的意义加工过程。在分析支持系统中，我们一直在构建视频图像和运动捕捉数据的同步输入和分析系统，包括手和头相对于磁源的位置和方位。同时，我们一直在用手套式传感器测量手的形状。作为使用此…的结果更多的S系统在实际分析中，解决了依赖视觉检测的各种问题。3.在描述方法上，增强了手语层次语素NVGS模型的非手指信号的描述功能。4.在会话模型分析中，定义了手语会话延迟的检测下限。采用双刺激损伤评分法对延迟效应进行评估。结果表明，交替计数的最大似然比为100毫秒，“求和数”的最大似然比为200毫秒。在手语动态图像的低码率数字编码中，根据手语的上述特点，提出了一种适合手语的低码率数字编码方法。结果表明，与现有的编码方法相比，使用本文提出的方法在低码率下对图像数据进行编码的可能性更大，基本达到了上述研究目的和实施方案。此外，研究成果还发表在《IEICE杂志与会刊》、《人机界面学会会刊》、《国际电子工程师学会杂志》、《国际会议》等期刊上，我觉得有必要开展这方面的研究。在此研究成果的基础上，笔者继续从认知科学的角度对手语进行会话分析。较少

A purpose of this research is scientifically clarify the mechanism of a linguistic function of a non-manual signals and a recognition function for communication of sign language. I got the following main result by this research through a research period.1.In analysis of mechanism of the recognition, I have analyzed a meaning processing process based on a event-related potential N400 measurement. As a result, because it is understood that N400 is observed in semantic congruity sentence by sign language and the character, and the potential is large in the character stimulation, and was shown the difference of the processing process by the presentation modality.2.In analysis support system, we have been constructing synchronous input and analysis system for video image and motion-captured data such as location and orientation of the hands and head in relation of the magnetic source. Simultaneously, we have been measuring hands configuration by gloved type sensors. As a result of using thi … More s system in actual analysis, it has solved the various kinds of problems that depended on visual inspection.3.In description method, it strengthened a description function of a non-finger signal of a hierarchical morpheme NVGS model of sign language.4.In analysis of conversation model, it was defining the lower limit of detection (LLD) of delay in sign conversation. Evaluation of the effect of delay was carried out by double stimulus impairment scale method (DSIS). The results showed that LLD of alternate counting was 100 msec, and LLD of "summing numbers" was 200 msec. Ceneralizing the results obtained so far, it is concluded that dialogue by sign language in more tolerant than speech dialogue.5.In low-bit rate digital encoding of moving picture of sign language, a new encoding method suitable for sign language is presented based on above mentioned characteristics of sign language. As a result, an encoding image data using our proposed method is more possible at a low bit rate in comparison with an existing method.This research purpose and the execution plan were almost achieved as above. In addition, results of research are presented in Journal and Transaction of IEICE, Journal and Transactions of Human Interface Society, Journal of IEE, International Conference, etc.I feel necessity to develop this research. On the basis of result of this research, I continue analysis work from the side of cognitive science through conversation analysis of sign language. Less