Fundamentals Studies about Recognition Mechanism Analysis for a Description Method of Sign language as Interaction Language

本研究的目的之一是科学地阐明非手势语的语言功能和手语的交际识别功能的机制。本研究通过一个研究周期，取得了以下主要成果：1.在再认机制分析中，基于事件相关电位N400的测量，分析了意义加工过程。研究结果表明，由于N400在语义一致句中被手语和文字所观察到，并且在文字刺激中潜力较大，通过呈现方式显示出加工过程的差异。2.在分析支持系统中，我们一直在构建视频图像和运动的同步输入和分析系统，所捕获的数据，例如手和头相对于磁源的位置和方向。同时，我们已经测量了手套型传感器的手配置。由于使用此 关于我们 在描述方法上，加强了手语的层次语素NVGS模型对非手指信号的描述功能; 4.在会话模型分析上，定义了手语会话延迟的检测下限。采用双刺激损伤量表法（DSIS）评价延迟治疗的效果。结果表明，交替计数的LLD为100毫秒，“和数”的LLD为200毫秒。综合目前的研究结果，我们可以得出结论：手语对话比语音对话具有更好的容忍度。5.在手语运动图像的低比特率数字编码中，根据手语的上述特点，提出了一种新的适合手语的编码方法。结果，与现有方法相比，使用我们提出的方法编码图像数据在低比特率下是更可能的。此外，研究结果发表在IEICE杂志和交易，人机界面学会杂志和交易，IEE杂志，国际会议等，我觉得有必要开展这项研究。在此研究成果的基础上，笔者从认知科学的角度，通过手语的会话分析，继续进行分析工作。少

A purpose of this research is scientifically clarify the mechanism of a linguistic function of a non-manual signals and a recognition function for communication of sign language. I got the following main result by this research through a research period.1.In analysis of mechanism of the recognition, I have analyzed a meaning processing process based on a event-related potential N400 measurement. As a result, because it is understood that N400 is observed in semantic congruity sentence by sign language and the character, and the potential is large in the character stimulation, and was shown the difference of the processing process by the presentation modality.2.In analysis support system, we have been constructing synchronous input and analysis system for video image and motion-captured data such as location and orientation of the hands and head in relation of the magnetic source. Simultaneously, we have been measuring hands configuration by gloved type sensors. As a result of using thi … More s system in actual analysis, it has solved the various kinds of problems that depended on visual inspection.3.In description method, it strengthened a description function of a non-finger signal of a hierarchical morpheme NVGS model of sign language.4.In analysis of conversation model, it was defining the lower limit of detection (LLD) of delay in sign conversation. Evaluation of the effect of delay was carried out by double stimulus impairment scale method (DSIS). The results showed that LLD of alternate counting was 100 msec, and LLD of "summing numbers" was 200 msec. Ceneralizing the results obtained so far, it is concluded that dialogue by sign language in more tolerant than speech dialogue.5.In low-bit rate digital encoding of moving picture of sign language, a new encoding method suitable for sign language is presented based on above mentioned characteristics of sign language. As a result, an encoding image data using our proposed method is more possible at a low bit rate in comparison with an existing method.This research purpose and the execution plan were almost achieved as above. In addition, results of research are presented in Journal and Transaction of IEICE, Journal and Transactions of Human Interface Society, Journal of IEE, International Conference, etc.I feel necessity to develop this research. On the basis of result of this research, I continue analysis work from the side of cognitive science through conversation analysis of sign language. Less