权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Construction of a Production System of CG Sign Language Images for Intelligent Communication and a Transmission Experiment of Animated Sign Language Images using a Communications Satellite

智能通信CG手语图像制作系统构建及通信卫星动画手语图像传输实验

基本信息

批准号：
06452237
负责人：
AOKI Yoshinao
金额：
$ 2.82万
依托单位：
HOKKAIDO UNIVERSITY
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
1994
资助国家：
日本
起止时间：
1994 至 1996
项目状态：
已结题

项目摘要

The purpose of this research is to develop a transmission technique of sign language image based on a method of an intelligent communication and to conduct a transmission experiment to verify the validity of the proposed technique. The intelligent communication is performed in the three steps ; 1) an intelligent coding of the image data to be transmitted based on the analysis of the image, 2) transmission of the coded text or parameter data, 3) original images reconstruction by an intelligent decoding of the received data using CG technique. In the research on the step 1), analysis of the gestures of sign language and the correspondence of the gesture images with words of sign language were conducted. A three-dimensional CG model of hands and arms constructed with polyhedrons was introduced and a matching technique between two-dimensional image of this 3-d model projected onto the two-dimensional plane and the silhouette image extracted from the real motion video images of the sign lan … More guage was examined for analyzing the sign language gesture. A concept of an information space of the meaning was introduced and a technique to correspond sign language image with their meanings was developed. We prepared the communication system using a communications satellite to conduct the research of the step 2) and an experiment of transmitting pictures and motion images was conducted. A TV conference system by Internet was achieved and an experiment on evaluation of understanding the transmitted moving images of sign language by the hearing impaired persons was conducted. In order to develop an efficient system for transmitting data between two computer systems through a communications satellite, a client-server system was constructed and a transmission experiment was conducted, which resulted in acquisition of fundamental data for developing such a client-server system for transmiting sign language images in near future. A new CG technique was developed to create sign language images for the step 3). For example a texture mapping technique was developed to achieve high-speed creation of CG sign language images. A three-dimensional modeling of hands and arms using CG-generated polyhedra was also examined and good results were obtained. A method of network model was proposed to generate natural motion of fingers and hand in producing animation of sign language. Although new knowledge was obtained in the investigations of each step of 1) -3), an experimental research of intelligent communication unifying image recognition, CG technique, and satellite communication was left as a future study. Less

本研究的目的是发展一种基于智能通信方法的手语图像传输技术，并进行传输实验，以验证所提出的技术的有效性。智能通信在三个步骤中执行：1）基于图像的分析对要传输的图像数据进行智能编码，2）传输编码文本或参数数据，3）通过使用CG技术对接收到的数据进行智能解码来重建原始图像。在步骤1）的研究中，对手语的手势进行了分析，并对手势图像与手语单词的对应关系进行了分析。介绍了一种用多面体构造的手和手臂的三维CG模型，并将该三维模型投影到二维平面上的二维图像与从标志牌的真实的运动视频图像中提取的轮廓图像进行了匹配 ...更多信息检查用于分析手语手势的语言。提出了意义信息空间的概念，并提出了一种将手语图像与其意义相对应的技术。为了进行步骤2）的研究，我们准备了使用通信卫星的通信系统，并进行了传输图片和运动图像的实验。实现了一个基于Internet的电视会议系统，并进行了听障者对手语运动图像的理解评价实验。为了开发一个通过通信卫星在两个计算机系统之间传输数据的有效系统，建造了一个客户-服务器系统，并进行了传输实验，从而为在不久的将来开发这种传输手语图像的客户-服务器系统获得了基本数据。开发了一种新的CG技术来创建步骤3）的手语图像。例如，开发了纹理映射技术以实现CG手语图像的高速创建。利用CG生成的多面体进行了手和手臂的三维建模，并取得了良好的效果。针对手语动画制作中手指和手的自然运动，提出了一种网络模型生成方法。虽然在1）-3）的每个步骤的研究中获得了新的知识，但将图像识别、CG技术和卫星通信相结合的智能通信的实验研究作为未来的研究留下。少