Improvement Communicative Skills in English and Technological Development for Creation and Accumulation of Multimodal Contents for its Purpose

因此，研究是一项人文学科与信息技术相结合的工作，由英语语言学、跨文化交际、英语教育、教育系统、自然语言处理、图像处理和人机界面等领域的研究者共同推动。基于几个英语内容，我们创建了多模态内容与英语交际技能的知识注释。我们在信息技术方面也取得了以下三项进展：（1）自动提取有用的英语交流知识和信息的技术的发展，（2）从大量图像数据中自动提取和表示有用和必要部分的技术的发展，（3）开发了对英语交际有用的英语构式（特别是伪灵巧构式）的自动标注系统。不同研究领域的合作所产生的协同效应，使人们能够自动提取更深层次的英语知识和英语交际技能，并有效地生成有吸引力和富有成效的多模态内容。在未来的研究中，我们将扩大我们的自动标注系统的应用范围。我们也将追求的可能性检测的重要部分，从韵律的角度和添加韵律的知识和信息自动多模态内容，这将导致更有用的和有价值的多模态内容的发展。

Thus research is a collaborative work of humanities and information technology ; pushed forward by the researchers on English linguistics, cross-cultural communication, English education, education system, natural language processing, image processing and human interface. Based on several English contents, we have created multimodal contents with annotations of knowledge of communicative skills in English. We have also made three developments in information technology as follows : (1)the development of the technology of automatic extraction of useful communicative knowledge and information in English, (2)the development of the technology of automatic extraction and representation of useful and necessary portions from within enormous quantity of image data, (3)the development of the system of automatic annotation of explanations of English constructions (particularly, the pseudo-deft construction) useful for English communication. The synergy effects, produced by the collaboration of the different fields of research, have made it possible to draw automatically deeper aspects of English knowledge and skills of English communication and to generate attractive and fruitful multimodal contents efficiently and productively. In future research, we will broaden the range of application of our automatic annotation system. We will also pursue the possibility of detecting important portions from the viewpoint of prosody and adding prosodic knowledge and information to multimodal contents automatically, which will lead to the development of more useful and valuable multimodal contents.