Improvement Communicative Skills in English and Technological Development for Creation and Accumulation of Multimodal Contents for its Purpose

点击翻译按钮获取中文摘要

Thus research is a collaborative work of humanities and information technology ; pushed forward by the researchers on English linguistics, cross-cultural communication, English education, education system, natural language processing, image processing and human interface. Based on several English contents, we have created multimodal contents with annotations of knowledge of communicative skills in English. We have also made three developments in information technology as follows : (1)the development of the technology of automatic extraction of useful communicative knowledge and information in English, (2)the development of the technology of automatic extraction and representation of useful and necessary portions from within enormous quantity of image data, (3)the development of the system of automatic annotation of explanations of English constructions (particularly, the pseudo-deft construction) useful for English communication. The synergy effects, produced by the collaboration of the different fields of research, have made it possible to draw automatically deeper aspects of English knowledge and skills of English communication and to generate attractive and fruitful multimodal contents efficiently and productively. In future research, we will broaden the range of application of our automatic annotation system. We will also pursue the possibility of detecting important portions from the viewpoint of prosody and adding prosodic knowledge and information to multimodal contents automatically, which will lead to the development of more useful and valuable multimodal contents.