Development of virtual information space system for visualizing and editing mul-tidimensional structural information.

点击翻译按钮获取中文摘要

We proposed a system for visualizing and editing multimedia contents in a virtual 3D space. The system inputs multimedia contents and extracts their attributes. Then, it constructs a virtual space where the contents and their mutual relationship are visualized referring to their attributes. Visualized contents are edited according to user's demand by using human friendly interface such as hand gesture. Edited results are output after being restructured for presentation.We developed a prototype of the proposed system. TV news are used as multimedia contents since they are one of the typical examples. Broadcasted TV news are stored and divided into segments. A still image that represents each segment well is selected as a representative image. Correlation between the segments is calculated for images, telops and voice. Telops and voice in the segments are transformed into text. Nouns are extracted from the text. By calculating the frequency of the extracted nouns, the segments of TV news are classified into six categories : politics, economy, social events, international affairs, sports and the others.We developed a man-machine interface based on hand gesture and the algorithm to recognize commands from three dimensional movement of a detected hand on the assumption that we use them for accessing the virtual three dimensional space. In this system, a continuous operation of the gesture is decomposed into individual operation units, and these units are classified into meaningful units or meaningless units. Then, the gesture is recognized by matching the unit with the model.