Development of virtual information space system for visualizing and editing mul-tidimensional structural information.

我们提出了一个在虚拟三维空间中可视化和编辑多媒体内容的系统。系统输入多媒体内容并提取其属性。然后，构建一个虚拟空间，将内容及其相互关系根据其属性进行可视化。通过手势等人性化界面，根据用户需求编辑可视化内容。编辑后的结果将在重组后输出。我们开发了这个系统的原型。电视新闻作为一种典型的多媒体内容被广泛使用。广播电视新闻被储存起来并分成片段。选取一个能很好地代表每一段的静止图像作为代表图像。计算图像、图象和声音的片段之间的相关性。片段中的语言和声音被转换成文本。名词是从文中摘录出来的。通过计算提取名词的频率，将电视新闻片段分为政治、经济、社会事件、国际事务、体育和其他六类。我们开发了一个基于手势和算法的人机界面，以识别被检测手的三维运动的命令，假设我们使用它们来访问虚拟三维空间。该系统将手势的连续操作分解为单个操作单元，并将这些操作单元分为有意义单元和无意义单元。然后，通过将单元与模型匹配来识别手势。

We proposed a system for visualizing and editing multimedia contents in a virtual 3D space. The system inputs multimedia contents and extracts their attributes. Then, it constructs a virtual space where the contents and their mutual relationship are visualized referring to their attributes. Visualized contents are edited according to user's demand by using human friendly interface such as hand gesture. Edited results are output after being restructured for presentation.We developed a prototype of the proposed system. TV news are used as multimedia contents since they are one of the typical examples. Broadcasted TV news are stored and divided into segments. A still image that represents each segment well is selected as a representative image. Correlation between the segments is calculated for images, telops and voice. Telops and voice in the segments are transformed into text. Nouns are extracted from the text. By calculating the frequency of the extracted nouns, the segments of TV news are classified into six categories : politics, economy, social events, international affairs, sports and the others.We developed a man-machine interface based on hand gesture and the algorithm to recognize commands from three dimensional movement of a detected hand on the assumption that we use them for accessing the virtual three dimensional space. In this system, a continuous operation of the gesture is decomposed into individual operation units, and these units are classified into meaningful units or meaningless units. Then, the gesture is recognized by matching the unit with the model.