Reserarch on Multimedia Mediation Mechanism for Relization of Human-oriented Information Environments

在这项研究项目中，在三个有前景的多媒体环境中获得了以下主要结果：(1)包括数字广播的流型环境，(2)包括ITS的真实世界型环境，(3)包括WWW的网络型环境。对于流类型的多媒体信息，提出了一种新的视频自动识别/利用框架，以及基于新的多模式处理的强大的视频识别系统。开发了视频检索、数据协作、创作等中介功能，以及几个具有实际播出节目的新型应用系统。提出并实现了适用于视频和海量数据处理的高性能计算机体系结构。作为Realworld类型视频数据事件发现的主要功能，在神田-Surugashita道口的实际测试现场成功地开发了交通事故等事件的自动识别系统。针对真实世界物体的精确几何形状和发光分布，提出了新的数据恢复方法，并将其应用于户外文化资产，如镰仓大佛。开发了城市建筑物识别方法和包括ITS在内的其他现实应用系统。(3)-1.针对网络型多媒体环境，针对WWW数据空间开发了高效的搜索引擎和数据挖掘方法。互联网空间的图像和音频检索系统以及其他新的应用已经被开发出来，已经发表了1120篇技术论文和90篇大众媒体文章等。

In this research project, following major results contributing to new information services and systems have been obtained in three promising multimedia environments ; (1) Stream-type environments including digital broadcasting, (2) Realworld-type environments including ITS and, (3) Network type environments including WWW.(1)-1. For stream-type multimedia information, a new framework of automated video recognition/utilization, and powerful video recognition systems based on novel multimodal processing have been proposed.(1)-2. Mediation functions such as video retrieval, data collaboration, authoring etc., and several novel application systems with actual broadcasting programs have been developed.(1)-3. High performance computer architectures suitable for video and huge data processing have been proposed and implemented.(2)-1. As a primary function for event discovery for Realworld-type video data, an automated recognition system of traffic accidents and other events has been successfully developed in actual test site of " Kanda-surugashita crossing".(2)-2. New data restore methods for precise geometry and luminescence distribution of Realworld objects have been proposed and applied to outdoor cultural assets such as the Kamakura Great Buddha.(2)-3. Urban building identification methods and other realworld application systems including ITS have been developed.(3)-1. For network-type multimedia environments, efficient search engines and data mining methods for WWW data space have been developed.(3)-2. Image and audio retrieval systems in Internet space and other novel applications have been developed.Above results have been published by 1,120 technical papers and 90 mass-media articles etc.