Reserarch on Multimedia Mediation Mechanism for Relization of Human-oriented Information Environments

在本研究项目中，在（1）包括数字广播在内的流型环境、（2）包括ITS在内的现实世界型环境、（3）包括WWW在内的网络型环境这三种有前景的多媒体环境中，取得了以下有助于新的信息服务和系统的主要成果。（1）-1。对于流类型的多媒体信息，已经提出了一个新的框架，自动视频识别/利用，和强大的视频识别系统的基础上，新的多模态处理。（1）-2。调解功能，如视频检索、数据协作、创作等，并且已经开发了几个具有实际广播节目的新颖应用系统。（1）-3。已经提出并实现了适合于视频和大数据处理的高性能计算机体系结构。（2）-1。作为现实世界类型视频数据的事件发现的主要功能，交通事故和其他事件的自动识别系统已在“神田-surugashita十字路口”的实际测试现场成功开发。（2）-2。针对真实世界物体的精确几何形状和发光分布的新数据恢复方法已被提出并应用于室外文化资产，如镰仓大佛。（2）-3。城市建筑物识别方法和包括ITS在内的其他实际应用系统已经开发。（3）-1。对于网络型多媒体环境，已经开发了针对WWW数据空间的高效搜索引擎和数据挖掘方法。（3）-2。开发了因特网空间的图像和音频检索系统及其他新的应用，上述成果已通过1 120篇技术论文和90篇大众媒体文章等发表。

In this research project, following major results contributing to new information services and systems have been obtained in three promising multimedia environments ; (1) Stream-type environments including digital broadcasting, (2) Realworld-type environments including ITS and, (3) Network type environments including WWW.(1)-1. For stream-type multimedia information, a new framework of automated video recognition/utilization, and powerful video recognition systems based on novel multimodal processing have been proposed.(1)-2. Mediation functions such as video retrieval, data collaboration, authoring etc., and several novel application systems with actual broadcasting programs have been developed.(1)-3. High performance computer architectures suitable for video and huge data processing have been proposed and implemented.(2)-1. As a primary function for event discovery for Realworld-type video data, an automated recognition system of traffic accidents and other events has been successfully developed in actual test site of " Kanda-surugashita crossing".(2)-2. New data restore methods for precise geometry and luminescence distribution of Realworld objects have been proposed and applied to outdoor cultural assets such as the Kamakura Great Buddha.(2)-3. Urban building identification methods and other realworld application systems including ITS have been developed.(3)-1. For network-type multimedia environments, efficient search engines and data mining methods for WWW data space have been developed.(3)-2. Image and audio retrieval systems in Internet space and other novel applications have been developed.Above results have been published by 1,120 technical papers and 90 mass-media articles etc.