Development of an advanced hypermedia system with capability of realtime linking to broadcasted video data

开发具有实时链接广播视频数据能力的先进超媒体系统

• 批准号: 07558034
• 负责人: SAKAUCHI Masao
• 金额: $ 6.98万
• 依托单位: The University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 1995
• 资助国家: 日本
• 起止时间: 1995 至 1996
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-07558034/
• 关键词: multimedia; database; hypermedia; digital broadcasting; video recognition; リアルタイムリンク; マルチメディアプラットホーム; 放送映像自動認識; 映像シーン記述言語

The objective of this research project is to develop a new type of hypermedia system with capability of advanced realtime linking to broadcasted video data.Major results of the project are as follows.(1) The Live Hypermedia System, which can acquire a desired set of video scenes from live television broadcasting programs using automated video scene recognition techniq, ues has been originally developed. In the system, information nodes and links are dynamically determined corresponding to the structure of the recognition model. The recognition models itself are expressed by the flexible compounds of state-transition rules and scene feature descriptions.This Live Hyper-media System is implemented on our original platiorm GOLS.In order to demonstrate the effectiveness, experimental evaluations of the Recall rate and Precision rate (video scence pick-up performance) for TV broadcasting programs have been done successfully.(2) To realize more flexible and user-oriented access and utilization of video data, more advanced methods of making high data models have been developed. Basic idea is to realize logical synchronization between related video, sound and document data.Higher-level recognition, retrieval and date authorization are successfully developed based on this idea. Experimented results reveal the effectiveness of there methods.

本研究计划的目的是开发一种新型的超媒体系统，具有先进的实时连接到广播视频数据的能力。(1)人们最初开发了一种能够利用自动视频场景识别技术从电视直播节目中获取所需视频场景集的实时超媒体系统。在该系统中，信息节点和链接对应于识别模型的结构被动态地确定。识别模型本身由状态转换规则和场景特征描述的灵活组合来表示.该实时超媒体系统在我们的原始平台戈尔斯上实现.为了证明该系统的有效性，对电视广播节目的查全率和查准率（视频场景拾取性能）进行了成功的实验评估。(2)为了实现更灵活的、面向用户的视频数据访问和利用，人们开发了更先进的高层数据模型的方法。其基本思想是实现相关的视频、声音和文档数据之间的逻辑同步，并基于此思想成功地实现了更高层次的识别、检索和数据授权。实验结果表明了这三种方法的有效性。

项目成果

Takashi Satou・Masao Sakauchi: "A Software Multimedia Platform with Real-time Video Manipulation Capability" International Jaornal on Real-time Imaging. 2. 153-162 (1996)

Takashi Satou・Masao Sakauchi：“具有实时视频操作能力的软件多媒体平台”国际实时成像杂志。2. 153-162 (1996)

Yoshitomo Yaginuma,Masao Sakauchi: "Construction of Intelligent TV Drama Database based on the Synchronization between Image, Sound and Script" Pacific Workshop on Distributed Multimedia Systems. 125-132 (1996)

Yoshitomo Yaginuma、Masao Sakauchi：“基于图像、声音和脚本之间同步的智能电视剧数据库的构建”太平洋分布式多媒体系统研讨会。

Takashi Satou, Masao Sakauchi: "A Software Multimedia Platform with Real-time Video Manipulation Capability" International Journal on Real-time Imaging, Academic Press. Vol. 2. 153-162 (1996)

Takashi Satou、Masao Sakauchi：“具有实时视频操作能力的软件多媒体平台”国际实时成像杂志，学术出版社。

Yoshitomo Yaginuma, Masao Sakauchi: "Content-based Drama Editing based on Inter-media Synchronization" Internation Conference on Multimedia Computing and Systems. 322-329 (1996)

Yoshitomo Yaginuma、Masao Sakauchi：“基于跨媒体同步的基于内容的戏剧编辑”多媒体计算与系统国际会议。

Yoshitomo Yaginuma, Masao Sakauchi: "Content-based Retrieval and Decomposition of TV Drama Based on Intermedia Synchronization" Proceedings of the First International Conference on Visual Information Systems. 165-170 (1996)

Yoshitomo Yaginuma、Masao Sakauchi：“基于跨媒体同步的电视剧内容检索与分解”第一届视觉信息系统国际会议论文集。