Research on 'Database Vision' based on media cooperative recognition and purposive utilization

基于媒体协同识别与有目的利用的“数据库视觉”研究

• 批准号: 03452163
• 负责人: SAKAUCHI Masao
• 金额: $ 4.35万
• 依托单位: University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for General Scientific Research (B)
• 财政年份: 1991
• 资助国家: 日本
• 起止时间: 1991 至 1992
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-03452163/
• 关键词: Image Processing; Multi-media Database; Database Vision; Media Fusion; Drama Analysis; Keyword Extraction; マルチメディア; メディア協調; デ-タベ-スビジョン; 状態遷移モデル

In this research project, a new approach to realize effective multi-media database systems, named 'Database Vision' framework, has been successfully proposed, where two new ideas of automatic image recognition based on media fusion and purposive and adaptive utilization of achieved data model, playa important role. The following concrete results have been obtained.(1) Proposal of the framework for database vision approach and purposive utilization: In this sub-project, a general purpose automatic image understanding method using 'state-transition' mechanism has been developed and implemented, which provides flexible image date models adaptively applicable to various purposes.(2) Development of an automatic drama movie understanding system based on media fusion: A concrete moving image understanding system using cooperative recognition of images, documents and voice, has been implemented to successfully realize difficult 'scene decomposition' and human identification for real TV drama movies.(3) Realization of purposive image databases: Two full-automatic image databases, one for sports scene still images and the other for TV scene moving images, have been realized and successfully evaluated by experiments.(4) A new-type of Image Sequence Analysis Method using color multiplextion has been invented and effectiveness has been revealed by experiments.

本课题成功提出了一种实现高效多媒体数据库系统的新方法——“数据库视觉”框架，其中基于媒体融合的自动图像识别和已有数据模型的有目的自适应利用两个新思路发挥了重要作用。得到了以下具体结果：(1)数据库视觉方法及目的利用框架的提出：本子项目开发并实现了一种基于“状态转换”机制的通用自动图像理解方法，该方法提供了灵活的图像数据模型，自适应适用于各种目的。(2)基于媒体融合的戏剧电影自动理解系统的开发：实现了一个具体的基于图像、文档和语音协同识别的运动图像理解系统，成功实现了对真实电视剧电影的难“场景分解”和人工识别。(3)目的性图像数据库的实现：实现了体育场景静态图像和电视场景运动图像两个全自动图像数据库，并通过实验进行了成功的评价。(4)提出了一种基于彩色复用的图像序列分析方法，并通过实验验证了该方法的有效性。

项目成果

Yoshitomo Yaginuma, Masao Sakauchi: "Human Extraction from the Drama Scene" Monthly Journal of Institute of Industrial Science, University of Tokyo. Vol.44. 26-28 (1992)

八木沼义智、坂内正雄：《从戏剧场景中提取人》东京大学产业科学研究所月刊。

Masao Sakauchi: "Perspective of Multi-media Database based on Image Understanding" Proceeding of International Workshop on Next Generation of Industrial Fuzzy Technology. 155-167 (1992)

Masao Sakauchi：“基于图像理解的多媒体数据库视角”下一代工业模糊技术国际研讨会论文集。

山根 淳,坂内 正夫: "キ-ワ-ド自動抽出を考慮した画像デ-タベ-ス" 情報処理学会コンピュ-タビジョン研究会資料. CD73ー1. (1991)

Jun Yamane，Masao Sakauchi：“考虑自动关键词提取的图像数据库”日本信息处理学会计算机视觉研究组材料 CD73-1。

Masao Sakauchi: "Image ans Multimedia Database" The Journal of the Institute of Television Engineers of Japan. Vol.46. 1474-1479 (1992)

Masao Sakauchi：“图像与多媒体数据库”日本电视工程师学会杂志。

柳沼 良知、坂内 正夫: "ドラマシーンからの人物の抽出" 生産研究. 44. 26-28 (1992)

Yoshichi Yaginuma、Masao Sakauchi：“戏剧场景中的人物提取”制作研究 44. 26-28 (1992)。