Intelligent Media for Realizing Question-Answering with Appropriate Images and Videos

智能媒体，通过合适的图片和视频实现问答

• 批准号: 13480087
• 负责人: NAKAMURA Yuichi
• 金额: $ 2.56万
• 依托单位: University of Tsukuba
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2001
• 资助国家: 日本
• 起止时间: 2001 至 2003
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-13480087/
• 关键词: multimedia; video-based media; interactive media; video processing; natural language processing; communication media; intelligent video capturing; automated editing

The purpose of this project is to realize an intelligent interactive media that answers questions based on video-based media.. Through three year's investigation, we obtained the following results・We showed automated video capturing and indexing are efficiently integrated in our system. The objects handled in a. presentation and the manipulation done for the objects are effectively detected lay our multi-sensor system・We proposed a method for automatic video indexcing for broadcasted contents such as cooking shows・We proposed a framework QUEVICO, which is a question-based video composition scheme in which video indexing and editing is designed from the viewpoint of "question find answer", and in which multi-view videos can be effectively used. Based on this framework, the system retrieves a relevant video portion, even if a complete set of indices ire not given・We proposed a novel model for video editing and summarizing based on constraint-satisfaction. In this model, a video is considered as a sequence of boxes i.e., video segments, each of which has a short length, e.g., 1 second, and the editing is defined as the problem of assigning an appropriate shot to each box. A variety of good editing patterns can be generated, and that we can control the characteristics of obtained videos by changing the rules and parameters

本项目的目的是实现一个智能交互媒体，回答基于视频的媒体的问题。通过三年的研究，我们得到了以下结果：我们表明，自动视频捕获和索引有效地集成在我们的系统。中处理的对象。我们提出了一种用于广播内容的自动视频索引的方法，例如烹饪节目。我们提出了一个框架QUEVICO，这是一个基于问题的视频合成方案，其中视频索引和编辑是从“问题找到答案”的角度设计的，并且可以有效地使用多视图视频。在此基础上，即使没有给出完整的索引集，系统也可以检索到相关的视频部分。我们提出了一种新的基于约束满足的视频编辑和摘要模型。在该模型中，视频被认为是一系列盒子，即，视频段，每个视频段具有短的长度，例如，1秒，编辑被定义为每个框分配适当镜头的问题。可以生成各种良好的编辑模式，并且可以通过改变规则和参数来控制所获得视频的特性

项目成果

尾関, 伊藤, 里, 中村, 大田: "複合コミュニティ空間における注目の共有"日本バーチャルリアリティ学会論文誌. 8・4. 369-377 (2003)

Ozeki、Ito、Sato、Nakamura、Ota：“在复杂的社区空间中共享注意力”日本虚拟现实学会杂志 8・4（2003 年）。

村山, 中村, 大田: "DocScape:文章の概覧性を高めるための概念図の生成と利用"情報処理学会論文誌. 44・4(掲載予定). (2003)

Murayama、Nakamura、Ota：“DocScape：生成和使用概念图来改进文本概述”，《日本信息处理学会汇刊》44-4（即将出版）。

尾関, 伊津野, 伊藤, 中村, 大田: "Object Tracking and Task Recognition for Producing Interactive Video Content---Semi-automatic indexing for QUEVICO"Proc. Int'l Conference on Knowledge-Based Intelligent Information & Engineering Systems. 1044-1053 (2003)

Ozeki、Itsuno、Ito、Nakamura、Ota：“用于生成交互式视频内容的对象跟踪和任务识别 ---QUEVICO 的半自动索引”Proc。基于知识的智能信息与工程系统国际会议 1044-1053。 (2003)

尾関, 中村, 大田: "Camerawork for Intelligent Video Production"Proc. Int. Conf. On Multimedia and Expo. 41-44 (2001)

Ozeki、Nakamura、Ota：“智能视频制作的摄影作品”国际会议 41-44 (2001)

H.Izuno, Y.Nakamura, Y.Ohta: "QUEVICO QA Model for Video-based Interactive Media"Proc.Third International Workshop on Content-Based Multimedia Indexing. 413-420 (2003)

H.Izuno、Y.Nakamura、Y.Ohta：“基于视频的交互式媒体的 QUEVICO QA 模型”Proc.第三届基于内容的多媒体索引国际研讨会。