Intelligent Media for Realizing Question-Answering with Appropriate Images and Videos

这个项目的目的是真正地实现一个基于视频媒体问题的智能互动媒体，并在基于视频的媒体上回答问题。经过三年的调查，我们获得了以下结果，我们展示了自动视频捕获和索引在我们的系统中有效地集成。在A.中处理的物体presentation and the manipulation done for the objects are effectively detected lay our multi-sensor system·We proposed a method for broadcasted contents such as cooking shows·We proposed a framework QUEVICO， which is a question-based v\composition scheme in which v\indexing and editing is designed from the viewpoint of "question find answer"， and in which multi-view videos can be effectively used。基于这个框架，系统检索了一个可靠的视频部分，即使是一套没有给予的印度的完整集合，我们提出了一个基于约束满足的视频编辑和汇总的新颖模型。在这个模型中，一个视频被认为是一个盒子的序列。视频片段，每个片段都有一个短长度，例如一秒钟后，编辑被定义为将合适的照片发送到每个盒子的问题。良好的编辑模式的各种变体可以产生，这样我们就可以通过改变规则和参数来控制获得的视频的特征。

The purpose of this project is to realize an intelligent interactive media that answers questions based on video-based media.. Through three year's investigation, we obtained the following results・We showed automated video capturing and indexing are efficiently integrated in our system. The objects handled in a. presentation and the manipulation done for the objects are effectively detected lay our multi-sensor system・We proposed a method for automatic video indexcing for broadcasted contents such as cooking shows・We proposed a framework QUEVICO, which is a question-based video composition scheme in which video indexing and editing is designed from the viewpoint of "question find answer", and in which multi-view videos can be effectively used. Based on this framework, the system retrieves a relevant video portion, even if a complete set of indices ire not given・We proposed a novel model for video editing and summarizing based on constraint-satisfaction. In this model, a video is considered as a sequence of boxes i.e., video segments, each of which has a short length, e.g., 1 second, and the editing is defined as the problem of assigning an appropriate shot to each box. A variety of good editing patterns can be generated, and that we can control the characteristics of obtained videos by changing the rules and parameters