Intelligent Media for Realizing Question-Answering with Appropriate Images and Videos

点击翻译按钮获取中文摘要

The purpose of this project is to realize an intelligent interactive media that answers questions based on video-based media.. Through three year's investigation, we obtained the following results・We showed automated video capturing and indexing are efficiently integrated in our system. The objects handled in a. presentation and the manipulation done for the objects are effectively detected lay our multi-sensor system・We proposed a method for automatic video indexcing for broadcasted contents such as cooking shows・We proposed a framework QUEVICO, which is a question-based video composition scheme in which video indexing and editing is designed from the viewpoint of "question find answer", and in which multi-view videos can be effectively used. Based on this framework, the system retrieves a relevant video portion, even if a complete set of indices ire not given・We proposed a novel model for video editing and summarizing based on constraint-satisfaction. In this model, a video is considered as a sequence of boxes i.e., video segments, each of which has a short length, e.g., 1 second, and the editing is defined as the problem of assigning an appropriate shot to each box. A variety of good editing patterns can be generated, and that we can control the characteristics of obtained videos by changing the rules and parameters