Content-based Retrieval System for Video Databases, Based on Event-Activity Model

点击翻译按钮获取中文摘要

Concerning the subject about the construction of video databases, we developed the event-activity model.The events are defined as the features of objects observed from the difference among frames and also the activities are composed as a sequence of continuously ordered events. Additionally, we implemented the prototyping system STRIKE for managing video databases, based on such a model. In many of the traditional approaches, the retrieval facilities are dependent on the indexes for scenes with several frames, and identify only the preset scenes. On the other hand, the indexes in our approach are assigned to individual characteristic frames as events and the retrieval facilities can select various scenes which match with a sequence of events adaptively. Namely, the retrieval facility looks upon the retrieval conditions as activities for patterns of a sequence of events, and a sequence of events to be consistent with the event pattern from video frames. The automaton which supports the retrieval facility basically transfers its own internal state to the acceptable state in accordance with the order of input events, and identifies scenes, corresponded by activities effectively.Our research subject was scheduled during 3 years until 2000, and contributed the following mechanism and functions for managing video databases :- scene retrieval through a sequence of events ;- content-based retrieval controlled by automaton mechanism ;- automatic indexing to video frames ;- user-oriented retrieval, based on semantic roles among events/objects ;- similar scene retrieval ;- automatic composition of digests for topic scenes ;- hyper-video for effective browsing.