Methods and algorithms for multi-camera visual surveillance and monitoring

点击翻译按钮获取中文摘要

The objective of this research program is to devise new methods and algorithms for the development of intelligent surveillance systems. The research will focus on the necessary components required to build the next generation of video monitoring systems capable of extracting high-level information on occurring events and give users an easier access to the information collected by such systems. The emphasis will be on solutions that can be integrated to real-time surveillance systems. The solutions sought will perform object-based video analytics for the detection, the tracking and re-identification of specific objects in the scene and the recognition of their actions. More than the development of these individual modules, our research program aims at the seamless integration of these four vision components into real-time video surveillance and monitoring systems. In order to validate, apply and expand this research, our research will be performed in the context of an advanced surveillance system for tracking the behavior of customers in store and restaurants.***The remarkable advances in object detection methods make them good candidates for object extraction in videos. In the context of video monitoring, these ones can be designed to operate at a very low false positive rate even if this leads to an important miss rate. Working with videos allow us to recover objects that were missed in previous frames. Object position in-between detections can be obtained, when required, from a visual tracker. Longer term tracking, over multiple cameras, can be achieved through a re-identification module that can re-detect a previously observed moving object. Finally, the last essential ingredient for a complete understanding of a scene's dynamic is the detection of the actions undertaken by the actors of the scene. These four components represent the fundamental building blocks of an advanced video analytics system. ***We foresee that the proposed research program will lead to the development of new specialized video analytics systems. Based on our current collaborations, we specifically target applications in customer tracking, or more generally event detection and behaviour analysis in public places. Although most of this research has a focus on the interpretation of videos captured by fixed cameras, we intent to also consider the case of moving cameras such as action cameras and wearable cameras.**