Visual Perception in Ad Hoc Networks of Smart Cameras

点击翻译按钮获取中文摘要

I envision a future where imaging networks comprising stationary fixed cameras, hand-held camera-equipped mobile devices, and cameras mounted on autonomous platforms will collect and analyze large sums of imagery and video to support a variety of applications in areas such as infrastructure management, ecological monitoring, smart spaces for independent living, disaster readiness and response, transportation systems, personalized photo agents, etc. These networks will be an order of magnitude larger than the existing "multi-camera systems," and many scientific and technical challenges remain and much original research is needed to realize this vision. This proposal seeks funds to accelerate the development of the next generation of smart camera networks capable of unattended operation in support of urban sensing, smart environments, and scene analysis and modelling. Over the next five years, we aim to: 1) develop scientific theory for collaborative sensing in ad hoc networks of smart cameras; 2) develop theory and methods for summarizing videos captured by these networks; and 3) explore scientific and theoretical foundations for cross-view activity recognition. Work outlined in this proposal will lead to new scientific discoveries, mathematical theories, and tools for visual perception in smart camera networks. The work will also enable a myriad of smart camera networks applications. The proposal also provides exciting opportunities for unique interdisciplinary Highly Qualified Personnel (HQP) training. These HQPs will not only develop deep technical and scientific knowledge in the areas of computer vision, machine learning, camera networks, and system building, they will also learn interpersonal and oral and written communication skills. I expect that these HQPs will be in high demand in the current technology-focused job market. These HQPs will also have the opportunity to go into academia if that is where there interests lie. The outcomes of this program will directly benefit both local and international camera technology, video analytics, and digital entertainment industries, spurring economic growth. The work carried out under this proposal will adhere to the university guidelines around equity, diversity and inclusivity.