Compressive sensing for image and video processing, coding and communication

点击翻译按钮获取中文摘要

Current image and video communications systems acquire the image or video in high resolution and subsequently compress the signal effectively discarding a large amount of data. This approach complicates the image sensor and the compression algorithm and requires large read-out bandwidths especially at high frame rates. The research proposed here focuses on a new approach where compression is carried out during signal acquisition; a paradigm known as compressive sensing (CS). During the course of the research we will design and fabricate CS-based image sensors and study the applications of CS to image and video processing and communication. There are numerous applications where CS could be helpful. Standard video capture systems require a complete set of samples at which point a compression algorithm may be applied. In some applications, it may be difficult, expensive or time consuming to obtain these raw samples. In other applications, such as multi-camera networks, implementing a compression algorithm may itself be a challenge. We argue that these burdens can be reduced by using compressive imaging where random measurements are collected independently and no additional compression is needed. In exchange, the challenge of implementing such a scheme comes in developing efficient sparsity-inducing representations and the corresponding algorithms for video recovery from random measurements. The proposed research will improve image and video acquisition and communication by developing new methods for CS-based distributed and multi-view video coding, CS-based detection/classification and design and fabrication of CS-based image sensors. CS promises to substantially increase the performance and capabilities of data acquisition, processing and fusion systems while lowering the cost and complexity of deployment. There are fascinating theoretical and practical research problems in the proposed research program with promising payoffs in improved image and video acquisition, processing and communications.