New Signal Processing Techniques for Next Generation Video Compression

下一代视频压缩的新信号处理技术

• 批准号: RGPIN-2019-05388
• 负责人: Yahampath, Pradeepa
• 金额: $ 2.04万
• 依托单位: University of Manitoba
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=715525
• 关键词: New; Signal; Processing; Techniques; Next

Video compression (VC) is one of the key technologies that enables streaming, downloading, and broadcasting of video content over wireless networks. The important purpose of VC is to minimize the amount of data required to capture the content, without compromising the visual quality. Given the sheer amounts of data associated with most video content, it is practically impossible to send high quality live video over even the fastest wireless link, without first applying very efficient compression to reduce the required network bandwidth. While the capacity of wireless networks will continue to grow, so will the raw bitrates of emerging applications such as 8K HD video, high dynamic range (HDR) and wide color gamut (WCG) video etc. Cisco Systems Inc. estimates that, by 2021, over 80% of the Internet traffic would be video. Many in the industry are of the opinion that substantial improvements in video compression efficiency can no longer be achieved without fundamental changes to the conventional motion compensated transform coding (MCTC) framework on which the current VC technology is built. This research program will investigate fundamentally new disruptive VC technologies which can help go beyond the performance limits of the MCTC. The proposed research departs from the established practice in two major ways with the potential to achieve order-of-magnitude improvements in video compression efficiency. First, it aims to forgo the conventional approach of putting together a series of processing operations in a heuristic manner to implement complex functions such as motion compensation (MC) and rate-distortion optimization (RDO). Instead, the focus will be on a holistic approach where such functions are "machine learned" from real video data. Recently, a number of difficult problems in computer vision have been solved with machine learning based on deep convolution neural-networks (DCNN). Given that video compression can also be viewed as a computer vision problem, this research will pursue the novel idea of using DCNNs for MC and RDO . The second major difference of proposed research is the use of bio-inspired vision models for performance optimization. Examples are retinal model for quantifying the distortion between original and coded video and models for information coding in human eye. These models can be used to heavily compress video data with a negligible effect on the quality as perceived by a human viewer. This is in contrast to the current practice of compressing video based on pixel-level differences which results in disturbing visible artifacts in compressed video. It is anticipated that this research will introduce novel frameworks for MC and RDO which can help develop new video compression algorithms achieving a very high bandwidth efficiency. Being mainly carried out by graduate students, this research will also play an important role in the training of highly qualified personnel (HQP) in communication engineering.

视频压缩（VC）是实现无线网络上视频内容的流媒体、下载和广播的关键技术之一。VC的重要目的是尽量减少捕获内容所需的数据量，同时不影响视觉质量。考虑到与大多数视频内容相关的大量数据，如果不首先应用非常有效的压缩来减少所需的网络带宽，即使是最快的无线链路，也几乎不可能发送高质量的实时视频。随着无线网络容量的不断增长，诸如8K高清视频、高动态范围（HDR）和宽色域（WCG）视频等新兴应用的原始比特率也将继续增长。思科系统公司（Cisco Systems Inc.）估计，到2021年，超过80%的互联网流量将是视频。许多业内人士认为，如果不从根本上改变当前VC技术所基于的传统运动补偿变换编码（MCTC）框架，就无法实现视频压缩效率的实质性提高。这项研究计划将从根本上研究新的颠覆性VC技术，这些技术可以帮助超越MCTC的性能限制。