"Advanced Keying, Compression and Watermarking of 3D Video Signals"

“3D 视频信号的高级键控、压缩和水印”

• 批准号: 227781-2012
• 负责人: Zhao, Jiying
• 金额: $ 1.6万
• 依托单位: University of Ottawa
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=570319
• 关键词: Advanced; Keying; Compression; Watermarking; 3D

3D TV programs are an irreversible trend for future TV broadcasting. Research on 3D video processing has become an extremely hot topic in recent years. We, as researchers in the field of video processing, must get ready and prepared for the immediate future of video processing. We should research and develop advanced algorithms to produce, process, store, and transmit 3D TV contents. In this project proposal, we will focus our research on keying, compression and watermarking of 3D video signals. The research results can be extended to multiview 3D video processing. Chroma keying is a technique for compositing two images or frames together in which background colors from one image is removed, revealing another image behind it. To the best of our knowledge, there is no keying algorithm that can process semi-transparency sufficiently well. Applying the technique to video signal is even harder since extracted mattes on sequential frames must be both spatially and temporally coherent. We will research and develop advanced real-time 2D/3D video keying algorithms by using depth information in addition to chroma, spatial and temporal information. Depth map generation is indispensable for 2D to 3D video conversion and 3D video representation using depth maps. We will research and develop advanced algorithms to generate depth map for 2D/3D video signals, and SSIM based quality evaluation algorithms for keying and depth map. We will use the new quality metric to guide the generation process of keying and depth map. The 3D video representation using depth maps (called 2D plus depth) will become more efficient, which represents the stereoscopic information using the monocular image and its associated depth information. We will research and develop advanced depth map compression algorithms for 3D video compression. The proposed research on 3D video keying, compression and watermarking will definitely benefit the video industry of Canada.

3D电视节目是未来电视广播不可逆转的趋势。近年来，三维视频处理的研究已经成为一个非常热门的话题。我们作为视频处理领域的研究人员，必须为即将到来的视频处理做好准备。我们应该研究和开发先进的算法来制作、处理、存储和传输3D电视内容。在本项目方案中，我们将重点研究3D视频信号的键控、压缩和水印。该研究成果可推广到多视点三维视频处理领域。 色度键控是一种将两个图像或帧合成在一起的技术，其中一个图像的背景色被移除，显示在它后面的另一个图像。就我们所知，没有一种键控算法可以足够好地处理半透明。将该技术应用于视频信号更加困难，因为在连续帧上提取的遮片必须在空间和时间上都是相干的。我们将研究和开发先进的实时2D/3D视频键控算法，除了色度、空间和时间信息外，还将使用深度信息。 深度图生成对于2D到3D视频转换和使用深度图的3D视频表示是必不可少的。我们将研究和开发先进的2D/3D视频信号深度图生成算法，以及基于SSIM的键控和深度图质量评估算法。我们将使用新的质量度量来指导关键帧和深度图的生成过程。使用深度图(称为2D+深度)的3D视频表示将变得更加高效，其使用单目图像及其关联的深度信息来表示立体信息。我们将研究和开发适用于3D视频压缩的先进深度图压缩算法。 本文提出的3D视频键控、压缩和水印技术的研究，必将对加拿大的视频业产生积极的影响。