"Advanced Keying, Compression and Watermarking of 3D Video Signals"

“3D 视频信号的高级键控、压缩和水印”

• 批准号: 227781-2012
• 负责人: Zhao, Jiying
• 金额: $ 1.6万
• 依托单位: University of Ottawa
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=570319
• 关键词: Advanced; Keying; Compression; Watermarking; 3D

3D TV programs are an irreversible trend for future TV broadcasting. Research on 3D video processing has become an extremely hot topic in recent years. We, as researchers in the field of video processing, must get ready and prepared for the immediate future of video processing. We should research and develop advanced algorithms to produce, process, store, and transmit 3D TV contents. In this project proposal, we will focus our research on keying, compression and watermarking of 3D video signals. The research results can be extended to multiview 3D video processing. Chroma keying is a technique for compositing two images or frames together in which background colors from one image is removed, revealing another image behind it. To the best of our knowledge, there is no keying algorithm that can process semi-transparency sufficiently well. Applying the technique to video signal is even harder since extracted mattes on sequential frames must be both spatially and temporally coherent. We will research and develop advanced real-time 2D/3D video keying algorithms by using depth information in addition to chroma, spatial and temporal information. Depth map generation is indispensable for 2D to 3D video conversion and 3D video representation using depth maps. We will research and develop advanced algorithms to generate depth map for 2D/3D video signals, and SSIM based quality evaluation algorithms for keying and depth map. We will use the new quality metric to guide the generation process of keying and depth map. The 3D video representation using depth maps (called 2D plus depth) will become more efficient, which represents the stereoscopic information using the monocular image and its associated depth information. We will research and develop advanced depth map compression algorithms for 3D video compression. The proposed research on 3D video keying, compression and watermarking will definitely benefit the video industry of Canada.

3D电视节目是未来电视广播不可逆转的趋势。3D视频处理的研究是近年来的一个非常热门的课题。作为视频处理领域的研究人员，我们必须为视频处理的未来做好准备。我们应该研究和开发先进的算法来生产，处理，存储和传输3D电视内容。在本计画中，我们将针对三维视讯讯号之键控、压缩与浮水印技术进行研究。研究成果可推广到多视点三维视频处理中。 色度键控是一种将两幅图像或帧合成在一起的技术，其中一幅图像的背景颜色被去除，露出它后面的另一幅图像。据我们所知，没有一种键控算法可以足够好地处理半透明。将该技术应用于视频信号甚至更难，因为在连续帧上提取的蒙版必须在空间和时间上都是相干的。我们将研究和开发先进的实时2D/3D视频键控算法，通过使用深度信息，除了色度，空间和时间信息。 深度图生成对于2D到3D视频转换和使用深度图的3D视频表示是必不可少的。我们将研究和开发先进的算法来生成2D/3D视频信号的深度图，以及基于SSIM的键控和深度图质量评估算法。我们将使用新的质量指标来指导键控和深度图的生成过程。使用深度图（称为2D加深度）的3D视频表示将变得更有效，其使用单目图像及其相关联的深度信息来表示立体信息。我们将研究和开发先进的深度图压缩算法，用于3D视频压缩。 3D视频键控、压缩和水印的研究将使加拿大的视频产业受益。