Three-Dimensional Video Postproduction and Processing
Three-Dimensional Video Postproduction and Processing
复制标题
DOI：
10.1109/jproc.2010.2098350
复制
发表时间：
2011-01
影响因子：
20.6
通讯作者：
A. Smolic;P. Kauff;S. Knorr;A. Sorkine-Hornung;M. Kunter;Marcus Müller;Manuel Lang
中科院分区：
文献类型：
--
作者：
A. Smolic;P. Kauff;S. Knorr;A. Sorkine-Hornung;M. Kunter;Marcus Müller;Manuel Lang
本文概述了3D视频后期制作和处理的最新进展，并对仍然存在的挑战和机遇进行了展望。首先，概述了立体摄影的基本原理，为正确的3-D内容创建设定了规则。在此上下文中，通过视图合成来操纵给定立体对的深度组成被识别为关键功能。描述了适配和校正基本立体属性的基本算法，例如几何失真、颜色对齐和立体几何。然后，基于深度图像的绘制被解释为当今在3D内容创建中广泛应用的视图合成解决方案。最近对深度估计的改进已经提供了非常好的结果。然而，在大多数情况下，仍以交互工作流为主。基于翘曲的方法可能成为未来一些不依赖于密集和准确的深度估计的应用的替代方案。最后讨论了2D到3D的转换，这是在3D中重用现有遗留2D内容的一个重要的特殊领域。在这里，各种高级算法被组合在交互式工作流中。
This paper gives an overview of the state-of-the-art in 3-D video postproduction and processing as well as an outlook to remaining challenges and opportunities. First, fundamentals of stereography are outlined that set the rules for proper 3-D content creation. Manipulation of the depth composition of a given stereo pair via view synthesis is identified as the key functionality in this context. Basic algorithms are described to adapt and correct fundamental stereo properties such as geometric distortions, color alignment, and stereo geometry. Then, depth image-based rendering is explained as the widely applied solution for view synthesis in 3-D content creation today. Recent improvements of depth estimation already provide very good results. However, in most cases, still interactive workflows dominate. Warping-based methods may become an alternative for some applications in the future, which do not rely on dense and accurate depth estimation. Finally, 2-D to 3-D conversion is covered, which is an important special area for reuse of existing legacy 2-D content in 3-D. Here various advanced algorithms are combined in interactive workflows.