Super-Resolution Stereo- and Multi-View Synthesis from Monocular Video Sequences
Super-Resolution Stereo- and Multi-View Synthesis from Monocular Video Sequences
复制标题
单目视频序列的超分辨率立体和多视图合成
DOI：
10.1109/3dim.2007.54
复制
发表时间：
2007
期刊：
影响因子：
--
通讯作者：
T. Sikora
中科院分区：
文献类型：
--
作者：
S. Knorr;M. Kunter;T. Sikora
提出了一种由单眼视频生成超分辨率立体多视点视频的新方法。例如，这种多视角视频用于多用户3D显示器或带有头部跟踪的自动立体显示器，以创建观察到的景物的深度印象。我们的方法是现实立体视图合成（RSVS）方法的扩展，该方法基于运动技术的结构和基于图像的渲染，以在每个时间点生成所需的立体视图。该扩展依赖于额外的超分辨率模式，该模式利用原始视频序列的许多帧来生成具有更高分辨率的虚拟立体帧。该算法在几个电视广播视频上进行了测试，以及用单个手持摄像机捕获的序列和著名的BBC纪录片“行星地球”中的序列。最后，仿真结果表明，RSVS非常适合超分辨率2D-3D转换。
This paper presents a new approach for generation of super-resolution stereoscopic and multi-view video from monocular video. Such multi-view video is used for instance with multi-user 3D displays or auto-stereoscopic displays with head-tracking to create a depth impression of the observed scenery. Our approach is an extension of the realistic stereo view synthesis (RSVS) approach which is based on structure from motion techniques and image-based rendering to generate the desired stereoscopic views for each point in time. The extension relies on an additional super- resolution mode which utilizes a number of frames of the original video sequence to generate a virtual stereo frame with higher resolution. The algorithm is tested on several TV broadcast videos, as well as on sequences captured with a single handheld camera and sequences from the well known BBC documentation "Planet Earth". Finally, some simulation results will show that RSVS is quite suitable for super-resolution 2D-3D conversion.