Interactive multiview video system with low decoding complexity
Interactive multiview video system with low decoding complexity
复制标题
DOI：
10.1109/icip.2011.6116618
复制
发表时间：
2011-12
期刊：
影响因子：
--
通讯作者：
Thomas Maugey;P. Frossard
中科院分区：
文献类型：
--
作者：
Thomas Maugey;P. Frossard
多媒体研究始终致力于探索改善用户沉浸式体验的新方法。当前的一种解决方案在于设计提供高水平交互性的系统，例如多视图内容导航，其中在观看视频序列（例如，自由视点电视、游戏等）时可以改变视点。为传输此类媒体流而设计的编码算法必须适应这些新颖的解码器需求。然而，视频加深度数据传输通常通过将信息流视为用MVC方案编码的两个序列来执行。虽然它实现了良好的压缩性能，但这种编码方法不适合交互式应用，因为帧的解码通常需要预先传输和解码几个参考帧。此外，最近开发的用于提高交互性的技术通常在解码器处实现，其计算复杂性要求增加。在本文中，我们提出了一种适合用户导航的视频加深度序列的新颖编码方案；与几种常见方法相反，在编码器侧增加了额外的复杂性，以便解码器保持简单。我们进一步建议通过设计基于用户行为模型的速率分配算法来限制交互性要求所施加的额外带宽。我们的新颖编码架构的第一个版本是根据率失真性能进行评估的，结果表明它以合理的带宽成本提供了高交互性。
Research in multimedia is always investigating new ways of improving the immersive experience of the users. One current solution consists in designing systems which offer a high level of interactivity, such as multiview content navigation where the point of view can be changed while watching at a video sequence (e.g., free viewpoint television, gaming, etc.). The coding algorithm designed for the transmission of such media streams must be adapted to these novel decoder needs. However, video plus depth data transmission is usually performed by considering the information flows as two sequences encoded with MVC schemes. Whereas it achieves good compression performance, this coding approach is not appropriate for interactive applications since the decoding of a frame often requires the prior transmission and decoding of several reference frames. Moreover, the techniques recently developed to improve interactivity are generally implemented at the decoder, whose computational complexity requirements are augmented. In this paper, we propose a novel coding scheme for video plus depth sequences that is adapted to user navigation; contrarily to several common approaches, the additional complexity is added on the encoder side so that the decoder stays simple. We further propose to limit the additional bandwidth imposed by interactivity requirements by designing a rate allocation algorithm that builds on a model of the user behavior. A first version of our novel coding architecture is evaluated in terms of rate-distortion performance, where it is shown to offer a high interactivity at a reasonable bandwidth cost.