Interactive omnidirectional video delivery: A bandwidth-effective approach

Interactive omnidirectional video delivery: A bandwidth-effective approach
复制标题

DOI:
10.1002/bltj.20538
复制
发表时间:
2012-03
影响因子:
--
通讯作者:
Patrice Rondao-Alface;J. Macq;Nico Verzijp
Patrice Rondao-Alface;J. Macq;Nico Verzijp
中科院分区:
--
文献类型:
--
作者:
Patrice Rondao-Alface;J. Macq;Nico Verzijp

文献摘要

被引文献

相似文献

全向视频(圆柱形或球形)是一种越来越受欢迎的新媒体,因为它具有交互性,可以用于b谷歌街景等在线多媒体应用,也可以用于视频监控和机器人应用。在这种情况下,交互性意味着用户能够通过自由选择视点和观看方向来探索和导航视听场景。为了提供这个关键功能,全向视频通常被表示为一个经典的二维(2D)矩形全景视频,它被映射到一个(球形或圆柱形)网格上,然后在客户端屏幕上呈现。这种全全景视频和网格内容的早期传输模型简单地将全景作为高分辨率视频以统一质量进行编码。通常,用户只能查看内容的受限视图,然后与平移-倾斜-缩放命令交互。这意味着很大一部分带宽被浪费在传输没有可视化的区域的高质量视频上。在本文中,我们评估了个性化传输的相关性和最优性,其中质量在球形或圆柱形区域进行调制,这取决于它们在实时用户交互期间被观看的可能性。我们展示了基于交互延迟和带宽限制的平铺和预测方法如何改进现有方法。©2012阿尔卡特朗讯
Omnidirectional video (cylindrical or spherical) is a new media becoming more and more popular thanks to its interactivity for online multimedia applications such as Google Street View as well as for video surveillance and robotics applications. Interactivity in this context means that the user is able to explore and navigate audio-visual scenes by freely choosing viewpoint and viewing direction. In order to provide this key feature, omnidirectional video is typically represented as a classical two-dimensional (2D) rectangular panorama video that is mapped onto a (spherical or cylindrical) mesh and then rendered on the client's screen. Early transmission models of this full panorama video and mesh content simply deal with the panorama as a high-resolution video to be encoded at uniform quality. Generally the user can only view a restricted field-of-view of the content and then interact with pan-tilt-zoom commands. This means that a significant part of the bandwidth is wasted by transmitting quality video in regions that are not being visualized. In this paper we evaluate the relevance and optimality of a personalized transmission where quality is modulated in spherical or cylindrical regions depending on their likelihood to be viewed during a live user interaction. We show, based on interaction delay as well as bandwidth constraints, how tiling and predictive methods can improve on existing methods. © 2012 Alcatel-Lucent.