Semantic-Aware Virtual Reality Video Streaming
Semantic-Aware Virtual Reality Video Streaming
复制标题
语义感知虚拟现实视频流
DOI：
10.1145/3265723.3265738
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
Yuhao Zhu
中科院分区：
文献类型：
--
作者：
Yue Leng;Chi;Qiuyue Sun;Jian Huang;Yuhao Zhu
虚拟现实(VR)技术具有巨大的潜力，可以实现全新的应用，其中球面全景(又名360°)视频流即将达到临界值。目前的VR系统将360°VR内容视为普通RGB像素，类似于传统的平面帧，导致数据传输和客户端处理的巨大浪费。在本文中，我们认为新一代VR平台可以利用VR内容固有的语义信息来提高流媒体和处理效率。为此，我们提出了SVR，这是一个语义感知的VR系统，它利用VR帧中的对象信息来进行内容索引和流媒体。SVR利用了一个关键的观察结果，即终端用户的观看行为往往是面向对象的。SVR不是串流整个帧，而是提供仅覆盖VR视频中跟踪的可视对象的微帧。我们用实际的硬件板实现了SVR原型，并证明了它可以减少高达34%的网络带宽，同时节省21%的设备功耗。
Virtual reality (VR) technologies have huge potential to enable radically new applications, among which spherical panoramic (a.k.a., 360°) video streaming is on the verge of hitting the critical mass. Current VR systems treat 360° VR content as plain RGB pixels, similar to conventional planar frames, resulting in significant waste in data transfer and client-side processing. In this paper, we make the case that next-generation VR platforms can take advantage of semantics information inherent to VR content so as to improve the streaming and processing efficiency. To that end, we present SVR, a semantic-aware VR system that utilizes the object information in VR frames for content indexing and streaming. SVR exploits the key observation that end-users' viewing behaviors tend to be object-oriented. Instead of streaming entire frames, SVR delivers miniature frames that cover only the tracked visual objects in VR videos. We implement SVR prototype with a real hardware board and demonstrate that it achieves up to 34% network bandwidth reduction along with 21% device power saving.