SphericRTC: A System for Content-Adaptive Real-Time 360-Degree Video Communication
SphericRTC: A System for Content-Adaptive Real-Time 360-Degree Video Communication
复制标题
DOI：
10.1145/3394171.3413999
复制
发表时间：
2020-10
期刊：
影响因子：
--
通讯作者：
Shuoqian Wang;Xiaoyang Zhang;Mengbai Xiao;K. Chiu;Yao Liu
中科院分区：
文献类型：
--
作者：
Shuoqian Wang;Xiaoyang Zhang;Mengbai Xiao;K. Chiu;Yao Liu
提出了一种适用于360度实时视频通信的SphericRTC系统。360度视频允许观看者从摄像机位置从任何方向观察环境。这种更身临其境的流媒体体验使用户能够更高效地交换信息，在实时设置中可能会有所裨益。我们的系统应用了一种新的方法来选择360度帧的表示形式，以实现高效的、内容自适应的交付。该系统通过CUDA将昂贵的转换操作卸载到GPU，从而实时执行联合内容和码率适配。该系统展示了多个子组件--视点反馈、表示选择、以及联合内容和比特率适配--可以有效地集成在单个框架内。与基线实现相比，SphericRTC中的视图具有始终如一的更高视觉质量。这类视点的中位数视点-PSNR比基线系统中的视点高2.25分贝。
We present the SphericRTC system for real-time 360-degree video communication. 360-degree video allows the viewer to observe the environment in any direction from the camera location. This more-immersive streaming experience allows users to more-efficiently exchange information and can be beneficial in the real-time setting. Our system applies a novel approach to select representations of 360-degree frames to allow efficient, content-adaptive delivery. The system performs joint content and bitrate adaptation in real-time by offloading expensive transformation operations to the GPU via CUDA. The system demonstrates that the multiple sub-components -- viewport feedback, representation selection, and joint content and bitrate adaptation -- can be effectively integrated within a single framework. Compared to a baseline implementation, views in SphericRTC have consistently higher visual quality. The median Viewport-PSNR of such views is 2.25 dB higher than views in the baseline system.