EVASR: Edge-Based Video Delivery with Salience-Aware Super-Resolution

EVASR: Edge-Based Video Delivery with Salience-Aware Super-Resolution
复制标题

EVASR:具有显着性感知超分辨率的基于边缘的视频传输

DOI:
10.1145/3587819.3590967
复制
发表时间:
2023
期刊:
Proceedings of the 14th Conference on ACM Multimedia Systems
影响因子:
--
通讯作者:
Liu, Yao
Liu, Yao
中科院分区:
--
文献类型:
--
作者:
Li, Na;Liu, Yao

文献摘要

参考文献

相似文献

随着视频内容消费的快速增长,如何在有限的可用网络带宽下为用户提供高质量的流媒体视频显得尤为重要。在本文中,我们提出了EVASR系统,该系统可以向具有显著性感知的超分辨率客户端执行基于边缘的视频传输。我们选择显著性分数较高的patch进行超分辨率处理,同时对同一视频帧中的剩余patch进行简单而高效的双三次插值。为了有效地利用边缘服务器上可用的计算资源,我们引入了一个名为“显著性视觉质量”的新度量,并将补丁选择作为优化问题制定,以便在边缘服务器为多个用户服务时实现最佳性能。我们实现了基于FFmpeg框架的EVASR,并进行了大量的实验来评估。结果表明,EVASR在资源效率和视觉质量指标(包括PSNR、显著性视觉质量(SVQ)和VMAF)方面都优于基线方法。
With the rapid growth of video content consumption, it is important to deliver high-quality streaming videos to users even under limited available network bandwidth. In this paper, we propose EVASR, a system that performs edge-based video delivery to clients with salience-aware super-resolution. We select patches with higher saliency score to perform super-resolution while applying the simple yet efficient bicubic interpolation for the remaining patches in the same video frame. To efficiently use the computation resources available at the edge server, we introduce a new metric called "saliency visual quality" and formulate patch selection as an optimization problem to achieve the best performance when an edge server is serving multiple users. We implement EVASR based on the FFmpeg framework and conduct extensive experiments for evaluation. Results show that EVASR outperforms baseline approaches in both resource efficiency and visual quality metrics including PSNR, saliency visual quality (SVQ), and VMAF.
DOI: 10.1145/3474085.3475673
发表时间: 2021-10
期刊: Proceedings of the 29th ACM International Conference on Multimedia
影响因子: --
作者:
Lingdong Wang;M. Hajiesmaili;R. Sitaraman
通讯作者: Lingdong Wang;M. Hajiesmaili;R. Sitaraman
FFmpegSR:实现实时 4K 超分辨率的通用框架
DOI: 10.1109/ism55400.2022.10068833
发表时间: 2022
期刊: 2022 IEEE International Symposium on Multimedia (ISM
影响因子: --
作者:
Li, Na;Liu, Yao
通讯作者: Liu, Yao