A proof-of-concept framework for PDE-based video compression
A proof-of-concept framework for PDE-based video compression
复制标题
DOI：
10.1109/pcs.2016.7906362
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
Sarah Andris;Pascal Peter;J. Weickert
中科院分区：
文献类型：
--
作者：
Sarah Andris;Pascal Peter;J. Weickert
在图像压缩中，依赖偏微分方程 (PDE) 插值的编解码器变得越来越流行。然而，将这一概念转移到视频压缩中的尝试并不多。由于实时性能对于基于偏微分方程的重建来说是一个挑战，因此第一个有效的方法是在逐帧的基础上工作，并专注于并行实现，而不考虑编码质量。到目前为止，还没有完全基于 PDE 的视频编解码器能够利用时间冗余。作为一种补救措施，我们提出了一种将基于 PDE 的压缩与运动补偿相结合的模块化框架：使用基于 PDE 的修复来预测帧内帧，并使用密集光流场来预测帧间帧。我们使用这个框架开发了一种概念验证编解码器，它将同质扩散修复与 Brox 等人的变分光流模型相结合。 （2004）。即使没有复杂的并行化，我们也能够在基于 PDE 的视频压缩中首次对彩色视频进行实时解压缩。
In image compression, codecs that rely on interpolation with partial differential equations (PDEs) are becoming increasingly popular. However, there have not been many attempts to transfer this concept to video compression. Since real-time performance is challenging for PDE-based reconstruction, first efficient approaches work on a frame-by-frame basis and focus on parallel implementations without considering coding quality. So far, there is no fully PDE-based video codec that exploits temporal redundancies. As a remedy, we propose a modular framework that combines PDE-based compression with motion compensation: Intra frames are predicted with PDE-based inpainting and inter frames with dense optic flow fields. We use this framework to develop a proof-of-concept codec that combines homogeneous diffusion inpainting with the variational optic flow model of Brox et al. (2004). Even without sophisticated parallelisation, we are able to perform real-time decompression of colour videos for the first time in PDE-based video compression.