Video Coding Using Multihypothesis Motion Compensation in the Redundant Wavelet Domain

摘要0310864詹姆斯E. FowlerMississippi State U在视频编码中，多假设运动补偿（MHMC）形成由多个运动补偿假设预测组成的预测，以努力对抗运动估计过程中固有的不确定性。MHMC技术-例如选择空间上不同的预测的技术（例如，分数像素预测），以及利用时间分集的那些（例如，双向预测）-已经形成了现代视频编码器的组成部分。本研究探讨了一种新形式的MHMC-冗余小波多假设（RWMH）-它执行运动补偿域的过完备，或冗余，小波变换，以产生运动补偿的预测是不同的变换相位。变换的冗余产生了从不同视角观察运动的不同阶段，每个阶段贡献了关于运动的真实性质的其自己的假设，本研究的重点是将RWMH技术结合到现代视频编码系统中，以证明RWMH技术与其他先进的视频编码系统的功能互补。编码技术具体考虑的是将RWMH纳入传统的混合系统，包括运动补偿预测，变换和量化，即最先进的H.264参考模型。 此外，RMHW被部署到现代3D编码器采用运动补偿时间滤波（MCTF），努力提供完整的时间，分辨率和保真度的可伸缩性。在这两个系统中，RWMH具有的好处是，较低分辨率的信息预测具有更大数量的假设，对应于在低空间分辨率下估计运动固有的更大困难。这项工作的更广泛的影响来自于这样一个事实，即所有产生的源代码都作为一个大型图书馆的一部分提供给视频编码社区，并根据开源许可证。

ABSTRACT0310864James E. FowlerMississippi State UIn video coding, multihypothesis motion compensation (MHMC) forms a prediction composed of multiple motion-compensated hypothesis predictions in an effort to combat the uncertainty inherent in the motion-estimation process. MHMC techniques---such as those that choose predictions that are diverse spatially (e.g., fractional-pixel prediction), as well as those exploiting temporal diversity (e.g., bidirectional prediction)---have formed an integral part of modern video coders. This research investigates a new form of MHMC---redundant wavelet multihypothesis (RWMH)---which performs motion compensation in the domain of an overcomplete, or redundant, wavelet transform in order to produce motion-compensated predictions that are diverse in transform phase. The redundancy of the transform yields distinct phases that view motion from different perspectives with each phase contributing its own hypothesis as to the true nature of the motion, resulting in rate-distortion performance significantly superior to traditional single-phase systems.The present research focuses on the incorporation of RWMH into modern video-coding systems in order to demonstrate that the RWMH technique functions complementary to other advanced video-coding techniques. Specifically considered is the incorporation of RWMH into a traditional hybrid system consisting of motion-compensating prediction, transform, and quantization, namely the state-of-the-art H.264 reference model. Additionally, RMHW is deployed into modern 3D coders employing motion-compensated temporal filtering (MCTF) in an effort to provide full temporal, resolution, and fidelity scalability. In both systems, RWMH has the benefit that lower-resolution information is predicted with a greater number of hypotheses, corresponding to the greater difficulty inherent in estimating motion at low spatial resolution. Broader impacts of the work stem from the fact that all resulting source code is provided to the video-coding community as part of a large library under an open-source license.