RIA: Object-Oriented Motion Decomposition and Estimation with Application to Low-Bit-Rate Video Coding

RIA：面向对象的运动分解和估计及其在低比特率视频编码中的应用

• 批准号: 9211481
• 负责人: Yao Wang
• 金额: $ 10万
• 依托单位: Polytechnic University of New York
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 1992
• 资助国家: 美国
• 起止时间: 1992-07-01 至 1995-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9211481&HistoricalAwards=false
• 关键词: RIA; Object; Oriented; Motion; Decomposition

This project considers the estimation of motion in a time-varying image sequence, and its applications in video compression. The proposed approaches are based on a transform domain motion representation which describes the spatial displacement field of a moving object by a set of transform coefficients, each specifying the contribution of a basic motion to the apparent motion. The difficulty with using such an object-oriented motion representation for images containing multiple objects with mixed motions is countered by a joint motion estimation and object segmentation procedure in a multi-resolution quad-tree structure. The proposed project consists of two parts. The first part includes theoretic and algorithmic investigation on, 1) viable motion transform bases, 2) transform domain motion estimation, 3) hierarchical, joint motion estimation and object segmentation, and 4) motion compensated temporal interpolation. The second part encompasses the studies on low bit rate object oriented video coding using the techniques produced in the first part. Results from the first part will contribute to the theory of image sequence processing and analysis, and will provide new solutions to several key elements in video signal processing and three dimensional scene analysis and object tracking. The success of the second part, in particular, will suggest new alternatives to low bit rate video coding which is indispensable for video coding over narrow band channels and video database applications.

本课题研究时变图像序列的运动估计及其在视频压缩中的应用。所提出的方法是基于变换域运动表示，它通过一组变换系数来描述运动物体的空间位移场，每个变换系数指定基本运动对表观运动的贡献。在多分辨率四叉树结构的联合运动估计和目标分割过程中，克服了对包含混合运动的多个物体的图像使用这种面向对象运动表示的困难。拟建项目由两部分组成。第一部分包括理论和算法研究，1)可行的运动变换基，2)变换域运动估计，3)分层、联合运动估计和目标分割，4)运动补偿时间插值。第二部分包括使用第一部分中产生的技术对低比特率面向对象的视频编码的研究。第一部分的结果将有助于图像序列处理和分析的理论，并将为视频信号处理和三维场景分析和目标跟踪中的几个关键要素提供新的解决方案。特别是第二部分的成功将为窄带信道和视频数据库应用中不可缺少的低比特率视频编码提供新的替代方案。