Interframe Coding of Feature Descriptors for Mobile Augmented Reality
Interframe Coding of Feature Descriptors for Mobile Augmented Reality
复制标题
DOI：
10.1109/tip.2014.2331136
复制
发表时间：
2014-06
影响因子：
10.6
通讯作者：
Mina Makar;V. Chandrasekhar;Sam S. Tsai;David M. Chen;B. Girod
中科院分区：
文献类型：
--
作者：
Mina Makar;V. Chandrasekhar;Sam S. Tsai;David M. Chen;B. Girod
流传输移动的增强现实应用需要实时识别和跟踪视频序列中的感兴趣对象。通常，局部特征是根据各个视频帧中的关键点周围的规范补丁的梯度来计算的。在本文中，我们提出了一个时间相干的关键点检测器和设计有效的帧间预测编码技术的规范补丁，特征描述符和关键点位置。在所提出的系统中，我们努力传输每个补丁或其等效的特征描述符与尽可能少的位通过修改先前传输的补丁或描述符。我们的解决方案使基于服务器的移动的增强现实，连续流的显着信息，足够的基于图像的检索，和对象定位，发送的比特率是实用的今天的无线链路和不到十分之一的比特率需要流压缩视频到服务器。
Streaming mobile augmented reality applications require both real-time recognition and tracking of objects of interest in a video sequence. Typically, local features are calculated from the gradients of a canonical patch around a keypoint in individual video frames. In this paper, we propose a temporally coherent keypoint detector and design efficient interframe predictive coding techniques for canonical patches, feature descriptors, and keypoint locations. In the proposed system, we strive to transmit each patch or its equivalent feature descriptor with as few bits as possible by modifying a previously transmitted patch or descriptor. Our solution enables server-based mobile augmented reality where a continuous stream of salient information, sufficient for image-based retrieval, and object localization, is sent at a bit-rate that is practical for today's wireless links and less than one-tenth of the bit-rate needed to stream the compressed video to the server.