Robust color histogram descriptors for video segment retrieval and identification
Robust color histogram descriptors for video segment retrieval and identification
复制标题
DOI：
10.1109/tip.2002.1006397
复制
发表时间：
2002-05
期刊：
影响因子：
--
通讯作者：
A. Ferman;A. Tekalp;R. Mehrotra
中科院分区：
文献类型：
--
作者：
A. Ferman;A. Tekalp;R. Mehrotra
多个视频帧或图片的颜色特征的有效和高效的表示是视觉信息管理系统的重要而具有挑战性的任务。基于关键帧的方法来表示一组帧（GoF）的颜色特征高度依赖于代表帧的选择标准，并且可能导致不可靠的结果。我们提出了各种基于直方图的颜色描述符来可靠地捕获和表示多个图像或GoF的颜色属性。称为α-修剪平均直方图的一类这样的描述符使用特定的滤波操作来组合联合收割机单独的帧或图像直方图，以生成鲁棒的颜色直方图，其可以消除亮度/颜色变化、遮挡和编辑效应对颜色表示的不利影响。我们展示了用于视频片段检索应用的α修剪平均直方图的功效，并说明了它们如何始终优于基于关键帧的方法。我们引入的另一个颜色直方图描述符称为交叉直方图，反映了GoF中所有帧共有的给定颜色的像素数量。我们采用交叉直方图开发一个快速有效的算法来识别查询帧所属的视频段。建议的颜色直方图描述符已被纳入ISO标准MPEG-7经过广泛的评估实验。
Effective and efficient representation of color features of multiple video frames or pictures is an important yet challenging task for visual information management systems. Key frame-based methods to represent the color features of a group of frames (GoF) are highly dependent on the selection criterion of the representative frame(s), and may lead to unreliable results. We present various histogram-based color descriptors to reliably capture and represent the color properties of multiple images or a GoF. One family of such descriptors, called alpha-trimmed average histograms, combine individual frame or image histograms using a specific filtering operation to generate robust color histograms that can eliminate the adverse effects of brightness/color variations, occlusion, and edit effects on the color representation. We show the efficacy of the alpha-trimmed average histograms for video segment retrieval applications, and illustrate how they consistently outperform key frame-based methods. Another color histogram descriptor that we introduce, called the intersection histogram, reflects the number of pixels of a given color that is common to all the frames in the GoF. We employ the intersection histogram to develop a fast and efficient algorithm for identification of the video segment to which a query frame belongs. The proposed color histogram descriptors have been included in the ISO standard MPEG-7 after extensive evaluation experiments.