On clustering and retrieval of video shots through temporal slices analysis
On clustering and retrieval of video shots through temporal slices analysis
复制标题
DOI：
10.1109/tmm.2002.802022
复制
发表时间：
2002-12
期刊：
影响因子：
--
通讯作者：
C. Ngo;T. Pong;HongJiang Zhang
中科院分区：
文献类型：
--
作者：
C. Ngo;T. Pong;HongJiang Zhang
基于时间切片的分析，我们提出了视频镜头聚类和检索的新方法。时间切片是沿着图像体积的时间维度提取的一组二维 (2-D) 图像。它们对丰富的视觉模式进行编码以进行相似性度量。在本文中，我们首先证明从时间切片中提取的张量直方图特征适用于运动检索。随后，我们整合张量直方图和颜色直方图来构建两级层次聚类结构。顶层的每个簇都包含具有相似颜色的镜头，而底层的每个簇都包含具有相似运动的镜头。然后将构建的结构用于基于聚类的检索。发现所提出的方法对于体育比赛特别有用，在体育比赛中，在搜索和浏览所需的视频镜头时，运动和颜色是重要的视觉线索。
Based on the analysis of temporal slices, we propose novel approaches for clustering and retrieval of video shots. Temporal slices are a set of two-dimensional (2-D) images extracted along the time dimension of an image volume. They encode rich set of visual patterns for similarity measure. In this paper, we first demonstrate that tensor histogram features extracted from temporal slices are suitable for motion retrieval. Subsequently, we integrate both tensor and color histograms for constructing a two-level hierarchical clustering structure. Each cluster in the top level contains shots with similar color while each cluster in bottom level consists of shots with similar motion. The constructed structure is then used for the cluster-based retrieval. The proposed approaches are found to be useful particularly for sports games, where motion and color are important visual cues when searching and browsing the desired video shots.