Information theory-based shot cut/fade detection and video summarization
Information theory-based shot cut/fade detection and video summarization
复制标题
DOI：
10.1109/tcsvt.2005.856896
复制
发表时间：
2006-01-01
影响因子：
8.4
通讯作者：
Nikou, C
中科院分区：
文献类型：
--
作者：
Cerneková, Z;Pitas, I;Nikou, C
提出了基于信息论的镜头边界检测和关键帧提取的新方法。镜头边界检测的方法依赖于帧间的互信息和联合熵。它可以检测剪切，淡入和淡出。该检测技术在TRECVID 2003视频测试集上进行了测试，该视频测试集具有不同类型的镜头，并包含镜头内的重要对象和相机运动。它表明，该方法检测褪色和突变削减具有高精度。信息论测量为我们提供了更好的结果，因为它以比帧减法更紧凑的方式利用帧间信息。它也成功地与文献中发表的其他方法进行了比较。的.用于关键帧提取的方法也使用MI。我们表明，它捕捉令人满意的视觉内容的镜头。
New methods for detecting shot boundaries in video sequences and for extracting key frames using metrics based on information theory are proposed. The method for shot boundary detection relies on the mutual information (MI) and the joint entropy (JE) between the frames. It can detect cuts, fade-ins and fade-outs. The detection technique was tested on the TRECVID2003 video test set having different types of shots and containing significant object and camera motion inside the shots. It is demonstrated that the method detects both fades and abrupt cuts with high accuracy. The information theory measure provides us with better results because it exploits the inter-frame information in a more compact way than frame subtraction. It was also successfully compared to other methods published in literature. The. method for key frame extraction uses MI as well. We show that it captures satisfactorily the visual content of the shot.