Ultrahigh-Speed TV Commercial Detection, Extraction, and Matching
Ultrahigh-Speed TV Commercial Detection, Extraction, and Matching
复制标题
DOI：
10.1109/tcsvt.2013.2248991
复制
发表时间：
2013-06
影响因子：
8.4
通讯作者：
Xiaomeng Wu;S. Satoh
中科院分区：
文献类型：
--
作者：
Xiaomeng Wu;S. Satoh
我们描述了一个系统的基础上精确重复匹配检测和本地化的视频流中的电视广告，聚类的精确重复，并检测重复的精确重复集群跨视频流。一个两阶段的时间递归哈希算法用于检测，定位和聚类。该算法是完全无监督的，通用的，和超高速的。另一种算法用于整合视频和音频流，以实现更高性能的提取。其序列级和帧级准确率分别为98.1%和97.4%。第三种算法使用新的指纹袋模型来检测多个流中的重复精确重复集群。它对解码错误是鲁棒的。其贡献包括：1）完全无监督的检测、提取和匹配精确的重复; 2）比基于知识的技术更通用的商业广告检测; 3）超高速处理，其在不到42分钟的时间内从一个月的视频流中检测出电视广告，这比最先进的算法快十倍以上;以及4）在信号输入方面更通用的操作，其性能在视频和音频流之间是一致的。使用包含十小时、一个月和五年视频流的视频数据库进行测试，全面验证了该系统的有效性和效率。
We describe a system based on exact-duplicate matching for detecting and localizing TV commercials in a video stream, clustering the exact duplicates, and detecting duplicate exact-duplicate clusters across video streams. A two-stage temporal recurrence hashing algorithm is used for the detection, localization, and clustering. The algorithm is fully unsupervised, generic, and ultrahigh speed. Another algorithm is used to integrate the video and audio streams to achieve higher performance extraction. Its sequence- and frame-level accuracies in testing were respectively 98.1% and 97.4%. A third algorithm uses a new bag-of-fingerprints model to detect duplicate exact-duplicate clusters across multiple streams. It is robust against decoding errors. Its contributions include: 1) fully unsupervised detection, extraction, and matching of exact duplicates; 2) more generic commercial detection than with the knowledge-based techniques; 3) ultrahigh-speed processing, which detected the TV commercials from a one-month video stream in less than 42 minutes, which is more than ten times faster than with state-of-the-art algorithms; and 4) more generic operation in terms of signal input, the performance of which is consistent between video and audio streams. Testing using a video database containing a ten-hour, a one-month, and a five-year video stream comprehensively demonstrates the effectiveness and efficiency of this system.