Video summarization using textual descriptions for authoring video blogs
Video summarization using textual descriptions for authoring video blogs
复制标题
DOI：
10.1007/s11042-016-4061-3
复制
发表时间：
2017-05
影响因子：
3.6
通讯作者：
Mayu Otani;Yuta Nakashima;Tomokazu Sato;N. Yokoya
中科院分区：
文献类型：
--
作者：
Mayu Otani;Yuta Nakashima;Tomokazu Sato;N. Yokoya
创作视频博客需要视频编辑过程，这对普通用户来说很麻烦。视频摘要可以通过从原始视频中提取重要片段来自动执行此过程。由于博客作者通常会为他们的博客文章提供某些故事，因此博客文章的视频摘要应该考虑作者的意图。然而，大多数先前的作品解决视频摘要从原始视频挖掘模式，而不考虑博客作者的意图。为了生成一个视频摘要，反映了博客作者的意图，我们专注于支持文本的视频博客文章，并提出了一种基于文本的方法，其中支持文本作为一个之前的视频摘要。给定描述感兴趣场景的视频和文本，我们的方法将视频分段，并根据其与输入文本的相关性为每个视频片段分配摘要中的优先级。然后，我们的方法选择内容与输入文本相似的片段子集。因此，我们的方法根据输入文本从同一组视频中生成不同的视频摘要。我们在一项用户研究中评估了从博客浏览者和作者的角度生成的摘要。实验结果表明，所提出的基于文本的视频博客创作方法的优势。
Authoring video blogs requires a video editing process, which is cumbersome for ordinary users. Video summarization can automate this process by extracting important segments from original videos. Because bloggers typically have certain stories for their blog posts, video summaries of a blog post should take the author’s intentions into account. However, most prior works address video summarization by mining patterns from the original videos without considering the blog author’s intentions. To generate a video summary that reflects the blog author’s intention, we focus on supporting texts in video blog posts and present a text-based method, in which the supporting text serves as a prior to the video summary. Given video and text that describe scenes of interest, our method segments videos and assigns to each video segment its priority in the summary based on its relevance to the input text. Our method then selects a subset of segments with content that is similar to the input text. Accordingly, our method produces different video summaries from the same set of videos, depending on the input text. We evaluated summaries generated from both blog viewers’ and authors’ perspectives in a user study. Experimental results demonstrate the advantages to the proposed text-based method for video blog authoring.