Creating music videos using automatic media analysis
Creating music videos using automatic media analysis
复制标题
DOI：
10.1145/641007.641119
复制
发表时间：
2002-12
期刊：
影响因子：
--
通讯作者：
J. Foote;Matthew L. Cooper;Andreas Girgensohn
中科院分区：
文献类型：
--
作者：
J. Foote;Matthew L. Cooper;Andreas Girgensohn
我们提出了自动和半自动创建音乐视频的方法，给定任意音频配乐和源视频。显著的音频变化自动检测；同样，源视频自动分割和分析的适用性基于相机的运动和曝光。镜头过度运动或对比度差的视频会被处以高不合适分数，并且更有可能在最终编辑中被丢弃。然后自动选择高质量的视频剪辑，并及时与显著的音频变化对齐。通过选择所需长度的最合适区域来调整视频剪辑以匹配音频片段。除了完全自动化的解决方案外，我们的系统还可以使用图形界面手动选择和订购剪辑。然后通过截断选定的片段（保留高质量的部分）来创建视频，以产生与原声音乐同步的视频摘要，从而增强两者的影响。
We present methods for automatic and semi-automatic creation of music videos, given an arbitrary audio soundtrack and source video. Significant audio changes are automatically detected; similarly, the source video is automatically segmented and analyzed for suitability based on camera motion and exposure. Video with excessive camera motion or poor contrast is penalized with a high unsuitability score, and is more likely to be discarded in the final edit. High quality video clips are then automatically selected and aligned in time with significant audio changes. Video clips are adjusted to match the audio segments by selecting the most suitable region of the desired length. Besides a fully automated solution, our system can also start with clips manually selected and ordered using a graphical interface. The video is then created by truncating the selected clips (preserving the high quality portions) to produce a video digest that is synchronized with the soundtrack music, thus enhancing the impact of both.