Example-based video remixing
Example-based video remixing
复制标题
DOI：
10.1007/s11042-010-0633-9
复制
发表时间：
2010
影响因子：
3.6
通讯作者：
Naoko Nitta;N. Babaguchi
中科院分区：
文献类型：
--
作者：
Naoko Nitta;N. Babaguchi
视频混音通常是通过顺序安排选定的视频剪辑，并将它们与其他媒体流（如音频剪辑和过渡效果）混合而成的。特别是混合音乐剪辑往往能有效地提高视频剪辑的表现力。本文提出了一个基于实例的系统，用于支持普通用户在视频混音中的三个步骤：1)视频镜头序列的创建，2)音乐剪辑的选择，3)音频音量的调节。本发明的系统创建用于视频混音的模板，并根据专业创建的视频混音示例在界面上向用户提供建议，例如应选择哪些视频剪辑来创建视频镜头序列以及应将哪些音乐剪辑混合到所创建的视频镜头序列中。然后，每个视频镜头的音频音量根据其音频内容自动调整，使视频镜头中的声音和音乐片段不会相互干扰。实验证明，我们的系统能够创建一个视频镜头序列，通过混合选定的音乐片段，其质量得到了与专业制作的视频镜头序列相同的提高，在1-5的范围内，主观得分从1.7提高到3.7，翻了一番。自动音量调节使主观得分平均提高了约0.5分。此外，5名被试从265个视频片段和180个音乐片段中选择了32个视频片段和4个音乐片段，评价了界面上提供的建议在制作视频混音时的实用性。
Video remixes are generally created by sequentially arranging selected video clips and mixing them with other media streams such as audio clips and transition effects. Especially, mixing music clips often effectively improves the expressive quality of video clips. This paper proposes an example-based system for supporting average users in the 3 steps in video remixing: I)video shot sequence creation, II)music clip selection, and III)audio volume adjustment. The proposed system creates a template for a video remix and gives suggestions to users on an interface such as which video clips should be selected to create a video shot sequence and which music clips should be mixed to the created video shot sequence based on professionally created video remix examples. Then, the audio volume of each video shot is automatically adjusted based on its audio content so that the sounds in the video shots and the music clips would not interfere with each other. Experiments have verified that our system was able to create a video shot sequence whose quality was improved equally as the professionally created one by mixing the selected music clips, doubling the subjective scores from 1.7 to 3.7 on a scale of 1-5. Automatic audio volume adjustment improved the subjective scores by approximately 0.5 points on average. Further, the suggestions provided on the interface was evaluated useful by 5 subjects when creating a video remix by selecting 32 video clips and 4 music clips from 265 video clips and 180 music clips.