DanceDJ: A 3D Dance Animation Authoring System for Live Performance
DanceDJ: A 3D Dance Animation Authoring System for Live Performance
复制标题
DanceDJ：用于现场表演的 3D 舞蹈动画创作系统
DOI：
10.1007/978-3-319-76270-8_46
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
Shigeo Morishima(* equally contributed)
中科院分区：
文献类型：
--
作者：
Naoya Iwamoto*;Takuya Kato*;Hubert P. H. Shum;Ryo Kakitsuka;Kenta Hara;Shigeo Morishima(* equally contributed)
舞蹈是现场表演的重要组成部分，具有情感表达和视觉语境呈现的功能。人类舞蹈表演通常需要舞蹈编排和专业排练的专业知识，这对于休闲娱乐场所和俱乐部来说成本太高。角色动画和运动合成的最新进展使得实时合成虚拟3D舞蹈角色成为可能。现有系统的主要问题是缺乏直观的界面来控制实时舞蹈控制的动画。我们提出了一个新的系统称为舞蹈DJ来解决这个问题。我们的系统由两部分组成。第一部分是一个基本的运动分析系统，它评估运动特征，包括舞蹈特征，如姿势和运动克里思，以及音频特征，如音乐克里思和结构。作为一个预处理，给定一个舞蹈动作数据库，我们的系统评估可能的时间连接和切换不同的舞蹈动作的质量。在运行时，我们提出了一个控制界面，提供视觉指导。我们观察到，磁盘骑师（DJ）使用DJ控制器有效地控制音乐的混合，因此提出了一个DJ控制器控制跳舞的字符。这允许DJ使用类似的硬件设置将他们的技能从音乐控制转移到舞蹈控制。我们将不同的动作控制功能映射到DJ控制器上，并将自然连接点的时序可视化，以便DJ可以有效地管理合成的舞蹈动作。我们进行了两个用户实验来评估用户体验和舞蹈角色的质量。定量分析表明，我们的系统表现良好的运动控制和仿真质量。
Dance is an important component of live performance for expressing emotion and presenting visual context. Human dance performances typically require expert knowledge of dance choreography and professional rehearsal, which are too costly for casual entertainment venues and clubs. Recent advancements in character animation and motion synthesis have made it possible to synthesize virtual 3D dance characters in real-time. The major problem in existing systems is a lack of an intuitive interfaces to control the animation for real-time dance controls. We propose a new system called theDanceDJto solve this problem. Our system consists of two parts. The first part is an underlying motion analysis system that evaluates motion features including dance features such as the postures and movement tempo, as well as audio features such as the music tempo and structure. As a pre-process, given a dancing motion database, our system evaluates the quality of possible timings to connect and switch different dancing motions. During run-time, we propose a control interface that provides visual guidance. We observe that disk jockeys (DJs) effectively control the mixing of music using the DJ controller, and therefore propose a DJ controller for controlling dancing characters. This allows DJs to transfer their skills from music control to dance control using a similar hardware setup. We map different motion control functions onto the DJ controller, and visualize the timing of natural connection points, such that the DJ can effectively govern the synthesized dance motion. We conducted two user experiments to evaluate the user experience and the quality of the dance character. Quantitative analysis shows that our system performs well in both motion control and simulation quality.