Human motion synthesis from 3D video
Human motion synthesis from 3D video
复制标题
DOI：
10.1109/cvpr.2009.5206626
复制
发表时间：
2009-06
期刊：
影响因子：
--
通讯作者：
Peng Huang;A. Hilton;J. Starck
中科院分区：
文献类型：
--
作者：
Peng Huang;A. Hilton;J. Starck
演员表演的多视角3D视频重建捕捉到了身体和服装运动的细节级别，这是使用现有动画工具制作的耗时的。本文提出了一种根据用户对运动、位置和时间的约束，从多个3D视频序列进行级联合成的框架。执行不同动作的演员的多个3D视频序列被自动构建到表面运动图中，该表面运动图表示没有不自然运动伪影的序列之间具有相似形状和运动的可能的过渡。使用自适应时间窗口上的形状相似性来识别3D视频序列之间的过渡。通过在表面运动图中寻找用户指定关键帧之间的最优路径来合成新的3D视频序列，以控制运动、位置和定时。使用整数线性规划找到满足用户约束的最优路径，同时最小化3D视频序列之间的总过渡成本。结果表明，该框架允许灵活地生成新颖的3D视频序列，对于衣着宽松、留着长发但没有明显伪影的女演员来说，这些视频序列保留了捕捉到的动作的详细动态。
Multiple view 3D video reconstruction of actor performance captures a level-of-detail for body and clothing movement which is time-consuming to produce using existing animation tools. In this paper we present a framework for concatenative synthesis from multiple 3D video sequences according to user constraints on movement, position and timing. Multiple 3D video sequences of an actor performing different movements are automatically constructed into a surface motion graph which represents the possible transitions with similar shape and motion between sequences without unnatural movement artifacts. Shape similarity over an adaptive temporal window is used to identify transitions between 3D video sequences. Novel 3D video sequences are synthesized by finding the optimal path in the surface motion graph between user specified key-frames for control of movement, location and timing. The optimal path which satisfies the user constraints whilst minimizing the total transition cost between 3D video sequences is found using integer linear programming. Results demonstrate that this framework allows flexible production of novel 3D video sequences which preserve the detailed dynamics of the captured movement for an actress with loose clothing and long hair without visible artifacts.