Monocular 3D Reconstruction of Human Motion in Long Action Sequences
Monocular 3D Reconstruction of Human Motion in Long Action Sequences
复制标题
长动作序列中人体运动的单目 3D 重建
DOI：
10.1007/978-3-540-24673-2_36
复制
发表时间：
2004
期刊：
影响因子：
--
通讯作者：
S. Carlsson
中科院分区：
文献类型：
--
作者：
G. Loy;M. Eriksson;Josephine Sullivan;S. Carlsson
提出了一种新的单目长图像序列（>30秒）人体动作三维重建算法。序列由一小部分自动找到的代表性关键帧表示。骨骼关节位置在每个关键帧中手动定位，并映射到序列中的所有其他帧。对于每个关键帧，创建3D关键姿势，并且这些3D身体姿势之间的插值连同肢体长度和对称约束的合并一起提供3D运动的平滑初始近似。然后将其拟合到图像数据以生成逼真的3D重建。所需手动输入的程度由序列内容的多样性控制。体育的镜头非常适合这种方法，因为它经常包含有限数量的重复动作。我们的方法是证明了一个女人打网球拍摄的非固定摄像机长（36秒）序列。该序列需要在<1.5%的帧上手动初始化，并且表明该系统可以处理在多个并发帧上发生的非常快速的运动、严重的自遮挡、运动模糊和混乱。通过从“地面实况”参考相机的角度合成视图来验证单目3D重建，并且结果被认为提供了运动的定性准确的3D重建。
A novel algorithm is presented for the 3D reconstruction of human action in long (>30 second) monocular image sequences. A sequence is represented by a small set of automatically found representative keyframes. The skeletal joint positions are manually located in each keyframe and mapped to all other frames in the sequence. For each keyframe a 3D key pose is created, and interpolation between these 3D body poses, together with the incorporation of limb length and symmetry constraints, provides a smooth initial approximation of the 3D motion. This is then fitted to the image data to generate a realistic 3D reconstruction. The degree of manual input required is controlled by the diversity of the sequence’s content. Sports’ footage is ideally suited to this approach as it frequently contains a limited number of repeated actions. Our method is demonstrated on a long (36 second) sequence of a woman playing tennis filmed with a non-stationary camera. This sequence required manual initialisation on <1.5% of the frames, and demonstrates that the system can deal with very rapid motion, severe self-occlusions, motion blur and clutter occurring over several concurrent frames. The monocular 3D reconstruction is verified by synthesising a view from the perspective of a ‘ground truth’ reference camera, and the result is seen to provide a qualitatively accurate 3D reconstruction of the motion.