Surface and Motion Capture for High Fidelity Synthesis of Digital Humans

popovic， ZoranU of washington我们提出了一种多层的方法来捕捉和合成逼真的人体形状和动作。为了捕捉真实人体的静态形状，我们将采用三维扫描技术，包括分层光条纹，同时多条纹和光度立体。特征跟踪运动捕捉系统以及3D扫描技术将生成运动数据。研究人员将以不同的分辨率获取这些运动数据，以推动骨骼运动的分析，身体部位的变形，如由于肌肉弯曲而产生的肿胀，以及次要运动，如在踩踏地面时发生的腿部振动。这些丰富的人类数据将推动分析、建模和综合阶段。对静态扫描数据进行分析，以构建可能的人体形状空间。该人体形状模型将与身体部分运动捕捉和全身运动捕捉一起用于构建人体的详细运动学模型。在如此不同的细节水平上建模人体形状运动将允许在粗糙的骨骼水平上控制人体运动，同时保留精细的细节，如肌肉膨胀。此外，这种多层方法可以选择性地替换人体模型结构中的不同层。例如，可以将动画运动映射到不同的身体扫描上，并观察不同的表面形状运动和折痕。详细的运动学人体模型将进一步扩展为人体动力学模型，考虑到人体的一些物理特性，如肌肉使用和质量分布。这种额外的动态信息提供了一种方法来保持运动的真实性，即使运动的结构被显著修改。此外，研究人员将通过二次运动模拟来扩展骨骼动力学模型，以复制在高能运动中发生的松散皮肤和组织振动。调查人员将把他们的工作纳入他们大学的新课程和向专业团体提供的课程中。这项工作将被折叠成CDROM，以达到广泛的受众，包括普通公众和可能考虑从事信息技术职业的广泛高中学生。研究结果将包括人体形状和运动的复杂数据库，分发给一般研究界，以鼓励在这一领域的进一步研究。

Proposal #0098005Popovic, ZoranU of WashingtonWe propose a multi-layered approach to capturing and synthesizing realistic human shapes and motions. To capture the static shape of real humans, we will employ 3D scanning techniques including hierarchical light striping, simultaneous multi-striping, and photometric stereo. A feature-tracked motion capture system as well as 3D scanning techniques will generate motion data. The investigators will acquire this motion data at varying resolutions in order to drive the analysis of skeletal motion, body part deformation such as bulging due to flexing a muscle, and secondary motion such as leg vibrations that occur when stomping on the ground.This wealth of human data will then drive an analysis, modeling, and synthesis stage. The static scan data will be analyzed to construct the space of possible human shapes. This human shape model together with the body part motion capture and full-body motion capture will be used to construct a detailed kinematicmodel of the human body. Modeling human shape movement at such different levels of detail will allow control of the human motion on the coarse skeletal level while preserving the fine details such as muscle bulging. Furthermore, this multi-layered approach will enable selective replacement of different layers in the human model structure. For example, it will be possible to map the animated movement onto a different body scan and observe a different surface shape movement and creasing. The detailed kinematic human model will be further extended with a model of human dynamics by taking into account a number of physical properties of the human body such as muscle usage and mass distribution. This additional dynamic information provides a way to preserve the realism of motion even when the structure of motion is significantly modified. In addition, the investigators will extend the skeletal dynamic model with secondary motion simulations constructed to replicate the loose skin and tissue vibrations that occur in high-energy movements.The investigators will incorporate their work into new curriculum both at their university and in courses being offered to the professional community. This work will be folded into CDROM's that reach a wide audience, including the general public and a broad spectrum of high school students who may be considering careers in information technology. The results of the research will include complex databases of human shape and motion to be distributed to the general research community in order to encourage further research in this area.