Domain-adaptive human motion and dynamics capture

域自适应人体运动和动态捕捉

• 批准号: 461209230
• 负责人: Dr. Bastian Wandt
• 金额: --
• 依托单位: Department of Electrical Engineering (ISY)
• 依托单位国家: 德国
• 项目类别: WBP Fellowship
• 财政年份: 2021
• 资助国家: 德国
• 起止时间: 2020-12-31 至 2021-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/461209230?language=en
• 关键词: Domain; adaptive; human; motion; dynamics

The goal of the project is to develop a video-based markerless human motion and dynamics capture system. In contrast to other motion capture (MoCap) systems this project focuses on motions that are hard to record in traditional MoCap studios resulting in a lack of accurate 3D data for the specific motion domain. For example these motions can be outdoor activities of humans such as rock climbing, skiing and parkour running or even motions of animals. Additionally to estimating accurate 3D reconstructions of the observed object the system should also infer physical parameters that drive the motion, for instance joint torques and external forces. These forces are not only of high interest for motion analysis but will also improve the 3D motion reconstruction from videos. Moreover, constraints based on rigid body dynamics will be extremely helpful to enable a domain adaptation to motions without available ground truth 3D recordings.

该项目的目标是开发一个基于视频的无标记人体运动和动态捕捉系统。与其他运动捕捉（MoCap）系统相比，该项目侧重于传统MoCap工作室难以记录的运动，导致缺乏特定运动域的准确3D数据。例如，这些运动可以是人类的户外活动，例如攀岩、滑雪和跑酷跑步，或者甚至是动物的运动。除了估计所观察对象的准确3D重建之外，系统还应该推断驱动运动的物理参数，例如关节扭矩和外力。这些力不仅对运动分析有很高的兴趣，而且还将改善来自视频的3D运动重建。此外，基于刚体动力学的约束将非常有助于在没有可用地面实况3D记录的情况下实现对运动的域适应。