RI: Small: Acquisition and Modeling of Dense Nonrigid Shape and Motion

该项目的目标是在获取和建模动态非刚性物体方面推进最先进的技术。该项目关注的非刚性物体的具体例子包括：人脸、手、软组织、衣服和动物。PI试图解决以下两个基本问题：(1)如何使用非接触式光学方法来测量密集的3D表面运动，而不改变表面的物理外观？(2)从获得的密集三维运动数据中可以推断出哪些物理和/或生物特性？研究小组通过两个简单但通用的想法来解决这两个问题，即时空方法和数据驱动模型。时空方法建立在时空立体的基础上，实现了三维表面运动的精确光学测量，以及不同动态对象之间形状序列的自动配准。数据驱动模型用于材料识别和变形-肌电图关联。该项目具有广泛的科学影响，包括在生物计量学中生成2D面部对齐和3D面部识别数据，在人机交互中生成3D面部情感识别数据，在生物力学中测量人体变形，为骨科和计算机辅助手术建模软组织，以及为娱乐和教育建立虚拟人体模型。这些科学的影响转化为对社会的好处，例如，通过建立更精确的生物识别系统来保护我们的国家，创新手术程序来降低医疗保险成本，以及创建优秀教师的3D数字复制品，使我们随时随地以更低的成本获得教育。

The objective of this project is to advance the state-of-the-art in acquiring and modeling dynamic non-rigid objects. The specific examples of non-rigid objects that the project is to focus on include: human faces, hands, soft tissues, cloths, and animals. The PI seeks to address the following two fundamental questions: (1) How can non-contact optical methods be used to measure dense 3D surface motion without physically modifying the appearance of the surface? (2) What physical and/or biological properties can be inferred from the acquired dense 3D motion data?The research team addresses these two questions by two simple but general ideas, namely the space-time approach and data-driven models. The space-time approach builds upon space-time stereo, and enables accurate optical measurements of 3D surface motion, as well as automatic registration of shape sequences among different dynamic objects. The data-driven models are used for both material recognition and deformation-EMG correlation. The project has a wide range of scientific impacts, including generating data for 2D face alignment and 3D face recognition in biometrics, generating data for 3D face emotion recognition in human computer interaction, measuring human body deformation in biomechanics, modeling soft tissues for orthopedics and computer-aided surgery, and building virtual human models for entertainment and education. These scientific impacts translate into benefits to society, for example, by building more accurate biometric systems to secure our country, innovating surgery procedure to reduce health insurance cost, and creating 3D digital replicas of great teachers to make our education available anywhere, anytime, at a lower cost.