3DFace@Home: A pilot study for robust and highly accurate facial 3D reconstruction from mobile devices for facial growth monitoring at home

3DFace@Home：一项通过移动设备进行稳健且高精度面部 3D 重建的试点研究，用于家庭面部生长监测

• 批准号: EP/X036642/1
• 负责人: Ludovic Magerand
• 金额: $ 25.98万
• 依托单位: University of Dundee
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2024
• 资助国家: 英国
• 起止时间: 2024 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FX036642%2F1
• 关键词: 3DFace; Home; pilot; study; robust

The goal of 3Dface@Home is to develop and test a system to robustly obtain highly accurate facial 3D reconstruction from end users' mobile devices in real world conditions, such as one's smartphone at home. It is made of a mobile application allowing the user to capture images of their face by themselves with guidance and validity check. Those images are sent to a computational server where a deep learning based facial 3D reconstruction embedding multi-view geometry constraints will be used to obtain the 3D shape of the face. The project will aim to reach sub-millimetre accuracy required for measuring anatomical structures in the context of disease affecting facial growth. A purpose-built dataset will be acquired, including examples of facial dysmorphology, and reflecting real world conditions the system needs to be robust to such as bad illumination, blurry images or partial occlusion. In the future, this work will facilitate mass collection of data for genetic studies on disease affecting facial growth and enable the exploration of clinical translation in a variety of medical fields.

3Dface@Home的目标是开发和测试一个系统，以在现实世界条件下，从终端用户的移动设备（例如家中的智能手机）中可靠地获得高精度的面部3D重建。它是由一个移动应用程序组成的，允许用户在指导和有效性检查下自己捕捉面部图像。这些图像被发送到计算服务器，在那里，基于深度学习的面部3D重建嵌入多视图几何约束将被用来获得面部的3D形状。该项目旨在达到亚毫米精度，以测量影响面部生长的疾病背景下的解剖结构。将获得一个专门构建的数据集，包括面部畸形的例子，并反映系统需要对诸如照明不良、图像模糊或部分遮挡等现实世界条件具有鲁棒性。在未来，这项工作将有助于大量收集影响面部生长的疾病的基因研究数据，并在各种医学领域进行临床转化的探索。