Plausible 3D Face Wrinkle Generation Using Variational Autoencoders
Plausible 3D Face Wrinkle Generation Using Variational Autoencoders
复制标题
DOI：
10.1109/tvcg.2021.3051251
复制
发表时间：
2021-01
影响因子：
5.2
通讯作者：
Qixin Deng;Luming Ma;Aobo Jin;Huikun Bi;B. Le;Z. Deng
中科院分区：
文献类型：
--
作者：
Qixin Deng;Luming Ma;Aobo Jin;Huikun Bi;B. Le;Z. Deng
逼真的 3D 面部建模和动画已越来越多地应用于许多图形、动画和虚拟现实应用中。然而，在 3D 面部，特别是动画 3D 面部上生成逼真的细尺度皱纹仍然是一个具有挑战性的问题，远未得到解决。在本文中，我们提出了一种端到端系统，可以通过合成的精细几何皱纹自动增强粗尺度 3D 面部。通过将皱纹生成问题表述为监督生成任务，我们通过紧凑的生成模型对面部皱纹的连续空间进行隐式建模，从而可以通过空间中的有效采样和插值来生成合理的面部皱纹。我们还引入了一个完整的管道来在不同形状和拓扑的面部之间传输合成皱纹。通过许多实验，我们证明我们的方法可以在具有不同形状和表情的各种粗尺度 3D 面部上稳健地合成合理的细尺度皱纹。
Realistic 3D facial modeling and animation have been increasingly used in many graphics, animation, and virtual reality applications. However, generating realistic fine-scale wrinkles on 3D faces, in particular, on animated 3D faces, is still a challenging problem that is far away from being resolved. In this article we propose an end-to-end system to automatically augment coarse-scale 3D faces with synthesized fine-scale geometric wrinkles. By formulating the wrinkle generation problem as a supervised generation task, we implicitly model the continuous space of face wrinkles via a compact generative model, such that plausible face wrinkles can be generated through effective sampling and interpolation in the space. We also introduce a complete pipeline to transfer the synthesized wrinkles between faces with different shapes and topologies. Through many experiments, we demonstrate our method can robustly synthesize plausible fine-scale wrinkles on a variety of coarse-scale 3D faces with different shapes and expressions.