基于深度学习的人脸融合取证研究

人脸融合攻击通过融合多个真实人脸生成伪造人脸图像欺骗人脸识别系统，已严重威胁人证比对中身份验证的安全性。现有人脸融合攻击检测大多基于传统数字图像取证技术、人脸融合合谋者溯源需要融合方法和参数等先验知识、人脸融合取证缺少公开可用的图像数据集，导致取证性能的提升和科学评测仍然存在困难。针对此，本申请基于深度学习研究人脸融合取证，主要包括：人证比对中人脸融合攻击的安全模型、基于深度学习的人脸融合攻击检测、基于对抗学习的人脸融合合谋者溯源取证、人脸融合取证图像数据集和测试协议等。通过研究，发现人脸融合图像与真实人脸图像在身份特征上的内在联系，揭示宏观与微观差异对人脸融合攻击检测的作用机理，描述人脸面部特征稀疏表示对融合人脸的身份消融机制，解决人证比对中的人脸融合攻击检测和合谋者身份溯源等问题，提高人证比对中身份验证的安全性。研究成果可应用到犯罪调查、公共安全等领域，为维护社会稳定发挥重要作用。

Face morphing attack produces a forged face image from multiple persons’ real face images to deceive the face recognition system, and it is becoming a serious threat to the security of the current human-certificate authentication. The existing face morphing attack detection schemes are mainly based on traditional digital image forensics, the face morphing accomplice forensics still needs priori knowledges such as morphing methods and parameters, and there still has no publicly available face morphing forensics image dataset, which leads to difficulty in forensics performance improvement and scientific evaluation. Aiming to these limitations, this proposal puts effort on the study of face morphing forensics based on deep learning. It is mainly focused on the following aspects: the security model of face morphing attack in human-certificate authentication, face morphing attack detection based on deep learning, face morphing accomplice forensics based on adversarial learning, and image dataset and testing protocols for face morphing forensics. Through the research, it will discover the inherent connection of the identity characteristics between the morphed face image and the real face images, reveal the function mechanism of macro and micro differences in face morphing attack detection, describe the identity ablation principle for morphed face image from the facial feature sparse representation, resolve the problems of face morphing detection and accomplice forensics, and improve the security of identity verification in human-certificate authentication. The research results can be applied for crime investigation, public security and other fields. It will play an important role in maintaining social stability.