Deep Learning and Interpretability in Digital Image Forensics

数字图像取证中的深度学习和可解释性

• 批准号: RGPIN-2022-03049
• 负责人: Wang, ZJane
• 金额: $ 4.01万
• 依托单位: University of British Columbia
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=752307
• 关键词: Deep; Learning; Interpretability; Digital; Image

In the new AI era (or equivalently in the "Fake News" era), seeing will no longer be believing and even truth will not be believed. Ensuring integrity and authenticity of digital images is increasingly challenging and vital. With advanced image editing tools and deep learning (DL) models, people can easily manipulate digital images or generate highly visually convincing fake images and videos, including the infamous DeepFakes, and therefore pose critical challenges in digital image forensics (DIF) analysis. DIF analysis identifies the existence, lack or inconsistency of subtle, perceptually invisible forensic traces in a digital image to validate its origin, integrity and authenticity. Deep learning has been widely employed for DIF tasks. Unfortunately, both digital images and deep learning models are vulnerable to manipulations and attacks, intentionally or unintentionally. Adversarial examples, which an attacker has intentionally designed by adding specific human imperceptible perturbations into clean images, can easily fool a DL model to make a mistake. Particularly with the "black box" nature of current DL models, DL opportunities come with "big challenges" associated with DIF. The nature and scope of the DIF field has rendered deep learning interpretability increasingly critical. With this vision, this proposed research program will focus on exploring the intersection of digital image forensics and deep learning to eventually ensure trusting images and achieve more trusting DL solutions. More specifically, the proposed research program will pursue the following main technical objectives: (a) Exploring deep learning interpretability in digital image forensics: We aim to establish the evaluation benchmark and develop novel interpretability models for both conventional image forensics problems and adversarial deep learning problems; (b) Developing interpretation-incorporated deep learning frameworks for the general-purpose DIF analysis (e.g., simultaneous detection of different image manipulations and attacks); and (c) Developing adversary deep learning approaches to provide model-agnostic adversarial attacks and attack-agnostic adversarial defenses. The proposed research addresses fundamental challenges in digital image security and forensics -- the vulnerability of digital images and deep learning models, and has the potential to make influential contributions in achieving more trusting DL solutions for trusting images. Our expected improvements in the ability to combat fake contents and attacks will be of great benefit to society, privacy and national security. DL is reshaping many industries and revolutionizing many research fields, and our research will help achieve the full vision of trusting DL one tiny step further. The research program will provide an opportunity for the students to be trained in related cutting-edge technologies.

在新的人工智能时代（或相当于在“假新闻”时代），看到的将不再是相信的，甚至真理也不会被相信。确保数字图像的完整性和真实性越来越具有挑战性和重要性。借助先进的图像编辑工具和深度学习（DL）模型，人们可以轻松地操纵数字图像或生成视觉上高度可信的虚假图像和视频，包括臭名昭著的DeepFakes，因此对数字图像取证（DIF）分析提出了严峻的挑战。DIF分析识别数字图像中微妙的、感知上不可见的取证痕迹的存在、缺乏或不一致，以验证其来源、完整性和真实性。 深度学习已被广泛用于DIF任务。不幸的是，数字图像和深度学习模型都容易受到有意或无意的操纵和攻击。攻击者通过在干净的图像中添加特定的人类不可感知的扰动来故意设计对抗性示例，可以很容易地欺骗DL模型犯错误。特别是由于当前DL模型的“黑匣子”性质，DL机会伴随着与DIF相关的“巨大挑战”。DIF领域的性质和范围使得深度学习的可解释性变得越来越重要。有了这个愿景，这个拟议的研究计划将专注于探索数字图像取证和深度学习的交叉点，以最终确保可信的图像，并实现更可信的深度学习解决方案。 更具体地说，拟议的研究计划将追求以下主要技术目标：（a）探索数字图像取证中的深度学习可解释性：我们的目标是建立评估基准，并为传统图像取证问题和对抗性深度学习问题开发新的可解释性模型;（B）为通用DIF分析开发结合解释的深度学习框架（例如，同时检测不同的图像操作和攻击）;以及（c）开发对抗深度学习方法，以提供模型不可知的对抗攻击和攻击不可知的对抗防御。 拟议的研究解决了数字图像安全和取证方面的根本挑战-数字图像和深度学习模型的脆弱性，并有可能在实现更可信的DL解决方案方面做出有影响力的贡献。我们预期的打击虚假内容和攻击能力的改进将对社会、隐私和国家安全大有裨益。DL正在重塑许多行业，并彻底改变许多研究领域，我们的研究将有助于实现信任DL的完整愿景。该研究计划将为学生提供相关尖端技术培训的机会。