Collaborative Research: SaTC: CORE: Medium: Broad-Spectrum Facial Image Protection with Provable Privacy Guarantees

随着智能手机和其他移动设备的日益普及，图片分享在社交网络中越来越受欢迎。隐私保护现在已经成为一个需要解决的关键问题，因为分享图像可以揭示个人和社会环境以及私人生活的细节。虽然许多社交媒体允许用户设置隐私首选项，但由于选项的限制、问题的复杂性以及隐私配置的繁琐性质，这些设置很少足够。本项目的目标是设计一个智能的、自动的广谱图像保护系统，在保持图像质量的同时，为参与社会图像共享的多方提供可证明的隐私保障。具体地说，该项目的研究人员旨在克服以下挑战：(I)对图像背景中的人类主体和敏感物体进行隐私保护；(Ii)考虑在某些地方(如酒吧、医院)拍摄的图像可能会影响隐私，从而影响隐私，例如图像中的人不希望他们在这些位置出现或共生的情况被知道；(Iii)严格执行隐私保护，以符合同一图像中多个人的不同隐私需求。这项拟议研究的成功将解决社交网站上图片分享日益加剧的隐私问题，并使数十亿社交网络用户受益。该项目还将开展一系列教育活动，包括课程开发、大学生专业培训以及面向K-12教师和学生的外展活动，重点是代表不足的群体。该项目将极大地促进在线图像分享过程中面部隐私保护的最新水平，具有以下创新的研究思路。首先，将设计一种新的图像隐私策略语言和高效的策略管理系统，以管理多方的广谱隐私关切。其次，将定义正式的隐私模型，以量化隐私风险，并在政策执行期间提供可证明的隐私保障。第三，将研究新的基于深度学习的图像修改方法，如面部修改/替换和图像裁剪，以同时满足不同用户对同一图像的隐私需求，同时保持美学本质。最后，将进行界面和激励设计的结合，以获得更准确的用户反馈，并评估拟议系统的有效性和实用性。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

With the growing ubiquity of smartphones and other mobile devices, image sharing is gaining increasing popularity in social networks. Privacy protection has now become a crucial issue to be addressed because sharing images can reveal personal and social environments and details of private lives. While many social media allow users to set privacy preferences, these are rarely sufficient due to the limitations of the options, complexity of the problem, and the tedious nature of privacy configuration. The objective of this project is to design an intelligent and automatic broad-spectrum image protection system that offers provable privacy guarantees for multiple parties involved in social image sharing while maintaining image quality. Specifically, the researchers on this project aim to overcome the following challenges: (i) Privacy protection for human subjects and sensitive objects in the background of the images; (ii) Consideration of location-dependent image sensitivities whereby images taken at certain places (e.g., pubs, hospitals) may impact privacy, such as people in the images who do not want their occurrences or co-occurrences at those locations to be known; (iii) Strong enforcement of the privacy protection that conforms with different privacy needs of multiple people in the same image. The success of the proposed research will address the rising privacy concerns of image sharing on social sites and benefit billions of social network users. A range of educational activities will be also carried out including curriculum development, professional training for college students and outreach to K-12 teachers and students, with emphasis on under-represented groups.This project will greatly advance the state-of-the-art facial privacy protection during online image sharing with the following innovative research ideas. First, a new image privacy policy language and an efficient policy management system will be designed for managing broad-spectrum privacy concerns of multiple parties. Second, formal privacy models will be defined to quantify privacy risks and provide provable privacy guarantees during policy enforcement. Third, new deep-learning-based image modification approaches such as facial modification/replacement and image cropping will be investigated to simultaneously address different users' privacy needs regarding the same image while preserving the aesthetics nature. Finally, a combination of interface and incentive design will be conducted to obtain more accurate user feedback and evaluate the effectiveness and practicality of the proposed system.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.