Collaborative Research: SaTC: CORE: Large: Privacy-Preserving Abuse Prevention for Encrypted Communications Platforms

协作研究：SaTC：核心：大型：加密通信平台的隐私保护滥用预防

• 批准号: 2120497
• 负责人: Amy Zhang
• 金额: $ 37.14万
• 依托单位: University of Washington
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-08-01 至 2026-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2120497&HistoricalAwards=false
• 关键词: Collaborative; Research; SaTC; CORE; Large

This project will address the immense challenge of mitigating abuse in communication services where interactions between the parties are private and fully encrypted. Such services have become popular for individual and group communications, and their security features help protect individual privacy and rights. But these platforms are also used for harmful and illegal purposes such as organizing violent activities or sharing child sexual abuse materials. In addition, users on these platforms are subject to abuse such as hate, harassment, and misinformation. The encryption used by such services makes detecting and blocking harmful content extremely difficult. This work will develop new trust and safety approaches to enable secure and trustworthy communications that preserve privacy while mitigating abuses. The project will aim to provide (1) technical advances in developing novel cryptographic tools and techniques to support mitigation of abuse; (2) human-centered advances in understanding perceptions and expectations of privacy and abuse mitigation, as well as creating novel designs for individual and community interactions; and (3) legal, policy, and regulatory advances to support and enable these abuse-mitigating features.The research effort is organized around two overlapping thrusts: algorithmic-driven approaches and community-driven approaches. The algorithmic approaches will focus on developing better cryptographic tools for privacy-aware abuse detection in encrypted settings, such as detection of viral, fast-spreading content. These designs will be informed by a human-centered approach to understanding people's privacy expectations, and supported by legal analyses that ensure tools are consistent with applicable privacy and content-moderation laws. In the second thrust, the community approaches will focus on providing communities with the tools they need to address abuse challenges in encrypted settings. Given the challenges and pitfalls of centralized approaches for abuse mitigation, the project will explore building distributed capabilities to support communities and groups on these platforms. An importantly ingredient is working with communities and community moderators to understand their needs, as well as guide design of legal and policy frameworks to support new approaches.Taken together, this project will address the challenge of abuse mitigation on encrypted platforms, while preserving privacy protections for individuals and communities. It will especially consider the perspectives of individuals and communities most in need of privacy and abuse protection. The work, if successful, should fuel new innovations in the design of encrypted messaging platforms, and in basic research in cryptography, human-centered design, and Internet law.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目将解决在通信服务中减少滥用的巨大挑战，在通信服务中，各方之间的交互是私有的和完全加密的。这类服务在个人和群体通信中非常流行，它们的安全特性有助于保护个人隐私和权利。但这些平台也被用于有害和非法目的，如组织暴力活动或分享儿童性虐待材料。此外，这些平台上的用户还会受到诸如仇恨、骚扰和错误信息等滥用。这些服务使用的加密技术使得检测和阻止有害内容变得极其困难。这项工作将开发新的信任和安全方法，以实现安全可靠的通信，在保护隐私的同时减少滥用。该项目旨在提供(1)在开发新型加密工具和技术方面的技术进步，以支持减少滥用；(2)在理解对隐私和滥用缓解的看法和期望以及为个人和社区互动创造新颖设计方面，以人为本的进步；(3)法律、政策和监管方面的进步，以支持和启用这些缓解滥用的特性。研究工作围绕两个重叠的重点进行：算法驱动的方法和社区驱动的方法。算法方法将专注于开发更好的加密工具，用于在加密设置中检测隐私意识滥用，例如检测病毒式传播的内容。这些设计将通过以人为本的方法来了解人们的隐私期望，并得到法律分析的支持，以确保工具与适用的隐私和内容审核法律保持一致。在第二个重点中，社区方法将侧重于为社区提供他们需要的工具，以应对加密环境中的滥用挑战。鉴于集中式减少滥用方法的挑战和缺陷，该项目将探索建立分布式能力，以支持这些平台上的社区和团体。一个重要的组成部分是与社区和社区管理员合作，了解他们的需求，并指导法律和政策框架的设计，以支持新方法。总而言之，该项目将解决在加密平台上减少滥用的挑战，同时保护个人和社区的隐私。它将特别考虑最需要隐私和滥用保护的个人和社区的观点。这项工作，如果成功的话，应该会推动加密消息平台设计的创新，以及密码学、以人为本的设计和互联网法律的基础研究。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Skin Deep: Investigating Subjectivity in Skin Tone Annotations for Computer Vision Benchmark Datasets

• DOI: 10.1145/3593013.3594114
• 发表时间: 2023-05
• 期刊: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency
• 作者: Teanna Barrett;Quan Ze Chen;Amy X. Zhang