Collaborative Research: SaTC: CORE: Large: Privacy-Preserving Abuse Prevention for Encrypted Communications Platforms

该项目将解决在通信服务中减少滥用的巨大挑战，在通信服务中，各方之间的互动是私人的和完全加密的。这类服务在个人和群体通信中变得流行起来，其安全功能有助于保护个人隐私和权利。但这些平台也被用于有害和非法目的，如组织暴力活动或分享儿童性虐待材料。此外，这些平台上的用户还会受到仇恨、骚扰和错误信息等虐待。这类服务使用的加密使检测和阻止有害内容变得极其困难。这项工作将开发新的信任和安全方法，以实现安全可靠的通信，在保护隐私的同时减少滥用。该项目旨在提供(1)开发新的加密工具和技术以支持减少滥用的技术进步；(2)以人为中心在理解对隐私和滥用缓解的看法和期望方面的进展，以及为个人和社区互动创造新的设计；以及(3)法律、政策和监管方面的进步，以支持和启用这些减少滥用的特征。研究工作围绕两个重叠的推动力组织：算法驱动的方法和社区驱动的方法。算法方法将侧重于开发更好的密码工具，用于在加密环境中检测隐私意识滥用，例如检测病毒、快速传播的内容。这些设计将以人为中心的方法来了解人们的隐私期望，并得到法律分析的支持，以确保工具与适用的隐私和内容审查法律一致。在第二个推力中，社区方法将侧重于向社区提供他们需要的工具，以应对加密环境中的滥用挑战。鉴于减少滥用的集中化方法的挑战和陷阱，该项目将探索建立分布式能力，以支持这些平台上的社区和团体。一个重要的组成部分是与社区和社区主持人合作，了解他们的需求，并指导法律和政策框架的设计，以支持新的方法。总而言之，该项目将应对在加密平台上减少滥用的挑战，同时保护个人和社区的隐私。它将特别考虑最需要隐私和滥用保护的个人和社区的观点。这项工作如果成功，将推动加密消息平台设计以及密码学、以人为本的设计和互联网法律方面的基础研究的新创新。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

This project will address the immense challenge of mitigating abuse in communication services where interactions between the parties are private and fully encrypted. Such services have become popular for individual and group communications, and their security features help protect individual privacy and rights. But these platforms are also used for harmful and illegal purposes such as organizing violent activities or sharing child sexual abuse materials. In addition, users on these platforms are subject to abuse such as hate, harassment, and misinformation. The encryption used by such services makes detecting and blocking harmful content extremely difficult. This work will develop new trust and safety approaches to enable secure and trustworthy communications that preserve privacy while mitigating abuses. The project will aim to provide (1) technical advances in developing novel cryptographic tools and techniques to support mitigation of abuse; (2) human-centered advances in understanding perceptions and expectations of privacy and abuse mitigation, as well as creating novel designs for individual and community interactions; and (3) legal, policy, and regulatory advances to support and enable these abuse-mitigating features.The research effort is organized around two overlapping thrusts: algorithmic-driven approaches and community-driven approaches. The algorithmic approaches will focus on developing better cryptographic tools for privacy-aware abuse detection in encrypted settings, such as detection of viral, fast-spreading content. These designs will be informed by a human-centered approach to understanding people's privacy expectations, and supported by legal analyses that ensure tools are consistent with applicable privacy and content-moderation laws. In the second thrust, the community approaches will focus on providing communities with the tools they need to address abuse challenges in encrypted settings. Given the challenges and pitfalls of centralized approaches for abuse mitigation, the project will explore building distributed capabilities to support communities and groups on these platforms. An importantly ingredient is working with communities and community moderators to understand their needs, as well as guide design of legal and policy frameworks to support new approaches.Taken together, this project will address the challenge of abuse mitigation on encrypted platforms, while preserving privacy protections for individuals and communities. It will especially consider the perspectives of individuals and communities most in need of privacy and abuse protection. The work, if successful, should fuel new innovations in the design of encrypted messaging platforms, and in basic research in cryptography, human-centered design, and Internet law.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.