Collaborative Research: SaTC: CORE: Large: Privacy-Preserving Abuse Prevention for Encrypted Communications Platforms

该项目将解决在通信服务中减少滥用的巨大挑战，其中各方之间的互动是私密的和完全加密的。这些服务已成为个人和团体通信的热门，其安全功能有助于保护个人隐私和权利。但这些平台也被用于有害和非法的目的，如组织暴力活动或分享儿童性虐待材料。此外，这些平台上的用户还受到仇恨、骚扰和错误信息等虐待。这些服务使用的加密使得检测和阻止有害内容变得非常困难。这项工作将开发新的信任和安全方法，以实现安全和值得信赖的通信，保护隐私，同时减少滥用。该项目旨在提供（1）开发新的加密工具和技术以支持减轻滥用的技术进步;（2）以人为本的进步，以理解对隐私和滥用减轻的看法和期望，以及为个人和社区互动创造新的设计;以及（3）支持和实现这些滥用缓解功能的法律的、政策和监管进展。研究工作围绕两个重叠的重点组织：算法驱动方法和社区驱动方法。 算法方法将专注于开发更好的加密工具，用于加密设置中的隐私感知滥用检测，例如检测病毒，快速传播的内容。这些设计将遵循以人为本的方法来了解人们的隐私期望，并得到法律的分析的支持，以确保工具符合适用的隐私和内容审核法律。在第二个重点中，社区方法将侧重于为社区提供在加密环境中应对滥用挑战所需的工具。鉴于集中式减少滥用方法的挑战和缺陷，该项目将探索建立分布式能力，以支持这些平台上的社区和团体。一个重要的组成部分是与社区和社区版主合作，了解他们的需求，以及指导法律的和政策框架的设计，以支持新的方法。总之，这个项目将解决加密平台上的滥用缓解挑战，同时保护个人和社区的隐私保护。它将特别考虑最需要隐私和滥用保护的个人和社区的观点。这项工作，如果成功的话，应该会在加密消息平台的设计，以及密码学，以人为本的设计和互联网法律的基础研究中推动新的创新。这个奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

This project will address the immense challenge of mitigating abuse in communication services where interactions between the parties are private and fully encrypted. Such services have become popular for individual and group communications, and their security features help protect individual privacy and rights. But these platforms are also used for harmful and illegal purposes such as organizing violent activities or sharing child sexual abuse materials. In addition, users on these platforms are subject to abuse such as hate, harassment, and misinformation. The encryption used by such services makes detecting and blocking harmful content extremely difficult. This work will develop new trust and safety approaches to enable secure and trustworthy communications that preserve privacy while mitigating abuses. The project will aim to provide (1) technical advances in developing novel cryptographic tools and techniques to support mitigation of abuse; (2) human-centered advances in understanding perceptions and expectations of privacy and abuse mitigation, as well as creating novel designs for individual and community interactions; and (3) legal, policy, and regulatory advances to support and enable these abuse-mitigating features.The research effort is organized around two overlapping thrusts: algorithmic-driven approaches and community-driven approaches. The algorithmic approaches will focus on developing better cryptographic tools for privacy-aware abuse detection in encrypted settings, such as detection of viral, fast-spreading content. These designs will be informed by a human-centered approach to understanding people's privacy expectations, and supported by legal analyses that ensure tools are consistent with applicable privacy and content-moderation laws. In the second thrust, the community approaches will focus on providing communities with the tools they need to address abuse challenges in encrypted settings. Given the challenges and pitfalls of centralized approaches for abuse mitigation, the project will explore building distributed capabilities to support communities and groups on these platforms. An importantly ingredient is working with communities and community moderators to understand their needs, as well as guide design of legal and policy frameworks to support new approaches.Taken together, this project will address the challenge of abuse mitigation on encrypted platforms, while preserving privacy protections for individuals and communities. It will especially consider the perspectives of individuals and communities most in need of privacy and abuse protection. The work, if successful, should fuel new innovations in the design of encrypted messaging platforms, and in basic research in cryptography, human-centered design, and Internet law.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.