HCC: Medium: Sociotechnical Systems to Combat Nonconsensual Intimate Media

这项研究将探讨社会技术系统的设计，提供用户控制打击非自愿的亲密媒体（NCIM），并阻止犯罪者分享它。NCIM是指未经同意分享另一个人的亲密，性内容，侵犯一个人的隐私权和自主权。NCIM可能对受害者造成严重伤害，其中大多数是妇女。在线社交媒体已经实现了对NCIM的广泛收集和分享，而最近的计算进步，如实时流媒体，深度伪造和识别技术，放大了NCIM恶化和传播的潜力。法律正在逐步承认NCIM，但获得法律的追索权可能既昂贵又缓慢。类似地，受害者可以直接向平台呼吁删除他们的内容，但这种呼吁是劳动密集型的，创伤性的，而且往往不成功。这项工作将为技术公司和政策制定者提供经过评估的设计，以对抗NCIM。该研究将为一套支持个人机构和自主权的系统制定设计原则，同时认识到为NCIM蓬勃发展创造条件的社会不平等。该研究有六个主要目标：（1）通过设计研讨会了解受害者的需求;（2）通过在线实验检查有关适当内容共享实践的规范;（3）通过在线实验研究受害者的需求。（3）设计系统以支持受害者跟踪和请求删除未经同意的内容;（4）设计系统以传达内容共享偏好;（5）通过打击NCIM的社会技术指南将结果转化为更广泛的公众;（6）参与社区外联活动，打击计算机领域的滥用行为。该项目还将探索新的技术问题，例如是否有可能设计用于表达内容共享偏好的界面，或者用户选择的数字水印是否可以增加对个人内容的控制。它将研究如何将同意，数据权利，数据隐私和社区规范等原则设计到社会技术系统中。例如，它将探索如何将法律的原则与计算相结合，例如自动记录NCIM的证据或用于跟踪删除请求的用户界面设计。该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估来支持。

This research will examine the design of sociotechnical systems that offer user controls for combating non-consensual intimate media (NCIM) and that deter perpetrators from sharing it. NCIM refers to the sharing of another person's intimate, sexual content without their consent, violating a person's right to privacy and autonomy. NCIM can cause severe harm to its victims, most of whom are women. Online social media have enabled widespread collection and sharing of NCIM, and recent computational advancements like live-streaming, deep fakes, and recognition technologies amplify the potential for NCIM to fester and spread. The law is evolving to recognize NCIM, but access to legal recourse can be expensive and slow. Similarly, victims can appeal directly to platforms to take down their content, but such appeals are labor-intensive, traumatic, and often unsuccessful. This work will provide technology companies and policy makers with empirically-evaluated designs for combatting NCIM. It will develop design principles for a set of systems that support individual agency and autonomy, while recognizing the societal inequities that create the conditions for NCIM to thrive.The research has six main objectives: (1) understand the needs of victims using design workshops; (2) examine norms about appropriate content sharing practices via online experiments; (3) design systems to support victims tracking and requesting takedowns of non-consensual content; (4) design systems to communicate content sharing preferences; (5) translate results for the broader public through sociotechnical guidelines for combatting NCIM; (6) engage in community outreach to combat abuse within the field of computing. This project will also explore novel technical questions, such as whether it is possible to design interfaces for the expression of content sharing preferences, or whether user-selected digital watermarks can increase control over personal content. It will examine how principles like consent, data rights, data privacy, and community norms can be designed into sociotechnical systems. For example, it will explore how legal principles can be integrated with computation, such as automating documentation of evidence of NCIM or user interface designs for tracking takedown requests.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.