HCC: Small: Incorporating Procedural Fairness in Flagging Mechanisms on Social Media Sites

这项研究将分析社交媒体平台用户在标记生命周期的每个阶段使用标记工具的期望和交互。平台提供标记，这是一项技术功能，允许用户报告不适当的帖子或不良行为者，以减少在线伤害，如仇恨言论、非自愿分享性爱照片等。然而，先前的研究表明，举报伤害可能被视为二次受害，特别是当受害者感觉到缺乏程序正义时。FLAGS在维护内容审核系统的可行性方面发挥着关键作用，这是识别需要审核者或自动化工具仔细审查的内容的第一步。因此，至关重要的是，设计标记界面的方式可以缓解报告的负面体验。为了实现这一目标，我们必须了解用户如何理解标记，他们寻求什么信息，以及他们如何导航标记的界面。这个项目将分为三个阶段：(1)访谈最近标记了一篇帖子的社交媒体用户，以了解他们在标记之前的动机、心理模型和担忧。(2)使用交互式原型的用户研究将检查在使用标记界面报告帖子时遇到的认知、导航和使用问题。(3)参与式设计讲习班将为悬挂旗帜后的信息和通信系统开发原型。在每个阶段，研究成果将与来自边缘化社区的个人共同设计，他们面临着不成比例的在线虐待。分析将从程序正义及其发言权和一致性的概念的解释性角度来调查用户如何形成他们对日渐衰落的过程的公平感。它将产生一种标记决策树的分类，提供一组生成的设计维度，平台可以在这些维度上改变未来的标记实现。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

This research will analyze expectations and interactions of social media platform users with flagging tools in each phase of the flagging lifecycle. Platforms offer flagging, a technical feature that empowers users to report inappropriate posts or bad actors, to reduce online harm, such as hate speech, nonconsensual sharing of sexual photos, etc. However, prior research shows that reporting harms can be experienced as secondary victimization, especially when victims perceive a lack of procedural justice. Flags play a critical role in maintaining the feasibility of content moderation systems, an initial step to identifying content that requires careful review by moderators or automated tools. It is, therefore, vital to design flagging interfaces in ways that ease the negative experiences of reporting. To accomplish this goal, we must understand how users make sense of flagging, what information they seek, and how they navigate flagging interfaces.There will be three phases in this project: (1) Interviews will be conducted with social media users who have recently flagged a post to understand their motivations, mental models, and concerns prior to flagging. (2) A user study with interactive prototypes will examine the awareness, navigation, and usage issues encountered while using flagging interfaces to report a post. (3) Participatory design workshop sessions will develop prototypes for post-flagging information and communication systems. In each phase, the research output will be codesigned with individuals from marginalized communities, who face disproportionate online abuse. Analysis will draw from the interpretive lens of procedural justice and its notions of voice and consistency to investigate how users develop their fairness perceptions of the flagging processes. It will produce a taxonomy of flagging-decision trees, offering a generative set of design dimensions upon which platforms may alter future flagging implementations.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.