SaTC: CORE: Small: Investigating and Mitigating Harmful Design in User-Generated Virtual World through Design Moderation

用户生成的虚拟世界是提供身临其境体验的三维空间，由数千万用户设计和填充，其中包括大量儿童。许多孩子在这些在线空间里花了相当多的时间来创造、社交、学习和玩耍。虽然在线虚拟世界代表了儿童创造内容和相互互动的新方式，但它们也带来了有害的设计。有害的设计可能会以操纵性的、阴险的方式影响毫无戒心的儿童用户，例如诱导他们表演暴力角色扮演，让他们接触到辱骂内容，并诱使他们过度消费。以前的研究已经研究了如何检测和控制有害的用户生成内容，如仇恨言论和骚扰，这些内容通常以静态形式存在，如文本、图像和视频。然而，对用户生成的虚拟世界中的有害设计的关注有限。该项目旨在通过采用混合方法、以人为中心的设计方法来应对这一挑战。其目的是为有害设计提供全面的经验和概念洞察，培养更广泛的社会和学术对这一挑战的认识，并探索缓解这一挑战和类似问题的策略。为了实现这些目标，该项目正在识别和表征用户生成的虚拟世界中的有害设计，并探索可以减轻有害设计的适度策略。该项目使用定性和定量相结合的方法来记录和分析有害设计的实例，以及儿童用户如何体验和感知有害设计。该项目还使用合作探究与儿童和设计专家合作开发设计指南，以促进安全设计和减少有害设计。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

User-generated virtual worlds are three-dimensional spaces that offer an immersive experience and are designed and populated by tens of millions of users, including a significant number of children. Many children spend considerable time in these online spaces to create, socialize, learn, and play. Although online virtual worlds represent new ways for children to create content and interact with each other, they also have given rise to harmful design. Harmful design can affect unsuspecting child users in manipulative, insidious ways, such as inducing them to perform violent role-plays, exposing them to abusive content, and tricking them into excessive spending. Previous research has studied how to detect and moderate harmful user-generated content, such as hate speech and harassment, which typically exist in static forms such as text, image, and video. However, limited attention has been paid to harmful design in user-generated virtual worlds. This project aims to tackle this challenge by employing a mixed-methods, human-centered design approach. The objectives are to provide comprehensive empirical and conceptual insights into harmful design, foster broader societal and academic awareness of this challenge, and explore strategies to mitigate this challenge and alike.To achieve these goals, the project is identifying and characterizing harmful design in user-generated virtual worlds and exploring moderation strategies that can mitigate harmful design. The project uses a combination of qualitative and quantitative methods to document and analyze instances of harmful design, as well as how child users experience and perceive harmful design. The project also uses cooperative inquiry to work with children and design experts to develop design guidelines that can promote safety design and mitigate harmful design.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.