Collaborative Research: IIS Core: Small: World Values of Conversational AI and the Consequences for Human-AI Interaction

人们在日常生活中越来越多地与人工智能（AI）驱动的系统交谈，比如手机上的智能助手或家用扬声器。然而，如果人工智能系统表达了人们不同意的文化价值观或信仰，这些互动可能会对人们产生意想不到的潜在负面影响。事实上，当人类相互交往时，文化差异会导致“文化冲突”，这可能会引发误解、不信任、拒绝或幸福感下降。因此，了解在人类与人工智能交互中可能发生的文化冲突的程度，以及人们对表达不同价值观的人工智能系统的反应，是使基于人工智能的对话系统能够被不同背景的人接受、有用和包容的一个重要问题。该项目旨在研究对话式人工智能系统中体现的价值观和信仰的变化方式，以及人类和人工智能之间的价值观分歧是否会产生类似于人类之间文化冲突的影响。研究团队将开发：(1)在各种语言模型中测量文化价值的方法，这些语言模型构成了会话人工智能系统的基础；(2)了解世界各地和美国各群体的突出语言模式与人类价值观的比较；(3)关于人类和会话人工智能之间价值观不匹配对个人自身价值观、信任和主观幸福感的影响的经验知识，以及这些对更大社会的影响。该团队还将为其他研究人员发布数据集，并部署一个在线平台，让公众探索对话式人工智能系统所表达的价值观，分享他们自己在基于人工智能的系统中遭遇文化冲突的经历，并思考潜在的文化冲突及其后果。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

People increasingly converse with Artificial Intelligence (AI)-powered systems in their everyday lives, such as smart assistants on mobile phones or home speakers. However, those interactions could have unintended and potentially negative effects on people if the AI system expresses cultural values or beliefs they disagree with. Indeed, when humans interact with each other, cultural differences can lead to “culture clash,” which may trigger misunderstandings, mistrust, rejection, or declines in well-being. Thus, understanding to what extent culture clash may happen in human-AI interaction, and how people react to AI systems that express varied values, is an important question in making AI-based conversational systems that are acceptable, useful, and inclusive of people from different backgrounds. This project aims to investigate the ways values and beliefs embodied within conversational AI systems vary and whether diverging values between humans and AI can have effects similar to culture clash between humans. The team of researchers will develop: (1) methods for measuring cultural values in a variety of language models that form the basis for conversational AI systems; (2) insights into how prominent language models compare to human values across the world and across groups in the United States; and (3) empirical knowledge of the effects of mismatching values between humans and conversational AIs on a person's own values, trust, and subjective well-being, and the implications of these for larger society. The team will also release datasets for other researchers and deploy an online platform to allow the public to explore the values expressed by conversational AI systems, share their own experiences with culture clash in AI-based systems, and think about potential culture clashes and their consequences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.