Collaborative Research: IIS Core: Small: World Values of Conversational AI and the Consequences for Human-AI Interaction

人们在日常生活中越来越多地与人工智能（AI）驱动的系统进行匡威，例如移动的手机或家用扬声器上的智能助理。然而，如果人工智能系统表达了人们不同意的文化价值观或信仰，这些互动可能会对人们产生意想不到的潜在负面影响。事实上，当人类相互交往时，文化差异会导致“文化冲突”，这可能会引发误解、不信任、排斥或幸福感下降。因此，了解人类与人工智能互动中可能发生的文化冲突程度，以及人们如何对表达不同价值观的人工智能系统做出反应，是使基于人工智能的对话系统可接受，有用和包容来自不同背景的人的重要问题。该项目旨在研究对话式人工智能系统中体现的价值观和信仰的变化方式，以及人类和人工智能之间的不同价值观是否会产生类似于人类之间文化冲突的影响。研究团队将开发：（1）在各种语言模型中测量文化价值的方法，这些语言模型构成了对话人工智能系统的基础;（2）深入了解世界各地和美国各群体的突出语言模型与人类价值观的比较;以及（3）人类和会话AI之间的不匹配值对人自己的价值观，信任和主观幸福感的影响的经验知识，以及这些对更大社会的影响。该团队还将为其他研究人员发布数据集，并部署一个在线平台，让公众探索对话式人工智能系统所表达的价值观，分享他们在基于人工智能的系统中的文化冲突方面的经验，该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的智力价值和更广泛的评估来支持。影响审查标准。

People increasingly converse with Artificial Intelligence (AI)-powered systems in their everyday lives, such as smart assistants on mobile phones or home speakers. However, those interactions could have unintended and potentially negative effects on people if the AI system expresses cultural values or beliefs they disagree with. Indeed, when humans interact with each other, cultural differences can lead to “culture clash,” which may trigger misunderstandings, mistrust, rejection, or declines in well-being. Thus, understanding to what extent culture clash may happen in human-AI interaction, and how people react to AI systems that express varied values, is an important question in making AI-based conversational systems that are acceptable, useful, and inclusive of people from different backgrounds. This project aims to investigate the ways values and beliefs embodied within conversational AI systems vary and whether diverging values between humans and AI can have effects similar to culture clash between humans. The team of researchers will develop: (1) methods for measuring cultural values in a variety of language models that form the basis for conversational AI systems; (2) insights into how prominent language models compare to human values across the world and across groups in the United States; and (3) empirical knowledge of the effects of mismatching values between humans and conversational AIs on a person's own values, trust, and subjective well-being, and the implications of these for larger society. The team will also release datasets for other researchers and deploy an online platform to allow the public to explore the values expressed by conversational AI systems, share their own experiences with culture clash in AI-based systems, and think about potential culture clashes and their consequences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.