Collaborative Research: IIS Core: Small: World Values of Conversational AI and the Consequences for Human-AI Interaction

人们在日常生活中越来越多地使用人工智能(AI)驱动的系统，例如手机上的智能助理或家庭扬声器。然而，如果人工智能系统表达了他们不同意的文化价值观或信仰，这些互动可能会对人们产生意想不到的潜在负面影响。事实上，当人类彼此互动时，文化差异可能会导致“文化冲突”，这可能会引发误解、不信任、排斥或幸福感的下降。因此，了解在人与人工智能的互动中可能会发生多大程度的文化冲突，以及人们对表达不同价值观的人工智能系统的反应，是使基于人工智能的对话系统能够被接受、有用和包容不同背景的人的一个重要问题。该项目旨在调查对话人工智能系统中体现的价值观和信念的变化方式，以及人类和人工智能之间的价值观差异是否会产生类似于人类之间的文化冲突的影响。研究团队将开发：(1)在构成对话式人工智能系统基础的各种语言模型中衡量文化价值观的方法；(2)洞察世界各地和美国不同群体之间突出的语言模型与人类价值观的比较；以及(3)关于人类和对话性人工智能之间的价值观不匹配对个人的价值观、信任和主观幸福感的影响以及这些对更大社会的影响的经验知识。该团队还将发布其他研究人员的数据集，并部署一个在线平台，允许公众探索对话式人工智能系统所表达的价值观，分享他们自己在基于人工智能的系统中的文化冲突经验，并思考潜在的文化冲突及其后果。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

People increasingly converse with Artificial Intelligence (AI)-powered systems in their everyday lives, such as smart assistants on mobile phones or home speakers. However, those interactions could have unintended and potentially negative effects on people if the AI system expresses cultural values or beliefs they disagree with. Indeed, when humans interact with each other, cultural differences can lead to “culture clash,” which may trigger misunderstandings, mistrust, rejection, or declines in well-being. Thus, understanding to what extent culture clash may happen in human-AI interaction, and how people react to AI systems that express varied values, is an important question in making AI-based conversational systems that are acceptable, useful, and inclusive of people from different backgrounds. This project aims to investigate the ways values and beliefs embodied within conversational AI systems vary and whether diverging values between humans and AI can have effects similar to culture clash between humans. The team of researchers will develop: (1) methods for measuring cultural values in a variety of language models that form the basis for conversational AI systems; (2) insights into how prominent language models compare to human values across the world and across groups in the United States; and (3) empirical knowledge of the effects of mismatching values between humans and conversational AIs on a person's own values, trust, and subjective well-being, and the implications of these for larger society. The team will also release datasets for other researchers and deploy an online platform to allow the public to explore the values expressed by conversational AI systems, share their own experiences with culture clash in AI-based systems, and think about potential culture clashes and their consequences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.