Opening the black box: helping AI to persuade without bias

打开黑匣子：帮助人工智能无偏见地说服

• 批准号: 2752436
• 金额: --
• 依托单位: University of Aberdeen
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2022
• 资助国家: 英国
• 起止时间: 2022 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2752436
• 关键词: Opening; black; box; helping; AI

The overall aim of the project is to establish how AI can use natural language to persuade humans in transparent and bias-free ways. AI systems are becoming an integral part of our daily lives, from simple recommendations on YouTube or Netflix, to life-changing decisions such as shortlisting job applicants or recommending loans. However, these systems lack transparency and objective indicators of fairness, producing poorly understood 'advice' that could be fuelling biased decisions on a growing scale right across society. Biased advice that treats individuals differently based on their gender is a particular concern (e.g. in employment contexts). Detecting and removing this bias is extremely difficult. It arises from stereotyped human labelling and categorisation residing within huge, cobbled-together data sets typically used to train AI. Because this bias is 'hidden', its transmission to humans interacting with AI is correspondingly difficult to establish, and even more difficult to eliminate. In this Phd, we propose and test a novel solution which combines experimental psychology with computing science to offer a way of detecting when biased advice from AI passes into human judgements. The student will engineer their own AI into which known patterns of gender-bias, deriving from our work on cognitive stereotypes, can be 'injected'. Using advanced natural language models, the AI will have brief 'conversations' with human participants in a series of studies that will provide a rich source of data on acts of rejection or conformity to biased and unbiased advice. Using cutting-edge machine learning techniques, the student will analyse this new bespoke data set to identify language features that signal persuasion. Within these features the student will seek to isolate ones specifically linked to acceptance of biased content. Crucially, these features may be used to detect the transmission of hidden biases in real-life applications.

该项目的总体目标是确定人工智能如何使用自然语言以透明和无偏见的方式说服人类。人工智能系统正在成为我们日常生活中不可或缺的一部分，从YouTube或Netflix上的简单推荐，到改变生活的决定，如入围求职者或推荐贷款。然而，这些系统缺乏透明度和客观的公平指标，产生了人们理解不深的“建议”，可能会在整个社会范围内助长越来越大规模的偏见决策。基于性别而区别对待个人的带有偏见的建议尤其令人关切（例如在就业方面）。发现和消除这种偏见是非常困难的。它源于刻板的人类标签和分类，这些标签和分类存在于通常用于训练AI的庞大的拼凑数据集中。由于这种偏见是“隐藏的”，因此它对与人工智能互动的人类的传播相应地很难建立，甚至更难消除。在这篇博士论文中，我们提出并测试了一种新颖的解决方案，该解决方案将实验心理学与计算科学相结合，提供了一种检测人工智能的偏见建议何时传递到人类判断中的方法。学生将设计自己的人工智能，其中已知的性别偏见模式，从我们对认知刻板印象的工作中衍生出来，可以“注入”。使用先进的自然语言模型，人工智能将在一系列研究中与人类参与者进行简短的“对话”，这些研究将提供关于拒绝或遵守偏见和无偏见建议的行为的丰富数据来源。使用尖端的机器学习技术，学生将分析这个新的定制数据集，以识别信号说服的语言特征。在这些特征中，学生将寻求孤立那些与接受有偏见的内容特别相关的特征。至关重要的是，这些特征可以用来检测现实生活中应用程序中隐藏的偏见的传播。