Agents that Converse

交谈的代理

• 批准号: 2885103
• 金额: --
• 依托单位: University of Oxford
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2023
• 资助国家: 英国
• 起止时间: 2023 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2885103
• 关键词: Agents; Converse

This research project aims to bridge the gap between task-specific AI and conversational AI models. On one hand, task-specific AI models have reached super-human ability in many areas such as logistics planning, microchip layout optimization, games and various control problems, but remain largely black-box models, with little avenue for obtaining explanations or collaboratively refining proposed solutions. On the other hand, conversational AI models naturally interface with humans through conversations, but usually lack superhuman capability in the goal oriented behaviours that task specific AIs excel at.Through this combination of conversational AI and task-specific AI I aim to engage with some of the following questions. How can we use natural language to make requests from learnt agents acting in an environment? How can we train an agent acting in an environment to be able to provide justifications or explanations for their actions in natural language? How can we improve the performance of an agent learning from experiential data by supplementing it with domain-related natural language data?To do this I will explore avenues for making conversational AI agents more adept at goal oriented behaviour, even in tasks that are not natural language-based in nature through avenues that utilise what we already know about training performant task-specific AI. One approach would be through jointly training a task-specific AI model with a conversational model in a way that the representations they learn about the world are compatible. Other approaches involve starting with a powerful pretrained conversational model and fine-tuning it to excel at a task that is usually performed by task-specific AI. For the latter kind of approach, research is needed in order to learn how to do this while retaining the model's conversational abilities. Because, in general, training models to learn new skills tends to make them forget previously learnt skills.Through training these models we will be able to obtain models that are more interpretable and collaborative. This is becoming increasingly more important in an age where AI models are increasingly used in making decisions that affect human lives. Making these decisions more interpretable is necessary for making overall processes that utilise AI-decision-making fairer. Furthermore, making these AIs conversational will change the paradigm from one where a model makes a single final indisputable decision, to one where people can work collaboratively with a model until a final decision is reached.This project falls within the EPSRC AI and Robotics research area and is conducted under the supervision of Professor Jakob Foerster

该研究项目旨在弥合特定任务AI和会话AI模型之间的差距。一方面，特定于任务的人工智能模型在物流规划、微芯片布局优化、游戏和各种控制问题等许多领域已经达到了超人的能力，但在很大程度上仍然是黑箱模型，几乎没有获得解释或协作改进建议解决方案的途径。另一方面，对话式AI模型通过对话自然地与人类交互，但通常缺乏任务特定AI擅长的目标导向行为的超人能力。通过对话式AI和任务特定AI的结合，我的目标是解决以下一些问题。我们如何使用自然语言向在环境中活动的学习代理提出请求？我们如何训练一个在环境中行动的智能体，使其能够用自然语言为自己的行为提供理由或解释？我们如何通过补充领域相关的自然语言数据来提高智能体从经验数据中学习的性能？为了做到这一点，我将探索使会话AI代理更擅长目标导向行为的途径，即使在本质上不是基于自然语言的任务中，也可以通过利用我们已经知道的训练特定任务AI的途径。一种方法是通过联合训练特定于任务的人工智能模型和会话模型，使它们学习到的关于世界的表示是兼容的。其他方法包括从一个强大的预训练会话模型开始，并对其进行微调，以擅长通常由特定任务AI执行的任务。对于后一种方法，需要进行研究，以了解如何在保持模型的会话能力的同时做到这一点。因为，一般来说，学习新技能的训练模型往往会让他们忘记以前学过的技能。通过训练这些模型，我们将能够获得更具可解释性和协作性的模型。在人工智能模型越来越多地用于做出影响人类生活的决策的时代，这一点变得越来越重要。使这些决策更具可解释性对于使利用人工智能决策的整体流程更加公平是必要的。此外，使这些人工智能对话将改变模式，从一个模型做出单一的最终无可争议的决定，到一个人可以与模型合作，直到最终决定。该项目福尔斯EPSRC人工智能和机器人研究领域，并在Jakob Foerster教授的监督下进行