RI: Small: Extracting Knowledge from Language Models for Decision Making

RI：小型：从语言模型中提取知识以进行决策

• 批准号: 2246811
• 负责人: Sergey Levine
• 金额: $ 60万
• 依托单位: University of California-Berkeley
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-09-15 至 2026-08-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2246811&HistoricalAwards=false
• 关键词: RI; Small; Extracting; Knowledge; Language

This project aims to integrate semantic knowledge from large language models into automated decision-making and control systems while retaining reliability and robustness. The main principle of the proposed approach is to use language models to generate proposals and guidance, but still make the final decision or plan based on principled and robust planning and control methods, such that the language models are used when their semantic predictions are useful but not relied upon to always yield the correct answer. Large language models, such as ChatGPT, have garnered considerable attention in recent years due to their ability to respond to complex user queries and fulfill elaborate requests, such as writing code, composing stories, or providing educational explanations. Because of this, there is considerable interest in using them directly as decision-making systems (for example, if a language model can give “how to” instructions for repairing a car, perhaps it can also issue commands to a robot that actually repairs a car). However, there are also numerous concerns that such models might be too unreliable or too prone to generate false predictions to be useful as decision-making systems on their own. Therefore, this project aims to integrate these models into principled methods for planning and control to leverage the semantic knowledge in these models while providing a degree of robustness. This research has significant ramifications for automated decision-making systems that need to interact with complex real-world environments, where both semantic reasoning and intelligent planning are important. This includes robotic systems, including autonomous vehicles and service robots, intelligent assistants, decision support systems, and a range of automation technologies.The technical approach in this project will be based around a probabilistic formulation that ties together the ungrounded semantic predictions from language models with grounded but non-semantic predictions from learned dynamics models. In this way, probabilistic inference machinery can be used to derive algorithms that make decisions that have a high likelihood of being semantically good according to the language model and a high likelihood of being physically (dynamically) optimal according to the learned dynamics model. In practice, this principle can be instantiated in the context of both model-based and model-free reinforcement-learning systems, learned prediction systems, and planning algorithms (by formulating planning as inference). The project will explore applications of this concept to prediction, planning and control, and exploration in reinforcement learning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目旨在将大型语言模型的语义知识集成到自动化决策和控制系统中，同时保持可靠性和鲁棒性。该方法的主要原则是使用语言模型来生成建议和指导，但仍然基于原则性和稳健的规划和控制方法做出最终决策或计划，以便在语义预测有用但不依赖于总是产生正确答案时使用语言模型。近年来，诸如 ChatGPT 之类的大型语言模型因其能够响应复杂的用户查询并满足复杂的请求（例如编写代码、撰写故事或提供教育解释）而引起了相当大的关注。正因为如此，人们对直接将它们用作决策系统非常感兴趣（例如，如果语言模型可以给出修理汽车的“如何”指令，那么它也许也可以向实际修理汽车的机器人发出命令）。然而，也有很多人担心这些模型可能太不可靠或太容易产生错误的预测，无法单独用作决策系统。因此，该项目旨在将这些模型集成到规划和控制的原则方法中，以利用这些模型中的语义知识，同时提供一定程度的鲁棒性。这项研究对于需要与复杂的现实环境交互的自动化决策系统具有重大影响，其中语义推理和智能规划都很重要。这包括机器人系统，包括自动驾驶车辆和服务机器人、智能助手、决策支持系统和一系列自动化技术。该项目的技术方法将基于概率公式，将语言模型的无根据的语义预测与学习的动力学模型的有根据的但非语义的预测联系在一起。通过这种方式，概率推理机制可用于导出算法，这些算法做出的决策根据语言模型很有可能在语义上是好的，并且根据学习的动态模型很有可能在物理（动态）上是最优的。在实践中，这一原理可以在基于模型和无模型的强化学习系统、学习预测系统和规划算法（通过将规划制定为推理）的背景下实例化。该项目将探索这一概念在预测、规划和控制以及强化学习探索中的应用。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。