FMitF: Track I: Program Synthesis for Robot Learning from Demonstrations

FMITF：轨道 I：机器人从演示中学习的程序综合

• 批准号: 2319471
• 负责人: Isil Dillig
• 金额: $ 75万
• 依托单位: University of Texas at Austin
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2027-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2319471&HistoricalAwards=false
• 关键词: FMitF; Track; Program; Synthesis; Robot

As robots become more widely available and more capable, end-users of such consumer robots will inevitably expect to be able to teach robots how to perform new tasks. Learning from demonstration (or LfD, for short) is a popular paradigm for this problem, where a user demonstrates how to perform the task, and the robot learns a policy that captures what sequence of actions to perform to complete the task. Most existing LfD techniques rely on neural networks to learn such policies. While promising in some settings, such techniques suffer from key limitations, such as requiring large amounts of training data and lacking interpretability. This project's novelties are in addressing these limitations for robot LfD by combining neural networks (which are very effective for perception tasks) with symbolic learning, which excels at reasoning skills. The project's impacts are 1) introducing a new language to seamlessly merge learning programs consisting of both neural- and symbolic- components, 2) providing guarantees that the learned programs satisfy desired notions of correctness, and 3) allowing such learning to be performed with more realistic, noisy, real-world data. The project's contributions also include training and mentoring of students, developing novel teaching curriculum that integrate robotics with formal methods, and empowering more scalable, safe, and interpretable learning for robots. The research objective of this project is to develop a new LfD paradigm based on program synthesis, with the goal of putting robot learning on a more formal, interpretable, and less data-hungry footing. The key intellectual merit of the project lies in the development of a new set of foundational LfD techniques based on program synthesis. The project will advance the state-of-the-art in robot learning from demonstration by making it possible to learn, in a data-efficient way, programmatic policies that are interpretable and verifiable. The project will also advance the state-of-the-art in program synthesis by developing novel techniques that target the unique challenges of the robotics domain, including noisy and high-dimensional sensor data and uncertain interactions with the environment. In addition, the project will also advance the state-of-the-art in verified learning by considering desired correctness criteria. Finally, the project will make advances in the field of learning from unlabeled demonstrations by learning robot execution policies in the absence of a mapping from states to high-level robot actions.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

随着机器人变得越来越广泛，能力越来越强，这种消费机器人的最终用户将不可避免地期望能够教机器人如何执行新任务。从演示中学习（或简称LfD）是这个问题的一个流行范例，其中用户演示如何执行任务，机器人学习一个策略，该策略捕获要执行的动作序列以完成任务。大多数现有的LfD技术依赖于神经网络来学习这些策略。虽然在某些情况下很有前途，但这些技术受到关键限制，例如需要大量的训练数据和缺乏可解释性。该项目的新颖之处在于通过将神经网络（对感知任务非常有效）与擅长推理技能的符号学习相结合，解决了机器人LfD的这些限制。该项目的影响是1）引入一种新的语言来无缝合并由神经和符号组件组成的学习程序，2）提供学习程序满足所需正确性概念的保证，以及3）允许使用更真实，嘈杂，真实世界的数据进行这种学习。该项目的贡献还包括培训和指导学生，开发将机器人技术与正式方法相结合的新型教学课程，以及为机器人提供更具可扩展性，安全性和可解释性的学习。该项目的研究目标是开发一种基于程序合成的新LfD范式，目标是将机器人学习置于更正式，可解释和更少数据饥饿的基础上。该项目的主要智力价值在于开发了一套基于程序合成的新的基础LfD技术。该项目将通过以数据高效的方式学习可解释和可验证的编程策略，推进机器人学习的最新技术。该项目还将通过开发针对机器人领域独特挑战的新技术，包括噪声和高维传感器数据以及与环境的不确定交互，来推进程序合成的最新技术。此外，该项目还将通过考虑所需的正确性标准来推进验证学习的最新技术。最后，该项目将通过在没有从状态到高级机器人动作的映射的情况下学习机器人执行策略，在从未标记的演示中学习的领域取得进展。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。