NRI: Collaborative Research: A Framework for Hierarchical, Probabilistic Planning and Learning

NRI：协作研究：分层、概率规划和学习的框架

• 批准号: 1637937
• 负责人: Cynthia Matuszek
• 金额: $ 36.54万
• 依托单位: University of Maryland Baltimore County
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-09-01 至 2020-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1637937&HistoricalAwards=false
• 关键词: NRI; Collaborative; Research; Framework; Hierarchical

This project is an effort to create a unified framework for solving very large problems with uncertain states and actions, such as manipulator robots acting in real-world environments. The results may have especially great promise for assistive technologies, including autonomous robots that can be used by elderly and disabled populations to aid them in their daily activities. The proposed integrated framework will represent, apply, and learn hierarchical domain knowledge, and will include the ability to transfer knowledge from simpler problems to more complex ones. The research will enable autonomous agents to develop a structured representation of complex domains based on experience. The agents will use learned representations to interpret natural language commands for both low-level and high-level requests. The technical focus is enabling tractable planning in large, uncertain domains by generating and leveraging probabilistic domain knowledge at multiple levels of abstraction. Agents will autonomously create layered representations in which the layers build on one another to produce complex behaviors. Agents will learn to perform useful behaviors, such as navigating using low-level sensor feedback or assembling complex objects such as a bridge or a table. The key technical contributions will be methods for (1) planning in large state/action spaces using the abstract object-oriented Markov decision process (AMDP) model, a new formalism for representing probabilistic domain knowledge at multiple levels of abstraction; (2) learning hierarchical task knowledge in the form of AMDPs; and (3) interpreting natural language commands at multiple levels of abstraction by mapping to the learned hierarchical structure. The formalism will be demonstrated and validated in several domains, including a simulated "cleanup" toy domain, challenging and complex video games, and a robot manipulation task.

该项目致力于创建一个统一的框架，用于解决具有不确定状态和动作的大型问题，例如在现实环境中操作的机械手机器人。 这些结果可能对辅助技术有着特别大的希望，包括可供老年人和残疾人使用的自主机器人，以帮助他们进行日常活动。 拟议的综合框架将代表，应用和学习层次领域知识，并将包括知识从简单的问题转移到更复杂的能力。这项研究将使自主代理开发一个结构化的表示复杂的领域的经验的基础上。代理将使用学习的表示来解释低级和高级请求的自然语言命令。 技术重点是通过在多个抽象层次上生成和利用概率领域知识，在大型不确定领域中实现易于处理的规划。智能体将自主创建分层表示，其中各层相互建立以产生复杂的行为。智能体将学习执行有用的行为，例如使用低级传感器反馈进行导航或组装复杂的对象，例如桥梁或桌子。 关键的技术贡献将是（1）使用抽象面向对象的马尔可夫决策过程（AMDP）模型在大的状态/动作空间中进行规划的方法，AMDP模型是一种在多个抽象层次上表示概率领域知识的新形式主义;（2）以AMDP的形式学习分层任务知识;以及（3）通过映射到所学习的分层结构来在多个抽象级别上解释自然语言命令。形式主义将在几个领域，包括模拟的“清理”玩具领域，具有挑战性和复杂的视频游戏，和机器人操作任务进行演示和验证。

项目成果

The Expected-Length Model of Options

期权的预期长度模型

• 发表时间: 2019
• 期刊: IJCAI
• 作者: David Abel*, John Winder*

A Spoken Language Dataset of Descriptions for Speech-Based Grounded Language Learning

• DOI: 10.13016/m2bmhe-tmzc
• 发表时间: 2021-06
• 作者: Gaoussou Youssouf Kebe;Padraig Higgins;Patrick Jenkins;Kasra Darvish;Rishabh Sachdeva;Ryan Barron

Planning with Abstract Markov Decision Processes

• DOI: 10.1609/icaps.v27i1.13867
• 发表时间: 2017-06
• 作者: N. Gopalan;Marie desJardins;M. Littman;J. MacGlashan;S. Squire;Stefanie Tellex;J. Winder;Lawson L. S. Wong

Planning with Abstract Learned Models While Learning Transferable Subtasks

在学习可转移子任务的同时使用抽象学习模型进行规划

• DOI: 10.1609/aaai.v34i06.6555
• 发表时间: 2020
• 期刊: Proceedings of the AAAI Conference on Artificial Intelligence
• 作者: Winder, John;Milani, Stephanie;Landen, Matthew;Oh, Erebus;Parr, Shane;Squire, Shawn;desJardins, Marie;Matuszek, Cynthia
• 通讯作者: Matuszek, Cynthia

Towards Making Virtual Human-Robot Interaction a Reality

使虚拟人机交互成为现实

• 发表时间: 2021
• 期刊: and Mixed-Reality for Human-Robot Interactions (VAM-HRI
• 作者: Higgins, Padraig;Kebe, Gaoussou Youssouf;Berlier, Adam;Darvish, Kasra;Engel, Don;Ferraro, Francis;Matuszek, Cynthia
• 通讯作者: Matuszek, Cynthia