NRI: FND: COLLAB: Coordinating Human-Robot Teams in Uncertain Environments

NRI：FND：COLLAB：在不确定环境中协调人机团队

• 批准号: 1734482
• 负责人: Laurel Riek
• 金额: $ 37.5万
• 依托单位: University of California-San Diego
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1734482&HistoricalAwards=false
• 关键词: NRI; FND; COLLAB; Coordinating; Human

The decreasing cost and increasing sophistication of robot hardware is creating new opportunities for teams of robots to be deployed in combination with skilled humans to support and augment labor-intensive and/or dangerous manual work. The vision is for robots to free up time of skilled workers so they can focus on the tasks that they are skilled at (complex problem solving, dextrous manipulation, customer service, etc.) and robots can help with the distracting and frustrating parts of working, such as delivering materials or fetching supplies. This vision is being realized across many sectors of the US economy and abroad, such as in warehouse management, assembly manufacturing, and disaster response. However, progress in this area is being stymied by current methods that are rigid and inflexible, and rely on unrealistic models of human-robot interaction. This project seeks to overcome these problems by proposing new models and methods for teams robots to coordinate with teams humans to complete complex problems. In particular, this project will create and solve realistic models for coordinating teams of humans and robots in uncertain environments. The PIs will investigate innovative approaches to this research area, and will make the following contributions: 1) Enable a transformative re-conceptualization of multi-human multi-robot teamwork the accurately reflects the strengths and limitations of the team, as situated within a temporally dynamic, stochastic environment, 2) develop realistic and general models of human-robot teamwork that consider uncertainty and partial observability, and 3) Contribute innovative and scalable techniques for planning and learning in these models. This research will build off of methods that have been successful in single-robot problems under uncertainty and partially observability: partially observable Markov decision processes (POMDPs). POMDPs model robots and environments, but not humans. However, explicitly including people in these models will be critical in almost all real-world applications. By extending POMDPs to multiple robots interacting with teams of humans, complex and realistic problems with mixed human and robot teams can be represented. The solution methods developed in this project will allow the robots to reason about the uncertainty about the domain and their human teammates, while optimizing their behavior. The methods are broadly applicable to human-robot collaboration domains, but they will be evaluated in an emergency department, an environment with a large amount of uncertainty and many delivery and supply tasks during high-volume times. A team of robots can assist in these tasks. Experiments will take place in simulation and in the UC San Diego Simulation and Training Center with various numbers of humans and robots. The results of this project have the potential to transform the way human-robot coordination is performed.

机器人硬件成本的降低和复杂性的提高为机器人团队与熟练的人类一起部署创造了新的机会，以支持和增强劳动密集型和/或危险的手工工作。机器人的愿景是为技术工人腾出时间，使他们能够专注于他们擅长的任务（解决复杂问题，操作机器人，客户服务等）。机器人可以帮助解决工作中分散注意力和令人沮丧的部分，例如运送材料或获取供应品。这一愿景正在美国经济和国外的许多部门实现，例如仓库管理，装配制造和灾难响应。然而，这一领域的进展受到当前方法的阻碍，这些方法既僵化又不灵活，并且依赖于不切实际的人机交互模型。该项目旨在通过提出新的模型和方法来克服这些问题，使团队机器人与团队人类协调完成复杂的问题。特别是，该项目将创建和解决现实模型，用于在不确定的环境中协调人类和机器人团队。PI将研究这一研究领域的创新方法，并将做出以下贡献：1）实现多人多机器人团队合作的变革性重新概念化，准确反映团队的优势和局限性，如位于时间动态的随机环境中，2）开发考虑不确定性和部分可观察性的人类-机器人团队合作的现实和通用模型，以及3）为这些模型中的规划和学习贡献创新和可扩展的技术。这项研究将建立在不确定性和部分可观测性下的单机器人问题中取得成功的方法：部分可观测马尔可夫决策过程（POMDPs）。POMDPs模拟机器人和环境，但不模拟人类。然而，在这些模型中显式地包括人在几乎所有的现实世界的应用程序将是至关重要的。 通过将POMDPs扩展到与人类团队交互的多个机器人，可以表示混合人类和机器人团队的复杂和现实问题。在这个项目中开发的解决方案方法将允许机器人对域及其人类队友的不确定性进行推理，同时优化它们的行为。这些方法广泛适用于人机协作领域，但它们将在急诊室进行评估，这是一个具有大量不确定性的环境，并且在大量时间内有许多交付和供应任务。一组机器人可以协助完成这些任务。实验将在模拟和加州大学圣地亚哥分校模拟和培训中心进行，有不同数量的人类和机器人。该项目的结果有可能改变人机协调的方式。

项目成果

REGROUP: A Robot-Centric Group Detection and Tracking System

• DOI: 10.1109/hri53351.2022.9889634
• 发表时间: 2022-03
• 期刊: 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
• 作者: Angelique Taylor;L. Riek

Fluent Coordination in Proximate Human Robot Teaming

• 发表时间: 2019
• 作者: S. Matsumoto;L. Riek

Unseen Salient Object Discovery for Monocular Robot Vision

• DOI: 10.1109/lra.2020.2968059
• 发表时间: 2020-04
• 期刊: IEEE Robotics and Automation Letters
• 影响因子: 5.2
• 作者: Darren M. Chan;L. Riek

Situating Robots in the Emergency Department

• 发表时间: 2020
• 作者: Angelique Taylor;S. Matsumoto;L. Riek

Robot-Centric Perception of Human Groups

• DOI: 10.1145/3375798
• 发表时间: 2020-05
• 期刊: ACM Transactions on Human-Robot Interaction (THRI)
• 作者: Angelique Taylor;Darren M. Chan;L. Riek