CAREER: Re-Thinking the Perception-Action Paradigm for Agile Autonomous Robots

职业：重新思考敏捷自主机器人的感知-行动范式

• 批准号: 2145277
• 负责人: Giuseppe Loianno
• 金额: $ 60万
• 依托单位: New York University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-04-15 至 2027-03-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2145277&HistoricalAwards=false
• 关键词: CAREER; Re; Thinking; Perception; Action

Autonomous robots will become pervasive in our society and will solve complex tasks, actively collaborating with each other and with humans. As the recent COVID-19 outbreak has highlighted, autonomous robots can solve a range of time-sensitive problems including logistics, reconnaissance, and disinfection of critical areas. Beyond pandemic, small-scale robots can help humans in complex or dangerous tasks such as search and rescue, security, and surveillance, and, thanks to their lighter weight, they pose only a modest risk to human safety. These time-sensitive tasks require robots to make fast decisions and agile maneuvers in complex and dynamic environments. State-of-the-art autonomous navigation approaches, while mature, are slow and brittle and prevent robust and resilient agile navigation. This Faculty Early Career Development (CAREER) Program studies the fundamental perception-action problem for agile navigation of autonomous robots in complex environments by planning a novel, low-latency, robust, adaptive, safe, and resilient paradigm. This project aims also to educate students on the technical aspects, societal benefits, and ethical use of autonomous systems by establishing a unique multi-disciplinary, and inclusive research and educational platform which includes a core curriculum on robot localization and navigation, and a series of online racing hackathons for a post-pandemic customized and inclusive research and educational experience. These will contribute to lowering the barrier to participation in research and education for students, particularly underrepresented minorities.This project will generate a new foundational theory, which includes models and algorithms resulting from a principled combination of perception, learning, and control to holistically design visual perception and action to create small-scale agile autonomous robots. The goal is to capture the strict cross–coupling effects between perception and action to jointly and concurrently resolve the perception-action problem to speed up the robots’ decision making process and increase their agility. The project is organized in three thrusts according to a series of objectives, culminating in innovations in robotics autonomy research and education. A compressed and unified representation of the perception and action spaces guarantees to reduce the robot's inference latency and naturally reveals the cross-coupling effects among them. Next, the robot will exploit using this representation its action-predictive information to enhance its inference capabilities and will employ an optimal control/planning approach to maximize its perception accuracy and quality.This project is supported by the cross-directorate Foundational Research in Robotics program, jointly managed and funded by the Directorates for Engineering (ENG) and Computer and Information Science and Engineering (CISE).This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

自主机器人将在我们的社会中变得普遍，并将解决复杂的任务，积极地相互协作和与人类合作。正如最近的新冠肺炎疫情所突显的那样，自主机器人可以解决一系列时间敏感的问题，包括物流、侦察和关键区域的消毒。除了流行病，小型机器人还可以帮助人类完成复杂或危险的任务，如搜救、安保和监视，而且由于它们的重量较轻，它们对人类安全的风险很小。这些对时间敏感的任务要求机器人在复杂和动态的环境中做出快速的决策和灵活的机动。最先进的自主导航方法虽然成熟，但速度缓慢且脆弱，不利于稳健和有弹性的敏捷导航。该学院早期职业发展（Career）项目通过规划一种新颖、低延迟、鲁棒、自适应、安全和弹性的范式，研究自主机器人在复杂环境中敏捷导航的基本感知-行动问题。该项目还旨在通过建立一个独特的多学科、包容性的研究和教育平台，向学生传授自主系统的技术方面、社会效益和道德使用，该平台包括机器人定位和导航的核心课程，以及一系列在线竞赛黑客马拉松，以提供大流行后定制的、包容性的研究和教育体验。这将有助于降低学生，特别是代表性不足的少数民族参与研究和教育的障碍。该项目将产生一个新的基础理论，其中包括从感知，学习和控制的原则组合中产生的模型和算法，以整体设计视觉感知和行动，以创建小型敏捷自主机器人。目标是捕捉感知和动作之间的严格交叉耦合效应，共同并发地解决感知-动作问题，以加快机器人的决策过程，提高机器人的敏捷性。根据一系列目标，该项目分为三个重点，最终在机器人自主研究和教育方面进行创新。感知空间和动作空间的压缩统一表示保证了机器人的推理延迟，自然地揭示了它们之间的交叉耦合效应。接下来，机器人将利用这种表示来利用其行动预测信息来增强其推理能力，并将采用最优控制/规划方法来最大化其感知精度和质量。该项目由跨部门机器人基础研究项目支持，由工程（ENG）和计算机与信息科学与工程（CISE）联合管理和资助。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Nonlinear Model Predictive Control for Cooperative Transportation and Manipulation of Cable Suspended Payloads with Multiple Quadrotors

• DOI: 10.1109/iros55552.2023.10341785
• 发表时间: 2023-03
• 期刊: 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
• 作者: Guanrui Li;Giuseppe Loianno

Vision-based Relative Detection and Tracking for Teams of Micro Aerial Vehicles

基于视觉的微型飞行器编队相对检测与跟踪

• DOI: 10.1109/iros47612.2022.9981115
• 发表时间: 2022
• 期刊: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS
• 作者: Ge, Rundong;Lee, Moonyoung;Radhakrishnan, Vivek;Zhou, Yang;Li, Guanrui;Loianno, Giuseppe
• 通讯作者: Loianno, Giuseppe

Geometric Fault-Tolerant Control of Quadrotors in Case of Rotor Failures: An Attitude Based Comparative Study

转子故障情况下四旋翼飞行器的几何容错控制：基于态度的比较研究

• DOI: 10.1109/iros55552.2023.10341669
• 发表时间: 2023
• 期刊: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS
• 作者: Yeom, Jennifer;Li, Guanrui;Loianno, Giuseppe
• 通讯作者: Loianno, Giuseppe

RotorTM: A Flexible Simulator for Aerial Transportation and Manipulation

• DOI: 10.1109/tro.2023.3336320
• 发表时间: 2022-05
• 期刊: IEEE Transactions on Robotics
• 影响因子: 7.8
• 作者: Guanrui Li;Xinyang Liu;Giuseppe Loianno

Long-Range UAV Thermal Geo-Localization with Satellite Imagery

• DOI: 10.1109/iros55552.2023.10342068
• 发表时间: 2023-06
• 期刊: 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
• 作者: Jiuhong Xiao;Daniel Tortei;E. Roura;Giuseppe Loianno