Collaborative Research: Differentiable and Expressive Simulators for Designing AI-enabled Robots

这个项目开发了一种新颖的、原则性的和系统的方法来缩小机器人技术中所谓的模拟到真实的差距。这项工作带来了未来机器人技术的突破，以及支撑美国汽车、航空航天和太空探索等行业的计算机辅助工程。因此，这一奖项的结果给社会带来了好处，增加了美国的竞争力。这个项目产生知识并建立算法，使计算机模拟能够减少工程智能和安全机器人的设计时间和成本。人工智能(AI)有望赋予下一代机器人移动性和决策技能。然而，实验和获取大量的训练数据封装了机器人与其环境之间的物理交互作用，对于机器人和实践者来说可能是昂贵的，有时还会有风险。现有的仿真技术提供了虚拟试验台，机器人可以在其中高效和安全地学习，但有一个主要缺点-通过计算机模拟设计的机器人在部署到真实世界时，操作方式不同，往往效率较低，这被称为模拟与真实的差距。该奖项支持基础研究，以减少并尽可能消除模拟与现实的差距，释放支持人工智能的机器人的全部潜力。开发的新的建模技术和数值算法能够通过结合众所周知的物理方程和从数据中学习的经验特征来准确地捕捉真实世界的现象。该项目还推进了机器人技术的最先进水平，并扩大了来自代表性不足群体的高中生对计算的参与。目前，机器人模拟器受到两个主要问题的阻碍。首先，使用的机器人模型不够准确和表现力。其次，寻求改进这些模型的方法既费力又特定于机器人。这项研究的目的是创建新一代可表达和可区分的模拟器来解决这两个问题。如果模拟器有能力捕捉感兴趣的物理，那么它就是有表现力的。可微模拟器是一种除了预测机器人的时间演化外，还可以产生梯度信息的模拟器，从而允许模拟器自动调整以更好地匹配真实世界。研究团队专注于建立数学基础，建立具有可学习组件的机器人模拟器的原型，研究在机器人应用中利用这些模拟器的实用方法，并评估可表达和可区分的模拟器在缩小模拟与真实之间的差距方面的影响。该项目由跨部门机器人基础研究计划支持，由工程总监(ENG)和计算机和信息科学与工程(CEISE)共同管理和资助。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

This project develops a novel principled and systematic approach to closing the so-called sim-to-real gap in robotics. The work delivers a breakthrough in future robot technologies, as well as Computer Aided Engineering, which anchors US industries such as automotive, aerospace, and space exploration. Therefore, results from this award bring benefits to the society and increase US competitiveness. This project produces knowledge and establishes algorithms that enable computer simulation to reduce design time and costs in engineering intelligent and safe robots. Artificial intelligence (AI) is poised to endow the next generation of robots with mobility and decision-making skills. However, experimentation and acquisition of large amounts of training data encapsulating physical interaction between the robot and its environment can be costly and sometimes risky to the robots and practitioner. Existing simulation techniques provide virtual testbeds in which the robot can learn efficiently and safely, but have one major drawback - robots designed via computer simulation operate differently, often less effectively, when deployed to the real world, which is called the sim-to-real gap. This award supports fundamental research to reduce, and whenever possible eliminate, the sim-to-real gap, unlocking the full potential of AI-enabled robots. The new modeling techniques and numerical algorithms developed are able to accurately capture the phenomena of the real world by combining well-known physics equations and empirical traits learned from data. The project also advances the state of the art in robotic technologies and broaden the participation in computing of high-school students from underrepresented groups. Presently, robotic simulators are hampered by two main problems. First, the robot models used are not accurate and expressive enough. Second, the methods that seek to improve these models are both laborious and robot specific. This research aims to create a new generation of expressive and differentiable simulators to address both problems. A simulator is expressive if it has the ability to capture the physics of interest. A “differentiable simulator” is one that in addition to predicting the time evolution of a robot, can also produce gradient information, thus allowing the simulator to be automatically adjusted to better match the real world. The research team focuses on establishing the mathematical foundation, prototyping robotics simulators with learnable components, investigating practical ways to leverage these simulators in robotic applications, and evaluating the impacts of expressive and differentiable simulators on closing the sim-to-real gap.This project is supported by the cross-directorate Foundational Research in Robotics program, jointly managed and funded by the Directorates for Engineering (ENG) and Computer and Information Science and Engineering (CISE).This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.