Robots Teaching Robots: Real-time Optimal Control of Complex Engineering Systems

该项目引入了学习者-助手机器人对，使学习机器人能够在不需要精确的解析或数值模型的情况下，通过物理实验来提高其在重复任务中的性能。具体的挑战是，这些任务--例如用两条腿走路或骑自行车--需要最低必要的性能水平，低于这个水平，机器人就无法发挥作用。在这些例子中，这种最低水平的能力对应于不摔倒。帮助者满足这些最低要求，而学习者则使用重复的尝试来提高其性能。例如，助手可以将两条腿的步行者悬挂在旅行安全带上，或者沿着自行车机器人移动，以提供额外的支撑点。随着学习者-帮助者团队掌握了任务，帮助者可以申请的帮助量逐渐减少，直到学习者自己表现出高水平。一个类比是，一个孩子在旁边移动的成年人的帮助下学习骑自行车。这种新的控制技术将使机器人能够在未来工厂的训练线上教授机器人，类似于目前制造公司装配线上使用的机器人。因此，这项研究的结果将有利于美国的经济和社会。这项研究还涉及多个学科，包括机械、电气、计算机和控制工程。多学科方法预计将扩大未被充分代表的群体在研究中的参与并对工程教育产生积极影响。最优控制是控制理论的一个分支，有可能彻底改变智能工程系统、工业机器人、手术机器人和辅助机器人的创造，这些机器人可以通过重复经验改进，有点类似人类。控制工程系统的最优控制技术有很多。然而，目前几乎所有可用的技术都需要高保真的模型或大量的测量数据来缓解所谓的模拟与现实之间的差距，即计算机模拟预测的最佳性能与实际工程应用中观察到的非最佳性能之间的差距。该奖项支持基础研究，以缩小最优控制应用于工程系统时模拟与现实之间的差距。基于模型的最优控制技术实现了高效的计算，但它们受到保守控制性能的约束。数据驱动的最优控制技术缓解了不确定模型的不利影响，但要做到这一点，它们需要大量的训练数据。因此，必须克服科学障碍，才能充分发挥最优控制技术的应用潜力。这项研究将解决最优控制理论应用于复杂工程系统时限制其潜力和理论前景的知识鸿沟。这项新技术通过由专门的教师机器人指导的实时实验来促进系统性能的优化，而不是仅仅通过基于不确定模型的预测和测量数据来指导优化系统性能。这项技术提供了一种变革性的方法来控制这类复杂、驱动不足和不稳定的机器人，对这些机器人来说，获得高保真模型是具有挑战性的，同时收集训练数据也很耗时。研究成果可能会为创造下一代智能机器提供主流范例。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

This project introduces learner-helper robot pairs to enable the learner robot to use physical experimentation to improve its performance on repetitive task, without accurate analytical or numerical models. The specific challenge is that these tasks -- for example walking on two legs or riding a bicycle -- require a minimal necessary level of performance, below which the robot is unable to function. In the examples, this minimal level of ability corresponds to not falling over. The helper satisfies these minimal requirements while the learner uses repeated trials to improve its performance. For example, the helper might suspend the two-legged walker from a traveling harness or move alongside the bicycle robot providing an additional point of support. As the learner-helper team masters the task, the amount of assistance that the helper can apply is gradually reduced, until the learner is performing at a high level on its own. An analogy is a child learning to ride a bike with the help of an adult moving alongside. The new control technique will enable robots to teach robots in training lines of future factories similar to robots currently used in assembly lines of manufacturing companies. Therefore, the results of this research will benefit the U.S. economy and society. This research also involves several disciplines including mechanical, electrical, computer, and control engineering. The multi-disciplinary approach is expected to broaden the participation of underrepresented groups in research and positively impact engineering education.Optimal control is a branch of control theory that has the potential to revolutionize the creation of intelligent engineering systems, industrial robots, surgical robots, and assistive robots that can improve by repeated experience, somewhat similar to humans. There are many optimal control techniques to control engineering systems. However, almost all currently available techniques require high-fidelity models or a large amount of measured data to mitigate the so-called simulation-reality gap; the gap between the optimal performance predicted by computer simulations and the non-optimal performance observed in real engineering applications. This award supports fundamental research to close the simulation-reality gap when optimal control is applied to engineering systems. Model-based optimal control techniques enable efficient computation but they are subject to conservative control performance. Data-driven optimal control techniques mitigate the detrimental effect of uncertain models, but to do so, they require a large amount of training data. Therefore, scientific barriers must be overcome to realize the full application potential of optimal control techniques. This research will address the knowledge gap that limits the potential and theoretical promise of optimal control theory when applied to complex engineering systems. The new technique promotes optimization of system performance via real-time experiments guided by dedicated teacher robots, instead of optimizing system performance guided only by uncertain model-based predictions and measured data. The technique delivers a transformative approach to control the class of complex, underactuated, and unstable robots, for which obtaining high-fidelity models is challenging, while gathering training data is time-consuming. The research outcomes could potentially provide mainstream paradigms in creating next-generation intelligent machines.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.