CAREER: Interplay between Control Theory and Machine Learning

职业：控制理论和机器学习之间的相互作用

• 批准号: 2048168
• 负责人: Bin Hu
• 金额: $ 50万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-03-01 至 2026-02-28
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2048168&HistoricalAwards=false
• 关键词: CAREER; Interplay; between; Control; Theory

Control and machine learning are two high-impact research areas. Both are important for managing complex systems such as self-driving vehicles, humanoid robotics, smart buildings, and automated healthcare. This CAREER proposal aims at building fundamental connections between control theory and machine learning. On one hand, control theory provides mathematically rigorous tools for addressing the robustness requirement of modern safety-critical systems such as commercial aircraft and nuclear plants. On the other hand, machine learning techniques have been used to achieve the state-of-the-art performance for many artificial intelligence tasks in computer vision, natural language processing, and Go. A rapprochement of control theory and machine learning will significantly broaden the class of engineering problems that can be solved efficiently. This proposal aims at reconciling these two areas with a comprehensive interdisciplinary approach that spans and connects the forefronts of robust control theory, nonlinear system theory, jump system theory, supervised learning, reinforcement learning, imitation learning, semidefinite programming, and non-convex optimization. The proposed research will lay the theoretical foundation for reliable integration of control and machine learning in modern safety-critical intelligent systems. The research progress will promote multidisciplinary collaborations and benefit the researchers from learning, control, optimization, artificial intelligence, autonomy, and robotics. In addition, the research will be strongly coupled with educational developments which will promote students from different departments to develop solid multidisciplinary proficiency. New course materials resulting from the research will provide new concepts and ideas to inspire the next generation of academic and industrial leaders.This proposal takes an interdisciplinary perspective on machine learning and control. The proposed research is centered around two thrusts. The first thrust focuses on tailoring control theory to unify, streamline, and automate the analysis and design of machine learning algorithms. Specifically, algorithms in supervised/reinforcement/unsupervised learning will be modeled as Markovian jump systems and nonlinear systems which have been extensively studied in controls literature. The combination of this idea with modern control-theoretical tools such as stochastic dissipation inequalities will pave the way for a unified principled approach to the design of high-performance algorithmic pipelines in machine learning. The second thrust focuses on borrowing recent results in non-convex learning to push control theory beyond the convex optimization regime. The recently developed non-convex learning theory will be leveraged to derive various theoretical guarantees for non-convex optimization problems in control. The proposed research is expected to advance the state-of-the-art algorithms in large-scale control and broaden the class of nonlinear/robust control problems that can be solved with guarantees. The proposed research covers both “control for learning” and “learning for control,” deepening the connections of control and learning by showing that the techniques used by each side can be explored to impact the other side.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

控制和机器学习是两个高影响力的研究领域。两者对于管理复杂系统，例如自动驾驶汽车，人形机器人技术，智能建筑物和自动化医疗保健都很重要。该职业建议旨在建立控制理论与机器学习之间的基本联系。一方面，控制理论提供了数学上严格的工具，以解决现代关键安全系统（例如商用飞机和核电站）的鲁棒性要求。另一方面，已经使用机器学习技术来实现计算机视觉，自然语言处理和GO中许多人工智能任务的最新性能。控制理论和机器学习的和解将大大扩大可以有效解决的工程问题。该建议旨在通过全面的跨学科方法来调和这两个领域，该方法跨越并连接了健壮控制理论，非线性系统理论，跳跃系统理论，监督学习，增强学习，模仿学习，半冰期编程和非convex优化。拟议的研究将奠定理论基础，以在现代安全至关重要的智能系统中可靠地整合控制和机器学习。研究进度将促进多学科的合作，并使研究人员从学习，控制，优化，艺术智能，自主权和机器人技术中受益。此外，这项研究将与教育发展强烈相结合，这些发展将促进来自不同部门的学生，以发展稳固的多学科水平。研究产生的新课程材料将提供新的概念和思想，以激发下一代的学术和工业领导者。该提案对机器学习和控制有了跨学科的观点。拟议的研究以两个推力为中心。第一个推力着重于裁缝控制理论，以统一，简化和自动化机器学习算法的分析和设计。具体而言，监督/强化/无监督学习中的算法将被建模为Markovian跳跃系统和非线性系统，这些系统已经广泛研究了对照文献。这个想法与现代控制理论工具（例如随机耗散不平等）的结合将为统一的主要方法铺平道路，以设计机器学习中高性能算法管道的设计。第二个推力重点是借用非凸学习的最新结果，将控制理论推向了凸优化制度。最近开发的非凸学习理论将被利用，以得出对控制中非凸优化问题的各种理论保证。拟议的研究有望在大规模控制中推进最新算法，并扩大可以通过保证解决的非线性/鲁棒控制问题类别。拟议的研究涵盖了“学习控制”和“控制控制”，通过表明可以探索双方使用的技术来加深控制和学习的联系，以影响对方。该奖项反映了NSF的法定任务，并被认为是通过基金会的知识分子和更广泛的影响审查审查标准来通过评估来通过评估来支持的。

项目成果

Derivative-Free Policy Optimization for Linear Risk-Sensitive and Robust Control Design: Implicit Regularization and Sample Complexity

线性风险敏感和鲁棒控制设计的无导数策略优化：隐式正则化和样本复杂性

• 发表时间: 2021
• 期刊: Advances in Neural Information Processing Systems 34 (NeurIPS 2021
• 作者: Zhang, Kaiqing;Zhang, Xiangyuan;Hu, Bin;Başar, Tamer
• 通讯作者: Başar, Tamer

Convex Programs and Lyapunov Functions for Reinforcement Learning: A Unified Perspective on the Analysis of Value-Based Methods

• DOI: 10.23919/acc53348.2022.9867291
• 发表时间: 2022-02
• 期刊: 2022 American Control Conference (ACC)
• 作者: Xing-ming Guo;B. Hu

Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-Out

非凸性平均时一类 Polyak-Lojasiewicz 函数重球超越二次函数的可证明加速度

• 发表时间: 2022
• 期刊: International Conference on Machine Learning (ICML
• 作者: Wang, Jun-Kun;Lin, Chi-Heng;Wibisono, Andre;Hu, Bin
• 通讯作者: Hu, Bin

Connectivity of the Feasible and Sublevel Sets of Dynamic Output Feedback Control With Robustness Constraints

具有鲁棒性约束的动态输出反馈控制的可行集和子级集的连通性

• DOI: 10.1109/lcsys.2022.3188008
• 发表时间: 2023
• 期刊: IEEE Control Systems Letters
• 影响因子: 3
• 作者: Hu, Bin;Zheng, Yang
• 通讯作者: Zheng, Yang

Global Convergence of Direct Policy Search for State-Feedback $\mathcal{H}_\infty$ Robust Control: A Revisit of Nonsmooth Synthesis with Goldstein Subdifferential

状态反馈 $mathcal{H}_infty$ 鲁棒控制的直接策略搜索的全局收敛：重新审视 Goldstein 次微分的非平滑综合

• 发表时间: 2022
• 期刊: Advances in neural information processing systems
• 作者: Guo, Xingang;Hu, Bin
• 通讯作者: Hu, Bin