EAGER: Real-Time: Collaborative Research: Unified Theory of Model-based and Data-driven Real-time Optimization and Control for Uncertain Networked Systems

该项目旨在找到一个通用的决策框架，无缝集成离线数据和计算，实时数据和计算，学习和概率预测决策。它提供了一个统一的理论，基于模型和数据驱动的实时优化和控制的不确定网络系统。积分强化学习是集成实时数据驱动方法、基于模型的方法和物理约束的关键。将探索积分强化学习的结构，以研究在具有多个嵌套学习循环的架构中如何以及在何处使用深度学习神经网络。然后，概率时空场景数据驱动的框架将开发网络化工程系统的不确定性下的多尺度顺序控制。开发的算法和工具将用于为直流配电网中的电力电子转换器塑造最佳功率曲线，并有助于减轻间歇性电源、不确定负载需求或故障的不利影响。该项目代表了从现有的大数据和决策研究的根本出发，朝着发展自主决策的不确定性结构下的系统不断增长的规模和时间关键的使命要求。 开发的算法和工具可以扩展到其他智能和连接的领域，例如，空中交通管理、联网的交通排和传感器网络。到2020年，美国微电网容量预计将达到4.3GW。直流配电网是交流配电网的新兴替代品，对于可再生能源资源和电气化运输车队的可扩展整合至关重要。研究成果将被移植到强化学习，最优控制，网络控制系统，数据驱动的分析和决策以及电力电子系统的主题中。该项目协同研究活动之间的得克萨斯大学在阿灵顿（UTA）和得克萨斯州A M-科珀斯克里斯蒂（TAMUCC），HBCU/MI西班牙裔服务机构，并涉及来自电气工程和计算机科学背景的学生。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

The project seeks to find a common decision-making framework that seamlessly integrates offline data and computing, real-time data and computing, learning, and probabilistic predictive decision. It provides a unified theory of model-based and data-driven real-time optimization and control for uncertain networked systems. Integral Reinforcement Learning holds the key to integrating real-time data-driven methods, model-based methods, and physical constraints. The structure of Integral Reinforcement Learning will be explored to investigate exactly how and where to use Deep Learning neural networks in architectures that have multiple nested learning loops. A probabilistic spatiotemporal scenario data-driven framework will then be developed for multi-scale sequential control of networked engineering systems under uncertainty. The algorithms and tools developed will be used to sculpt optimal power profiles for power electronics converters in a DC distribution network and help mitigate the adverse effects of intermittent sources, uncertain load demand, or faults. The project represents a radical departure from the exiting big data and decision-making research, toward developing autonomous decision-making under uncertainty constructs for systems of growing scales and time critical mission requirements. Algorithms and tools developed can be extended to other smart and connected domains, e.g., air traffic management, networked traffic platoons, and sensor networks. US microgrid capacity is expected to reach 4.3 GW by 2020. DC distribution networks are emerging alternatives to AC distribution ones, and are critical to the scalable integration of renewable energy resources and electrified transportation fleets. Research results will be ported into topics in reinforcement learning, optimal control, networked control systems, data-driven analysis and decision-making, and power electronics systems. This project synergizes research activities between University of Texas at Arlington (UTA) and Texas A&M-Corpus Christi (TAMUCC), both HBCU/MI Hispanic Serving Institutions, and involves students from Electrical Engineering and Computer Science backgrounds.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.