Cooperative Differential Game-Based Optimal Control and Its Application to Power Systems
Cooperative Differential Game-Based Optimal Control and Its Application to Power Systems
复制标题
DOI：
10.1109/tii.2019.2955966
复制
发表时间：
2020-08
影响因子：
12.3
通讯作者：
C. Mu;Ke Wang;Z. Ni;Changyin Sun
中科院分区：
文献类型：
--
作者：
C. Mu;Ke Wang;Z. Ni;Changyin Sun
微分对策在最优控制问题中有着广泛的应用。纳什均衡是指当每个参与者都独立地试图最小化一个预定义的指标时，参与者之间的权衡。在考虑潜在合作时，帕累托均衡在合作微分对策中起着重要的作用。研究了二次无限时域上多层系统的合作控制问题。首先，通过定义一个联合成本函数，使用一个参数集，合作微分对策被重新表述为一般的最优控制问题，其中所有的球员形成一个大联盟。然后，联合成本函数近似的批评神经网络，并首次提出了一种新的自适应动态规划算法，具有两个学习阶段，以确定参数的选择，然后获得Pareto最优解。数值算例表明，该算法能获得最优策略和Pareto前沿.在应用方面，研究了两区域互联电力系统的协调控制问题，将一次频率控制和二次频率控制视为两个参与者。仿真结果表明，与Nash控制方法和其他三种控制方法相比，该方案能够获得具有约束力的合作协议，从而使合作控制方案获得更好的整体性能。
Differential games have been extensively applied to optimal control problems. Nash equilibrium captures the tradeoff among players’ policies when every player independently tries to minimize a predefined index. When considering potential cooperation, Pareto equilibrium plays an important role in cooperative differential games. This article studies the cooperative control of multiplayer systems on the quadratic infinite horizon. First, by defining a joint cost function using a parameter set, a cooperative differential game is reformulated as a general optimal control problem, where all players form a grand coalition. Then, the joint cost function is approximated by a critic neural network, and for the first time, a novel adaptive dynamic programming algorithm with two learning stages is proposed to determine the parameter selection and then obtain Pareto optimal solutions. A numerical example demonstrates that this algorithm can achieve optimal policies and Pareto frontier. As for its application, the cooperative control of a two-area interconnected power system is investigated, where the primary frequency control and secondary frequency control are regarded as two players. Simulation results indicate that the proposed scheme can obtain binding cooperation agreements, such that cooperative control scheme can get better overall performance compared to Nash control method and another three control methods.