Reinforcement-learning-based dynamic defense strategy of multistage game against dynamic load altering attack
Reinforcement-learning-based dynamic defense strategy of multistage game against dynamic load altering attack
复制标题
基于强化学习的多阶段博弈动态负载改变攻击动态防御策略
DOI：
10.1016/j.ijepes.2021.107113
复制
发表时间：
2021
影响因子：
5.2
通讯作者：
Shen, Yitong
中科院分区：
文献类型：
--
作者：
Guo, Youqi;Wang, Lingfeng;Liu, Zhaoxi;Shen, Yitong
由于目前的电网高度互联，最近正在部署更多的信息和通信技术（ICT），它可能成为恶意网络物理攻击的目标。动态变负荷攻击作为变负荷攻击的一种特殊情况，可以干扰需求响应并最终迫使某些发电机离线。也可能触发由于传输线路过载而引起的级联故障。在本文中，我们提出了一种新的动态防御策略，通过攻击者和防御者之间的多级博弈，解决了最小最大q学习。与静态博弈不同，多阶段博弈考虑了攻击者和防御者的行动序列，并学习了每个状态下的最优策略。在每一个时间步之后，测量级联故障，并将切负荷作为攻击者生成下一个动作策略的反馈。在IEEE 39节点系统上对该模型的性能进行了评估。通过对动态防御策略和被动防御策略的比较，验证了动态防御策略的优越性。为了提高电力系统的弹性，这种防御策略可以提前部署，当这种网络物理攻击的预期。
As the current power grid is highly interconnected and more information and communication technologies (ICTs) are being deployed recently, it could be the target of malicious cyber-physical attacks. Dynamic load altering attacks (D-LAAs), as a special case of load altering attacks, could be performed to interfere the demand response and ultimately force certain generators off-line. Cascading failures due to transmission line overloads may also be triggered. In this paper, we propose a new dynamic defense strategy against D-LAAs through a multistage game between the attacker and the defender which is solved by minimax-q learning. Different from the static game, the multistage game considers the attacker and defender’s action sequences and the optimal strategies at each state are learned. After each time step, the cascading failure is measured, and the load shedding is used as the feedback for the attacker to generate the next action strategy. The performance of the proposed model is evaluated on the IEEE 39-bus system. Comparisons between the dynamic defense strategy and the passive defense strategy are conducted, and the results verify the advantage of the proposed dynamic defense strategy. To improve the power system resilience, this defense strategy can be deployed in advance when such cyber-physical attacks are anticipated.
登录
查看更多内容
自动照明控制的最优需求响应能力
DOI：
--
发表时间：
2013
期刊：
IEEE PES Innovative Smart Grid Technologies Conference
影响因子：
--
作者：
Seyed Ataollah Raziei;Hamed Mohscnian
通讯作者：
Hamed Mohscnian
用于需求响应的住宅总负荷模型的基准测试
DOI：
--
发表时间：
2018
期刊：
IEEE Power & Energy Society General Meeting
影响因子：
--
作者：
Gregory S. Ledva;Sarah F. Peterson;J. Mathieu
通讯作者：
J. Mathieu
DOI：
10.1016/j.ijepes.2019.105432
发表时间：
2020-02
影响因子：
5.2
作者：
Saqib Hasan;A. Dubey;G. Karsai;X. Koutsoukos
通讯作者：
Saqib Hasan;A. Dubey;G. Karsai;X. Koutsoukos
影响因子：
4.4
作者：
Mortaji, Hamed;Ow, Siew Hock;Almurib, Haider Abbas F.
通讯作者：
Almurib, Haider Abbas F.
DOI：
10.1109/lcomm.2014.2371035
发表时间：
2015
期刊：
IEEE Communications Letters
影响因子：
--
作者：
Angelos K. Marnerides;Paul Smith;A. E. S. Filho;A. Mauthe
通讯作者：
Angelos K. Marnerides;Paul Smith;A. E. S. Filho;A. Mauthe