Collaborative Research: Lifelong Human-in-the-Loop Multiagent Learning for Decentralized Restoration of Distribution Systems (LifeGuard)

协作研究：用于配电系统分散恢复的终身人机循环多智能体学习 (LifeGuard)

• 批准号: 2223629
• 负责人: Mohammad Khodayar
• 金额: $ 8.79万
• 依托单位: Southern Methodist University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-08-01 至 2025-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2223629&HistoricalAwards=false
• 关键词: Collaborative; Research; Lifelong; Human; Loop

This research develops a novel multiagent system to provide a real-time solution for distribution service restoration that enhances energy supply resilience. The proposed multiagent framework will 1) leverage the spatiotemporal information obtained from the graph-structured power system dynamic data to provide accurate fault identification and location; 2) provide a distributed multiagent learning framework to find optimal restoration policies for rapid system recovery considering the scalability and time efficiency of the generated solutions; 3) obtain lifelong power restoration schemes that are flexible enough to adapt to new restoration problems by efficiently transferring their knowledge from a source problem to a target problem where the topology and characteristics of the power network are changed; and 4) provide an interpretable knowledge base for the human experts to evaluate the restoration scheme and modify it based on their prior knowledge and expertise. The academic and educational communities will benefit from the rapid dissemination of the generated knowledge from this project. The research plan encourages inventive collaboration among graduate and undergraduate students to find novel functional solutions to address current challenges in the distribution network operation. The project will develop a new curriculum for graduate and undergraduate students, promote interdisciplinary research, and develop K-12 outreach activities. The objective of this research is to develop a decentralized spatiotemporal artificial intelligence framework for distributed fault detection and identification, and power system restoration in large-scale distribution power networks considering the high dimensionality, sparsity, and partial observability of the system measurements. The project develops a graph capsule network to recognize spatiotemporal dynamic patterns of distribution systems, and detect the type and location of faults. Moreover, we devise a novel fully decentralized multiagent system with actor-critic reinforcement learning to solve large-scale restoration problems with high-dimensional system states and actions. Furthermore, we address knowledge transfer of multiagent systems as an open problem in machine learning and develop a lifelong restoration framework capable of adapting to changes in the topology and characteristics of the power system. The project also incorporates attention models into deep reinforcement learning to develop an interpretable knowledge base for the proposed restoration framework that can be used for restoration knowledge verification and modification using human expertise.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

本研究开发了一种新颖的多智能体系统，为提高能源供应弹性的配电服务恢复提供实时解决方案。所提出的多智能体框架将1)利用从图结构的电力系统动态数据中获得的时空信息来提供准确的故障识别和定位；2)提供一个分布式多智能体学习框架来为快速系统恢复提供最优恢复策略；3)通过有效地将他们的知识从源问题转移到目标问题来获得足够灵活的终身电力恢复方案，以适应新的恢复问题；以及4)为人类专家提供可解释的知识库，以基于他们的先验知识和专业知识对恢复方案进行评估和修改。学术界和教育界将受益于该项目所产生的知识的迅速传播。该研究计划鼓励研究生和本科生之间的创造性合作，以找到新的功能解决方案，以应对当前分销网络运营中的挑战。该项目将为研究生和本科生开发新的课程，促进跨学科研究，并开展K-12外联活动。考虑到系统测量的高维性、稀疏性和部分可观测性，本研究的目的是开发一种分布式时空人工智能框架，用于大规模配电网的分布式故障检测和识别以及电力系统恢复。该项目开发了一个图形胶囊网络，以识别配电系统的时空动态模式，并检测故障的类型和位置。此外，我们还设计了一种新的完全分散的多智能体系统，利用参与者-批评者强化学习来解决具有高维系统状态和动作的大规模恢复问题。此外，我们将多智能体系统的知识转移作为机器学习中的一个开放问题来解决，并开发了一个能够适应电力系统拓扑和特性变化的终身恢复框架。该项目还将注意力模型纳入深度强化学习，为拟议的恢复框架开发可解释的知识库，可用于使用人类专业知识验证和修改恢复知识。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。