A deep reinforcement learning approach for real-time sensor-driven decision making and predictive analytics
A deep reinforcement learning approach for real-time sensor-driven decision making and predictive analytics
复制标题
DOI：
10.1016/j.cie.2020.106600
复制
发表时间：
2020-09
期刊：
影响因子：
--
通讯作者：
Erotokritos Skordilis;R. Moghaddass
中科院分区：
文献类型：
--
作者：
Erotokritos Skordilis;R. Moghaddass
传感器密集型系统具有昂贵的子系统以及昂贵的维修和故障，其复杂性不断增加，需要高效的实时控制和决策策略。深度强化学习在解决高度复杂且具有挑战性的控制和决策问题方面表现出了巨大的潜力。尽管它有潜力使用动态系统的实时数据得出实时策略，但它很少用于传感器驱动的维护相关问题。在本文中，我们提出了两种新颖的决策方法，其中利用强化学习和粒子过滤来（i）导出实时维护策略和（ii）估计传感器监控的退化系统的剩余使用寿命。所提出的框架引入了一个新的方向，为系统监控提供了许多潜在的机会。为了证明所提出方法的有效性，通过 NASA 提供的一组模拟数据和涡轮风扇发动机数据集进行了数值实验。
The increased complexity of sensor-intensive systems with expensive subsystems and costly repairs and failures calls for efficient real-time control and decision making policies. Deep reinforcement learning has demonstrated great potential in addressing highly complex and challenging control and decision making problems. Despite its potential to derive real-time policies using real-time data for dynamic systems, it has been rarely used for sensor-driven maintenance related problems. In this paper, we propose two novel decision making methods in which reinforcement learning and particle filtering are utilized for (i) deriving real-time maintenance policies and (ii) estimating remaining useful life for sensor-monitored degrading systems. The proposed framework introduces a new direction with many potential opportunities for system monitoring. To demonstrate the effectiveness of the proposed methods, numerical experiments are provided from a set of simulated data and a turbofan engine dataset provided by NASA.