Towards autonomous management of cardiogenic shock

项目摘要 心脏重症监护室（CCU）的医生在越来越多的数据中做出决策， 知识丰富的世界，但他们往往得不到什么帮助。目前，每个医生都根据自己的或 她对病人生理的心理模型，以及对病人对病人的反应的心理预测， 干预这种方法可能导致一系列损害患者结局的行为，包括 生理学的过度简化、认知过载引起的错误以及医生之间的差异， 决策。一种配备了生理学定量知识的计算工具， 系统地评估所有数据，并通过过去行动结果事件的数据库提供信息， 医生提供有价值的行动建议。 我们建议训练一种算法来决定血管活性药物的剂量和启动 失代偿性心力衰竭心源性休克患者的机械支持。这一套集中的 决策需要对生理学进行计算，而这些计算通常是在医生的头脑中进行的。我们陷害 优化心血管功能以保持氧气输送的决策问题，我们应用了来自 最佳控制。我们将使用强化学习（RL）技术，而不是手工设计CCU控制器 一个“适合”。在过去的几年里，RL领域经历了爆炸式的增长，在以下方面取得了显着的进步： 战略决策问题和机器人技术。临床环境中的一个关键挑战是探索阶段 在真实的病人身上进行反复试验是不道德的。第二个挑战是， 患者数据虽然在增长，但可能成为瓶颈。我们将利用最先进的基于模型的强化学习来训练 使用模拟和从历史数据的离线学习的组合的算法。我们将使用一个模型 心血管生理学的基础，心脏模拟器在今天使用的心脏病专家的培训。 历史患者数据将来自马萨诸塞州综合医院临床数据动画中心， 除了标准的电子病历数据外， CCU患者持续数年。这是同类中最大和最完整的数据集之一。的 随着工具变得更加复杂， 患者寿命更长，合并症更广泛。先进的决策支持工具可以帮助驯服这个问题 复杂性，提高护理质量以及民主化。

Project Summary Physicians in the cardiac intensive care unit (CCU) make decisions in an increasingly data- and knowledge- rich world, yet often they get little help. Currently, each physician makes decisions based on his or her mental model of the patient’s physiology, together with mental predictions of the patient’s response to intervention. This approach can lead to a range of behaviors that compromise patient outcomes, including oversimplification of the physiology, errors due to cognitive overload, and physician to physician variability in decision making. A computational tool equipped with quantitative knowledge of physiology, the ability to systematically evaluate all the data, and informed by a database of past action-outcome events could aid the physician with valuable suggestions for action. We propose to train an algorithm to make decisions about dosing vasoactive medications and initiating mechanical support in patients with cardiogenic shock due to decompensated heart failure. This focused set of decisions entails calculations about the physiology that are normally performed in a physician’s head. We frame the decision problem as optimizing cardiovascular function to preserve oxygen delivery, and we apply tools from optimal control. Rather than hand-design a CCU controller we will use reinforcement learning (RL) techniques to “fit” one. The field of RL has experienced explosive growth over the past few years, with notable advances in strategic decision problems and robotics. A key challenge in the clinical environment is that the exploration phase of learning (“trial and error”) would be unethical in real patients. A second challenge is that the availability of patient data, while growing, is likely to be a bottleneck. We will leverage state-of-the-art model-based RL to train an algorithm using a combination of simulation and off-policy learning from historical data. We will use a model of cardiovascular physiology that underlies cardiac simulators in use today for the training of cardiologists. Historical patient data will come from the Massachusetts General Hospital Clinical Data Animation Center which has recorded real-time telemetry waveform data in addition to standard electronic medical record data from all CCU patients spanning several years. This is one of the largest and most complete datasets of its kind. The complexity of managing cardiogenic shock will continue to escalate as tools become more sophisticated and patients live longer, with more extensive comorbidities. Advanced decision support tools could help tame this complexity, improving the quality of care as well as democratizing it.