MAESTRO Jr. - Multi-sensing AI Environment for Surgical Task & Role Optimisation

该项目旨在设计和实施一个智能手术室环境，由可信赖的、人类理解的人工智能提供支持，能够不断适应和学习优化安全性、有效性、团队合作、经济性和临床结果的最佳方法。我们把这个概念称为MAESTRO。对MAESTRO来说，一个恰当的比喻是一个管弦乐队指挥，一个“大师”，他监督、偷听和指导一群人完成一项共同的任务，朝着一个共同的目标前进：一场精湛的音乐表演。虽然所有管弦乐队的乐谱都是相同的，但毫无疑问，他们都以不同的方式演奏，有些比其他人好得多。尽管管弦乐队音乐家的素质和个性非常重要，但人们普遍认为，大师的作用至关重要，并且超出了音乐表演的持续时间，以排练和理解乐谱背后的背景。因此，虽然管弦乐队可以在没有指挥的情况下演出，但大多数乐队都无法在没有指挥的情况下运作。我们提出的未来MAESTRO AI手术室围绕四个关键要素旋转：（a）通过各种传感器设备阵列对患者，员工，手术室环境和设备进行整体感知。(b)人工智能专注于人类（以人为中心），能够持续了解手术室中的情况和行动，并在必要时进行干预。(c)使用先进的人机用户界面来增强任务性能。(d)一个安全的设备互联平台，允许所有上述关键元素的完全集成。正如我们的管弦乐队类比，我们设想的MAESTRO通过以下方式在手术前、手术中和手术后指导手术室工作人员和手术设备：（1）感知手术过程的所有方面，包括目前被忽视的方面，如工作人员的生理反应（例如，心率、血压、出汗、瞳孔扩张）、注意力集中、大脑活动以及可能逃避临床团队注意的有害事件。(2)在整个手术过程中以及不同类型的手术和不同团队中实时监督个人和团队的表现。(3)通过自动检查点、虚拟和增强可视化、警告、个性化和广播警报、自动化、半自动化、机器人技术以及可能影响手术室性能的其他辅助工具和因素来指导和协助手术团队。(4)通过新颖的人机交互和界面模式，增强和优化个人和集体的操作能力、技能和任务人体工程学。该项目旨在产生重大的社会、经济和技术影响，并将NHS确立为全球领先的医疗保健模式。MAESTRO利用了机器人、传感、人工智能、人为因素、健康政策和患者安全领域顶级研究人员的专业知识。它是与顶级临床医生，英国最大的NHS信托基金之一，患者团体，表演艺术家，以及在人工智能，医疗设备，数字健康，大型网络，云服务，网络安全领域运营的几家中小型企业和大型跨国企业合作设计的。

This project is about devising and implementing a smart operating room environment, powered by trustable, human-understanding artificial intelligence, able to continually adapt and learn the best way to optimise safety, efficacy, teamwork, economy, and clinical outcomes. We call this concept MAESTRO. A fitting analogy for MAESTRO is that of an orchestra conductor, a 'maestro', who oversees, overhears and directs a group of people on a common task, towards a common goal: a masterful musical performance. Although the music score is identical for all orchestras, there is no doubt that they all perform it in different ways and some significantly better than others. Although the quality and personality of orchestra musicians is very important, it is widely accepted that the role of the maestro is crucial, and extends beyond the duration of the musical performance to rehearsals and understanding of the context behind the music score. Thus, while it is possible for orchestras to perform without conductors, most cannot function without one.Our proposed MAESTRO AI-powered operating room of the future rotates around four key elements:(a) The holistic sensing of patient, staff, operating room environment and equipment through an array of diverse sensor devices.(b) Artificial intelligence focused on humans (human-centric), able to continually understand situations and actions developing in the operating room, and of intervening when necessary.(c) The use of advanced human-machine user interfaces for augmenting task performance.(d) A secure device interconnectivity platform, allowing the full integration of all above key elements.As in our orchestra analogy, our envisioned MAESTRO directs the OR staff and surgical devices before, during and after a surgical procedure by:(1) Sensing surgical procedures in all their aspects, including those which are currently neglected such as the physiological responses of staff (e.g., heart rate, blood pressure, sweating, pupil dilation), focus of attention, brain activity, as well as harmful events that may escape the attention of the clinical team.(2) Overseeing individual and team performance in real-time, throughout the operation and across different types of surgeries and different teams.(3) Guiding and assisting the surgical team via automated checkpoints, virtual and augmented visualisations, warnings, individualised and broadcasted alerts, automation, semi-automation, robotics, and other aids and factors that can affect performance in the operating room.(4) Augmenting and optimising individual and collective operational capabilities, skills, and task ergonomics, through novel human-machine interaction and interfacing modalities.The project is designed to have a significant societal, economic and technological impact, and to establish the NHS as a leading healthcare paradigm worldwide. MAESTRO leverages the expertise of top researchers in the areas of robotics, sensing, artificial intelligence, human factors, health policies and patient safety. It is co-designed in collaboration with top clinicians, one of the largest NHS Trusts in England, patient groups, performing artists, and several small and medium-sized enterprises and large multinational industries operating in the areas of artificial intelligence, medical devices, digital health, large networks, cloud services, cyber security.