MAESTRO Jr. - Multi-sensing AI Environment for Surgical Task & Role Optimisation

该项目是关于设计和实施智能手术室环境，由值得信赖的、人类理解的人工智能提供支持，能够不断适应和学习优化安全性、有效性、团队合作、经济性和临床结果的最佳方法。我们称之为概念大师。对于大师来说，一个恰如其分的类比是管弦乐队的指挥家，一个监督、监听和指导一群人完成一项共同任务的大师，朝着一个共同的目标：一场高超的音乐表演。尽管所有管弦乐队的乐谱都是一样的，但毫无疑问，他们都以不同的方式演奏，有些明显好于另一些。虽然乐团音乐家的素质和个性非常重要，但人们普遍认为，大师的角色是至关重要的，并超越了音乐表演的持续时间，延伸到排练和对乐谱背后的背景的理解。因此，虽然交响乐团可以在没有指挥家的情况下表演，但大多数人没有指挥家就不能发挥作用。我们提议的未来人工智能大师手术室围绕四个关键要素：(A)通过一系列不同的传感器设备对患者、工作人员、手术室环境和设备进行整体感知。(B)人工智能以人类为中心(以人为中心)，能够持续了解手术室内的情况和行动，并在必要时进行干预。(C)使用先进的人机用户界面来增强任务性能。(D)安全的设备互连平台，在我们的管弦乐队中，我们设想的大师在外科手术之前、期间和之后通过以下方式指导手术室工作人员和手术设备：(1)感知手术过程的所有方面，包括目前被忽视的那些方面，如工作人员的生理反应(例如，心率、血压、出汗、瞳孔扩大)、注意力集中、大脑活动以及可能逃脱临床团队注意的有害事件。(2)实时监督个人和团队的表现，在整个手术过程中，跨越不同类型的手术和不同的团队。(3)通过自动化检查点、虚拟和增强的可视化、警告、个性化和广播警报、自动化、半自动化、机器人和其他可能影响手术室性能的辅助和因素来指导和协助手术团队。(4)通过新颖的人机交互和界面模式，增强和优化个人和集体的操作能力、技能和任务人机工程学。该项目旨在产生重大的社会、经济和技术影响，并将NHS建立为全球领先的医疗保健范例。Maestro充分利用了机器人、传感、人工智能、人为因素、健康政策和患者安全等领域的顶级研究人员的专业知识。它是与顶尖临床医生、英国最大的NHS信托基金之一、患者团体、表演艺术家以及在人工智能、医疗设备、数字健康、大型网络、云服务、网络安全等领域运营的几家中小型企业和大型跨国行业合作设计的。

This project is about devising and implementing a smart operating room environment, powered by trustable, human-understanding artificial intelligence, able to continually adapt and learn the best way to optimise safety, efficacy, teamwork, economy, and clinical outcomes. We call this concept MAESTRO. A fitting analogy for MAESTRO is that of an orchestra conductor, a 'maestro', who oversees, overhears and directs a group of people on a common task, towards a common goal: a masterful musical performance. Although the music score is identical for all orchestras, there is no doubt that they all perform it in different ways and some significantly better than others. Although the quality and personality of orchestra musicians is very important, it is widely accepted that the role of the maestro is crucial, and extends beyond the duration of the musical performance to rehearsals and understanding of the context behind the music score. Thus, while it is possible for orchestras to perform without conductors, most cannot function without one.Our proposed MAESTRO AI-powered operating room of the future rotates around four key elements:(a) The holistic sensing of patient, staff, operating room environment and equipment through an array of diverse sensor devices.(b) Artificial intelligence focused on humans (human-centric), able to continually understand situations and actions developing in the operating room, and of intervening when necessary.(c) The use of advanced human-machine user interfaces for augmenting task performance.(d) A secure device interconnectivity platform, allowing the full integration of all above key elements.As in our orchestra analogy, our envisioned MAESTRO directs the OR staff and surgical devices before, during and after a surgical procedure by:(1) Sensing surgical procedures in all their aspects, including those which are currently neglected such as the physiological responses of staff (e.g., heart rate, blood pressure, sweating, pupil dilation), focus of attention, brain activity, as well as harmful events that may escape the attention of the clinical team.(2) Overseeing individual and team performance in real-time, throughout the operation and across different types of surgeries and different teams.(3) Guiding and assisting the surgical team via automated checkpoints, virtual and augmented visualisations, warnings, individualised and broadcasted alerts, automation, semi-automation, robotics, and other aids and factors that can affect performance in the operating room.(4) Augmenting and optimising individual and collective operational capabilities, skills, and task ergonomics, through novel human-machine interaction and interfacing modalities.The project is designed to have a significant societal, economic and technological impact, and to establish the NHS as a leading healthcare paradigm worldwide. MAESTRO leverages the expertise of top researchers in the areas of robotics, sensing, artificial intelligence, human factors, health policies and patient safety. It is co-designed in collaboration with top clinicians, one of the largest NHS Trusts in England, patient groups, performing artists, and several small and medium-sized enterprises and large multinational industries operating in the areas of artificial intelligence, medical devices, digital health, large networks, cloud services, cyber security.