HoloSurge: Multimodal 3D Holographic tool and real-time Guidance System with point-of-care diagnostics for surgical planning and interventions on liver and pancreatic cancers

围手术期护理是一个复杂的过程，包括1)术前评估、手术计划和准备；2)术中操作；3)术后处理。围手术期护理取决于临床决策，这是一个涉及许多医疗保健专业人员的持续过程(包括。放射科医生、外科医生、麻醉师、护士和其他人)，他们根据现有的最佳证据、临床经验和患者的个人情况，就最佳治疗方案做出明智的决定。尽管医学成像手段(CT、MRI、超声)的进步极大地改善了手术结果，但它们对决定具体行动方案的解释仍然是主观的。此外，当单独使用时，这些模式有几个局限性(例如，遗漏的病变；不能提供血管等关键结构的3D可视化)，最终无法提供患者解剖的全景图，该全景被分配的团队中的所有人共享和明确理解。由于这些局限性，在围手术期护理中，经常会有一些不理想的决定增加了手术并发症的累积风险。HoloSurge是一家联合企业，它将来自高科技公司、临床中心和研究机构的欧洲科学家和临床医生联合起来，部署基于人工智能的创新医疗系统：i)实现最先进的成像模式的自动融合和分割，以实现患者器官的交互式3D全息可视化；ii)提供实时手术导航；以及iii)允许实时细胞级癌症诊断。该解决方案将在手术前和手术中为外科团队提供无与伦比的患者解剖和病理的实时整体视图。这一创新将被用于癌症干预，同时创建一条更知情的围手术期决策轨迹，可以拯救无数人的生命

Perioperative care is an intricate processthat encompasses 1) preoperative evaluation,surgical planning and preparation; 2) intraoperative procedure; and 3) postoperative management. Perioperative care depends on clinical decision-making, a continuous process that involves many healthcare professionals (incl. radiologists, surgeons, anaesthesiologists, nurses, and others) who – based on the best available evidence, clinical experience, and the patient's individual circumstances – make informed decisions on the best course of action. Even though advancementsin medical imaging modalities(CT, MRI, ultrasound) have greatly improved surgical outcomes, their interpretation towards deciding a specific course of action remains subjective. In addition, these modalities have several limitations when used alone (e.g., missed lesions; cannot provide a 3D visualization of key structures such as vessels), ultimately failing to provide a full picture of the patient’s anatomy that is shared and unambiguously understood by all in the assigned team. Due to these limitations, there are often suboptimal decisions that add to a cumulative risk of surgical complications in perioperative care. HoloSurge is a joint undertaking that brings European scientists and clinicians from high-tech companies, clinical centres, and research institutions in a consortium to deploy an innovative AI-based medical system that: i) enables automatic fusion and segmentation of state-of-the-art imaging modalities for interactive 3D holographic visualization of patients’ organs; ii) provides real-time surgical navigation; and iii) allows real-time cell-level cancer diagnostics. The solution will provide surgical teams with an unmatched holistic view of the patient’s anatomy and pathology in real-time at point of care, before and during surgery. This innovation will be validated for cancer interventions, while creating a trail of better-informed perioperative decision-making that can save countless lives