HoloSurge:Multimodal 3D Holographic tool and real-time Guidance System with point-of-care diagnostics for surgical planning and interventions on liver and pancreatic cancers

围手术期护理是一个复杂的过程，包括1）术前评估，手术计划和准备; 2）术中操作; 3）术后管理。围手术期护理取决于临床决策，这是一个涉及许多医疗保健专业人员（包括放射科医生、外科医生、麻醉科医生、护士和其他人员），他们根据最佳可用证据、临床经验和患者的个人情况，就最佳行动方案做出明智的决定。尽管医学成像方式（CT、MRI、超声）的进步极大地改善了手术结果，但对决定具体行动方案的解释仍然是主观的。此外，这些模态在单独使用时具有若干限制（例如，漏诊病变;无法提供关键结构（如血管）的3D可视化），最终无法提供患者解剖结构的全貌，无法为指定团队中的所有人共享并明确理解。由于这些局限性，往往有次优的决定，增加了围手术期护理手术并发症的累积风险。HoloSurge是一项联合项目，汇集了来自高科技公司，临床中心和研究机构的欧洲科学家和临床医生，共同部署一种创新的基于人工智能的医疗系统，该系统：i）能够自动融合和分割最先进的成像模式，以实现患者器官的交互式3D全息可视化; ii）提供实时手术导航;和iii）允许实时细胞水平的癌症诊断。该解决方案将为手术团队提供无与伦比的患者解剖和病理的实时整体视图，在护理点，手术前和手术期间。这一创新将被验证用于癌症干预，同时创造一个更明智的围手术期决策路径，可以挽救无数生命。

Perioperative care is an intricate processthat encompasses 1) preoperative evaluation,surgical planning and preparation; 2) intraoperative procedure; and 3) postoperative management. Perioperative care depends on clinical decision-making, a continuous process that involves many healthcare professionals (incl. radiologists, surgeons, anaesthesiologists, nurses, and others) who – based on the best available evidence, clinical experience, and the patient's individual circumstances – make informed decisions on the best course of action. Even though advancementsin medical imaging modalities(CT, MRI, ultrasound) have greatly improved surgical outcomes, their interpretation towards deciding a specific course of action remains subjective. In addition, these modalities have several limitations when used alone (e.g., missed lesions; cannot provide a 3D visualization of key structures such as vessels), ultimately failing to provide a full picture of the patient’s anatomy that is shared and unambiguously understood by all in the assigned team. Due to these limitations, there are often suboptimal decisions that add to a cumulative risk of surgical complications in perioperative care. HoloSurge is a joint undertaking that brings European scientists and clinicians from high-tech companies, clinical centres, and research institutions in a consortium to deploy an innovative AI-based medical system that: i) enables automatic fusion and segmentation of state-of-the-art imaging modalities for interactive 3D holographic visualization of patients’ organs; ii) provides real-time surgical navigation; and iii) allows real-time cell-level cancer diagnostics. The solution will provide surgical teams with an unmatched holistic view of the patient’s anatomy and pathology in real-time at point of care, before and during surgery. This innovation will be validated for cancer interventions, while creating a trail of better-informed perioperative decision-making that can save countless lives.