HoloSurge: Multimodal 3D Holographic tool and real-time Guidance System with point-of-care diagnostics for surgical planning and interventions on liver and pancreatic cancers

围手术期护理是一个复杂的过程，包括1)术前评估、手术计划和准备；2)术中程序；3)术后处理。围手术期护理依赖于临床决策，这是一个持续的过程，涉及许多医疗保健专业人员（包括放射科医生、外科医生、麻醉师、护士等），他们根据现有的最佳证据、临床经验和患者的个人情况，就最佳行动方案做出明智的决定。尽管医学成像方式（CT、MRI、超声）的进步极大地改善了手术效果，但它们对决定具体行动方案的解释仍然是主观的。此外，这些模式单独使用时有一些局限性（例如，遗漏病变；不能提供关键结构（如血管）的3D可视化），最终无法提供所有指定团队共享和明确理解的患者解剖结构的全貌。由于这些限制，在围手术期护理中，经常有次优的决定增加了手术并发症的累积风险。HoloSurge是一项联合事业，将来自高科技公司、临床中心和研究机构的欧洲科学家和临床医生聚集在一个联盟中，部署一个基于人工智能的创新医疗系统，该系统：i)实现最先进成像模式的自动融合和分割，以实现患者器官的交互式3D全息可视化；Ii)提供实时手术导航；iii)允许实时细胞水平的癌症诊断。该解决方案将为手术团队在手术前和手术期间的护理点实时提供无与伦比的患者解剖和病理的整体视图。这一创新将在癌症干预中得到验证，同时创造一系列更明智的围手术期决策，可以挽救无数生命

Perioperative care is an intricate processthat encompasses 1) preoperative evaluation,surgical planning and preparation; 2) intraoperative procedure; and 3) postoperative management. Perioperative care depends on clinical decision-making, a continuous process that involves many healthcare professionals (incl. radiologists, surgeons, anaesthesiologists, nurses, and others) who – based on the best available evidence, clinical experience, and the patient's individual circumstances – make informed decisions on the best course of action. Even though advancementsin medical imaging modalities(CT, MRI, ultrasound) have greatly improved surgical outcomes, their interpretation towards deciding a specific course of action remains subjective. In addition, these modalities have several limitations when used alone (e.g., missed lesions; cannot provide a 3D visualization of key structures such as vessels), ultimately failing to provide a full picture of the patient’s anatomy that is shared and unambiguously understood by all in the assigned team. Due to these limitations, there are often suboptimal decisions that add to a cumulative risk of surgical complications in perioperative care. HoloSurge is a joint undertaking that brings European scientists and clinicians from high-tech companies, clinical centres, and research institutions in a consortium to deploy an innovative AI-based medical system that: i) enables automatic fusion and segmentation of state-of-the-art imaging modalities for interactive 3D holographic visualization of patients’ organs; ii) provides real-time surgical navigation; and iii) allows real-time cell-level cancer diagnostics. The solution will provide surgical teams with an unmatched holistic view of the patient’s anatomy and pathology in real-time at point of care, before and during surgery. This innovation will be validated for cancer interventions, while creating a trail of better-informed perioperative decision-making that can save countless lives