Development of an augmented reality image-guidance system for cardiac interventions

开发用于心脏介入的增强现实图像引导系统

• 批准号: RGPIN-2019-06367
• 负责人: Ghugre, Nilesh
• 金额: $ 1.75万
• 依托单位: University of Toronto
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=716048
• 关键词: Development; augmented; reality; image; guidance

Each year 70,000 Canadians suffer a heart attack resulting in 16,000 deaths. A heart attack leaves behind a region of non-functional scar (or dead) tissue, resulting in a poorly functioning heart and ultimately heart failure. Unfortunately, the cells that are lost cannot be regenerated. The ability to repopulate the scar tissue by transplanting new functional heart cells represents a revolutionary new therapy for these patients. The new cells can be delivered into the heart through an open-heart surgery where a surgeon will inject the cells directly into the heart muscle. However, during a surgical procedure, the surgeon is unable to visually “see” the entire location and extent of the scar tissue to be able to deliver the cells in the right place, in turn losing the effectiveness of the therapy. Our research program offers a novel solution using image guidance technologies to overcome important hurdles in cell delivery. We aim to build a system that integrates high resolution three-dimensional (3D) roadmaps of the scar generated from cardiac Magnetic Resonance Imaging (MRI) with the emerging technology of augmented reality (AR). We will use head mounted AR devices that allow the user to interact with virtual objects placed in the living 3D space. We will first establish and calibrate an AR framework where users will be able to manipulate the holograms using hand gestures and voice commands. We will obtain high resolution 3D MRI scar maps and project them as 3D holograms into the user's visual field. The system will be able to align the 3D holograms to correctly place them over the target area using smart markers and further automatically adjust their shape and size to compensate for the movement of the beating heart and patient's breathing action. The system will be enhanced for multi-AR device communication and allow for rapid processing of complex heart motion with an external graphics processing unit. The system will also project preplanned injection sites to make the surgeon's workflow efficient and optimal. Augmented reality technology-based image-guidance in cardiac surgery is an unexplored area. The integrated imaging technologies developed in this program will be a first of its kind and will offer a unique and powerful framework for regenerative medicine investigators. Importantly, this system is directly translatable to humans and the program will position us towards deploying these novel technologies into high-impact pivotal efficacy studies involving new cell lines and advanced biomaterials for the treatment of heart failure. Furthermore, these image-guidance technologies can be leveraged by Canada-based devices and biotechnology partners for commercialization and accelerated availability in the Canadian healthcare system. We believe that the proposed AR framework will have implications in other cardiac interventions as well including open chest surgery for bypass, cardiac electrophysiology ablation and structural heart defects.

每年有70,000加拿大人心脏病发作，导致16,000人死亡。心脏病发作后会留下一块无功能的疤痕（或死亡）组织，导致心脏功能不佳，最终导致心力衰竭。不幸的是，失去的细胞不能再生。通过移植新的功能性心脏细胞来重新填充疤痕组织的能力代表了一种革命性的新疗法。这些新细胞可以通过开胸手术进入心脏，外科医生会将细胞直接注射到心肌中。然而，在外科手术过程中，外科医生无法通过视觉“看到”疤痕组织的整个位置和范围，从而无法将细胞输送到正确的位置，从而失去了治疗的有效性。我们的研究计划提供了一种新的解决方案，使用图像引导技术来克服细胞递送中的重要障碍。