Development of an augmented reality image-guidance system for cardiac interventions

点击翻译按钮获取中文摘要

Each year 70,000 Canadians suffer a heart attack resulting in 16,000 deaths. A heart attack leaves behind a region of non-functional scar (or dead) tissue, resulting in a poorly functioning heart and ultimately heart failure. Unfortunately, the cells that are lost cannot be regenerated. The ability to repopulate the scar tissue by transplanting new functional heart cells represents a revolutionary new therapy for these patients. The new cells can be delivered into the heart through an open-heart surgery where a surgeon will inject the cells directly into the heart muscle. However, during a surgical procedure, the surgeon is unable to visually “see” the entire location and extent of the scar tissue to be able to deliver the cells in the right place, in turn losing the effectiveness of the therapy. Our research program offers a novel solution using image guidance technologies to overcome important hurdles in cell delivery.******We aim to build a system that integrates high resolution three-dimensional (3D) roadmaps of the scar generated from cardiac Magnetic Resonance Imaging (MRI) with the emerging technology of augmented reality (AR). We will use head mounted AR devices that allow the user to interact with virtual objects placed in the living 3D space. We will first establish and calibrate an AR framework where users will be able to manipulate the holograms using hand gestures and voice commands. We will obtain high resolution 3D MRI scar maps and project them as 3D holograms into the user's visual field. The system will be able to align the 3D holograms to correctly place them over the target area using smart markers and further automatically adjust their shape and size to compensate for the movement of the beating heart and patient's breathing action. The system will be enhanced for multi-AR device communication and allow for rapid processing of complex heart motion with an external graphics processing unit. The system will also project preplanned injection sites to make the surgeon's workflow efficient and optimal.******Augmented reality technology-based image-guidance in cardiac surgery is an unexplored area. The integrated imaging technologies developed in this program will be a first of its kind and will offer a unique and powerful framework for regenerative medicine investigators. Importantly, this system is directly translatable to humans and the program will position us towards deploying these novel technologies into high-impact pivotal efficacy studies involving new cell lines and advanced biomaterials for the treatment of heart failure. Furthermore, these image-guidance technologies can be leveraged by Canada-based devices and biotechnology partners for commercialization and accelerated availability in the Canadian healthcare system. We believe that the proposed AR framework will have implications in other cardiac interventions as well including open chest surgery for bypass, cardiac electrophysiology ablation and structural heart defects.**