Augmented reality visualization for intraoperative guidance based on fluorescence lifetime

基于荧光寿命的术中引导增强现实可视化

• 批准号: 9770855
• 负责人: Laura Marcu
• 金额: $ 7.43万
• 依托单位: UNIVERSITY OF CALIFORNIA AT DAVIS
• 依托单位国家: 美国
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2021-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/9770855
• 关键词: Achievement; Address; Algorithms; Anatomy; Area; Augmented Reality; Biochemical; Breast; Calibration; Characteristics; Clinical; Clinical Research; Communication; Computer Vision Systems; Computer software; Contrast Media; Data; Devices; Excision; Fiber; Fiber Optics; Fluorescence; Goals; Image; Image-Guided Surgery; Imagery; Imaging Techniques; In Situ; Infrastructure; Injections; Interruption; Intuition; Laboratories; Machine Learning; Mammary Neoplasms; Measurement; Medical Imaging; Modification; Near-infrared optical imaging; Operating Rooms; Operative Surgical Procedures; Optical Coherence Tomography; Optics; Patient-Focused Outcomes; Patients; Pattern; Performance; Persons; Pilot Projects; Positioning Attribute; Postoperative Procedures; Procedures; Process; Property; Protocols documentation; Public Health; Research; Resolution; Risk; Scanning; Specimen; Stains; Structure; Surgeon; Surgical margins; System; Techniques; Testing; Time; Tissues; Work; base; breast lumpectomy; cancer therapy; clinical practice; design; design and construction; fluorescence lifetime imaging; human subject; image processing; image reconstruction; imaging modality; imaging system; improved outcome; in vivo; innovation; mixed reality; optical imaging; prototype; real-time images; tumor

Project summary/Abstract Optical imaging techniques have demonstrated potential to delineate tumor margins in vivo during surgery as they can rapidly characterize structural, biochemical or functional properties of tissue. Implementation in clinical practice demands rapid visualization and augmentation of imaging data but is often limited by the difficulty in dynamic registration, slow image reconstruction, lack of real- time ability or the need for contrast agents. The goal of this proposal is to implement the recently released Microsoft HoloLens with fiber-based imaging techniques to dynamically augment tissue characteristics directly on the interrogated area in the surgeon’s field of view. The specific aims of this proposal are as follows: (1) To realize a prototype of the augmented reality visualization platform and to combine it with our fluorescence lifetime imaging (FLIm) system, implement a user interface for a convenient interaction with the device. (2) To evaluate and optimize the scanning resolution and the registration precision using fluorescence phantoms and demonstrate the system in vivo for ten patients undergoing lumpectomy surgery. A current pilot study has demonstrated the potential of FLIm to localize tumor margins on excised breast specimen. The acquired in vivo data will help to systematically analyze differences between ex vivo and in vivo fluorescence decay signatures and provide initial data for a large-scale study that will be necessary to delineate tumor margins in vivo. The innovation of this proposal is that it will realize an augmented reality visualization platform for FLIm and other fiber based optical imaging modalities providing dynamic (continuous) augmentation of tissue properties directly on the interrogated area (surgeon’s field of view) in real-time without requiring the injection of contrast agents. The successful completion of this work has consequently the potential for significant impact in the field of surgical navigation.

项目概要/摘要 光学成像技术已经证明了在体内描绘肿瘤边缘的潜力， 因为它们可以快速表征组织的结构、生物化学或功能特性。 在临床实践中的实施需要快速可视化和增强成像数据 但往往受到动态配准困难、图像重建慢、缺乏真实的 时间能力或需要造影剂。该提案的目标是实施最近的 发布了微软HoloLens，它具有基于纤维的成像技术， 在外科医生的视野中，可以直接在询问区域上显示特征。具体目标 本文的主要工作如下：（1）实现了增强现实可视化的原型系统 平台，并将其与我们的荧光寿命成像（FLIm）系统相结合，实现一个 用于与设备方便交互的用户界面。(2)评估和优化 扫描分辨率和配准精度的荧光模型，并证明 该系统在体内用于10名接受乳房肿瘤切除术的患者。目前的一项试点研究 证明了FLIM在切除的乳腺标本上定位肿瘤边缘的潜力。的 获得的体内数据将有助于系统地分析离体和体内之间的差异 荧光衰减特征，并为大规模研究提供初始数据， 在体内描绘肿瘤边缘所必需的。这项提案的创新之处在于，它将实现 用于FLIm和其他光纤光学成像的增强现实可视化平台 直接在组织上提供组织特性的动态（连续）增强的模态 实时询问区域（外科医生的视野），无需注射造影剂 剂.这项工作的顺利完成，因此有可能对 在手术导航领域的影响。