Augmented reality visualization for intraoperative guidance based on fluorescence lifetime

项目摘要/摘要 光学成像技术已经显示出在活体内描绘肿瘤边缘的潜力 外科手术，因为它们可以快速表征组织的结构、生化或功能特性。 临床实践中的实施需要成像数据的快速可视化和增强 但往往受限于动态配准困难、图像重建速度慢、缺乏真实感。 时间、能力或需要造影剂。这项提案的目标是落实最近的 发布Microsoft HoloLens，采用基于光纤的成像技术动态增强组织 特征直接显示在外科医生视野中的问诊区域。具体目标 具体内容如下：(1)实现了一个增强现实可视化原型系统 平台，并将其与我们的荧光寿命成像(FLIM)系统相结合，实现了一个 用户界面，便于与设备进行交互。(二)评估优化 利用荧光模体进行扫描分辨率和配准精度的验证 该系统在体内用于10名接受肿块切除术的患者。目前的一项初步研究表明 展示了薄膜在切除的乳腺标本上定位肿瘤边缘的潜力。这个 获得的体内数据将有助于系统分析体外和体内的差异 并为大规模研究提供初始数据，该研究将 在活体内勾画肿瘤边缘所必需的。这一建议的创新之处在于它将实现 基于光纤等光学成像的增强现实可视化平台 直接提供动态(连续)增强组织特性的方式 实时询问区域(外科医生的视野)，无需注射对比剂 探员们。因此，这项工作的成功完成具有重大的潜在意义 在外科导航领域的影响。

Project summary/Abstract Optical imaging techniques have demonstrated potential to delineate tumor margins in vivo during surgery as they can rapidly characterize structural, biochemical or functional properties of tissue. Implementation in clinical practice demands rapid visualization and augmentation of imaging data but is often limited by the difficulty in dynamic registration, slow image reconstruction, lack of real- time ability or the need for contrast agents. The goal of this proposal is to implement the recently released Microsoft HoloLens with fiber-based imaging techniques to dynamically augment tissue characteristics directly on the interrogated area in the surgeon’s field of view. The specific aims of this proposal are as follows: (1) To realize a prototype of the augmented reality visualization platform and to combine it with our fluorescence lifetime imaging (FLIm) system, implement a user interface for a convenient interaction with the device. (2) To evaluate and optimize the scanning resolution and the registration precision using fluorescence phantoms and demonstrate the system in vivo for ten patients undergoing lumpectomy surgery. A current pilot study has demonstrated the potential of FLIm to localize tumor margins on excised breast specimen. The acquired in vivo data will help to systematically analyze differences between ex vivo and in vivo fluorescence decay signatures and provide initial data for a large-scale study that will be necessary to delineate tumor margins in vivo. The innovation of this proposal is that it will realize an augmented reality visualization platform for FLIm and other fiber based optical imaging modalities providing dynamic (continuous) augmentation of tissue properties directly on the interrogated area (surgeon’s field of view) in real-time without requiring the injection of contrast agents. The successful completion of this work has consequently the potential for significant impact in the field of surgical navigation.