Augmented Reality Head Mounted Display for Magnetic Resonance Imaging Guided Inte

描述(由申请人提供)：广泛的、长期的目标是开发一种低成本、易于使用的系统，可以将诊断MRI扫描仪转换为功能强大的神经外科MRI套件。该项目的具体目标是：1.开发HMD的只显示模式，将MRI实时扫描和设备跟踪注释集成到立体3D显示中。这种头盔显示器的可行性已在该项目的第一阶段得到论证。2.开发了一种基于图像和梯度跟踪的混合头部定位系统，用于增强现实系统，在MRI坐标系中提供扫描仪边缘区域的头部位置。3.开发HMD的增强现实模式，将先前获得的MRI解剖数据呈现到扫描仪边缘的神经外科手术区域。4.开发特定于应用的MRI协议，以提供具有多种对比度特性(例如T1、T2、FLAIR、MP-RAGE等)的无失真高分辨率3D渲染图像；以及规划和可视化软件接口，以使用增强现实将这些图像合并到过程规划和指导中。5.进行人体模型测试，以证明头盔显示器在两种操作模式下均能正常操作。6.进行动物实验，以评估HMD在进行经皮介入治疗和开放神经外科手术时的效果。拟议的项目符合PA-10-079的四个具体目标中的两个，即：-开发和优化完全集成的癌症成像、监测和治疗系统。-小型企业和学术临床中心之间的合作伙伴关系，以实现研究目标。该技术的开发和临床使用的最终产品将由Robin Medical，Inc.和巴尔的摩马里兰大学的磁共振研究中心(MRRC)共同完成，Robin Medical，Inc.是一家专门为MRI开发导航系统的小企业，该中心在人类和大型动物的MRI研究和定制扫描序列的开发方面拥有丰富的经验。Robin Medical将在第一阶段可行性论证的基础上开发头盔显示器(HMD)和头盔增强现实系统(HMARS)。HMD将提供实时或先前获取的MR图像的3D显示以及实时跟踪注释。HMARS将提供增强现实显示，由头戴式摄像机获得的手术视野、磁共振图像和跟踪注释组成。MRRC小组将开发定制的MRI序列，用于实时指导和显示3D渲染结构，并将使用该系统进行技术和动物实验。

DESCRIPTION (provided by applicant): The broad, long-term objective is to develop a low cost, easy to use system that can convert diagnostic MRI scanner into a functional neurosurgical MRI suite. The specific aims of the project are: 1. Develop the display-only mode of the HMD that integrates MRI realtime scans and device tracking annotation into a stereoscopic 3D display. Feasibility of such HMD has been demonstrated in Phase I of the project. 2. Develop a hybrid image-based and gradient-tracking based head positioning system for the augmented reality system to provide head position in the MRI coordinate system at the edge area of the scanner. 3. Develop the augmented reality mode of the HMD that presents 3D anatomic data from previously acquired MRI onto neurosurgical operation field at the edge of the scanner. 4. Develop application specific MRI protocols that provide non-distorted high-resolution 3D rendered images with multiple contrast characteristics (e.g. T1, T2, FLAIR, MP-RAGE, etc.); and the planning and visualization software interface to incorporate these images to procedure planning and guidance using augmented reality. 5. Conduct phantom tests to demonstrate adequate operation of the HMD in its two modes of operation. 6. Conduct animal tests to evaluate the HMD in conducting percutaneous interventions and open neurosurgical procedures. The proposed project complies with two of the four specific goals of PA-10-079, namely: - The development and optimization of fully integrated cancer imaging, monitoring, and therapy systems. - Partnerships among small business and academic clinical centers in order to reach the research goals. The development of the technology and the eventual product for clinical use will be done jointly by Robin Medical, Inc., a small business specializes in the development of navigation systems for MRI; and the Magnetic Resonance Research Center (MRRC) at the University of Maryland, Baltimore, having extensive experience in human and large animal research in MRI and development of customized scan sequences. Robin Medical will develop a head mounted display (HMD) and head mounted augmented reality system (HMARS), based on feasibility demonstration in Phase I. The HMD will provide a 3D display of realtime or previously acquired MR images along with realtime tracking annotation. The HMARS will provide an augmented reality display composed of view of the surgical field obtained by head mounted cameras, MR images, and tracking annotation. The MRRC group will develop customized MRI sequences for real-time guidance and display of 3D rendered structures and will conduct the technical and animal experimentation with the system.