Augmented Reality Head Mounted Display for Magnetic Resonance Imaging Guided Inte

描述（由申请人提供）：广泛的，长期的目标是开发一种低成本，易于使用的系统，可以将诊断MRI扫描仪转换为功能性神经外科MRI套件。该项目的具体目标是：1。开发HMD的仅显示模式，将MRI实时扫描和设备跟踪注释集成到立体3D显示中。这种HMD的可行性已在该项目的第一期得到证实。2. 为增强现实系统开发基于图像和基于梯度跟踪的混合头部定位系统，以在扫描仪边缘区域的MRI坐标系统中提供头部位置。3. 开发HMD的增强现实模式，将先前获得的MRI的3D解剖数据呈现到扫描仪边缘的神经外科手术场。4. 开发特定应用的MRI协议，提供具有多种对比度特征（例如T1， T2， FLAIR， MP-RAGE等）的非失真高分辨率3D渲染图像；规划和可视化软件接口，将这些图像纳入程序规划和指导使用增强现实。5. 进行模拟测试，以演示HMD在两种操作模式下的适当操作。6. 进行动物试验以评估HMD在经皮介入治疗和开放性神经外科手术中的作用。拟议的项目符合PA-10-079四个具体目标中的两个，即：-开发和优化完全集成的癌症成像，监测和治疗系统。-在小企业和学术临床中心之间建立伙伴关系，以实现研究目标。这项技术的开发和最终用于临床的产品将由Robin Medical， Inc.共同完成，Robin Medical, Inc.是一家专门开发MRI导航系统的小型企业；以及巴尔的摩马里兰大学磁共振研究中心（MRRC），在MRI的人类和大型动物研究以及定制扫描序列的开发方面拥有丰富的经验。Robin Medical将根据第一阶段的可行性论证，开发一种头戴式显示器（HMD）和头戴式增强现实系统（HMARS）。头戴式显示器将提供实时或先前获取的MR图像的3D显示以及实时跟踪注释。HMARS将提供增强现实显示，由头戴式摄像机获得的手术视野视图、MR图像和跟踪注释组成。MRRC小组将开发定制的MRI序列，用于实时指导和3D渲染结构的显示，并将使用该系统进行技术和动物实验。

DESCRIPTION (provided by applicant): The broad, long-term objective is to develop a low cost, easy to use system that can convert diagnostic MRI scanner into a functional neurosurgical MRI suite. The specific aims of the project are: 1. Develop the display-only mode of the HMD that integrates MRI realtime scans and device tracking annotation into a stereoscopic 3D display. Feasibility of such HMD has been demonstrated in Phase I of the project. 2. Develop a hybrid image-based and gradient-tracking based head positioning system for the augmented reality system to provide head position in the MRI coordinate system at the edge area of the scanner. 3. Develop the augmented reality mode of the HMD that presents 3D anatomic data from previously acquired MRI onto neurosurgical operation field at the edge of the scanner. 4. Develop application specific MRI protocols that provide non-distorted high-resolution 3D rendered images with multiple contrast characteristics (e.g. T1, T2, FLAIR, MP-RAGE, etc.); and the planning and visualization software interface to incorporate these images to procedure planning and guidance using augmented reality. 5. Conduct phantom tests to demonstrate adequate operation of the HMD in its two modes of operation. 6. Conduct animal tests to evaluate the HMD in conducting percutaneous interventions and open neurosurgical procedures. The proposed project complies with two of the four specific goals of PA-10-079, namely: - The development and optimization of fully integrated cancer imaging, monitoring, and therapy systems. - Partnerships among small business and academic clinical centers in order to reach the research goals. The development of the technology and the eventual product for clinical use will be done jointly by Robin Medical, Inc., a small business specializes in the development of navigation systems for MRI; and the Magnetic Resonance Research Center (MRRC) at the University of Maryland, Baltimore, having extensive experience in human and large animal research in MRI and development of customized scan sequences. Robin Medical will develop a head mounted display (HMD) and head mounted augmented reality system (HMARS), based on feasibility demonstration in Phase I. The HMD will provide a 3D display of realtime or previously acquired MR images along with realtime tracking annotation. The HMARS will provide an augmented reality display composed of view of the surgical field obtained by head mounted cameras, MR images, and tracking annotation. The MRRC group will develop customized MRI sequences for real-time guidance and display of 3D rendered structures and will conduct the technical and animal experimentation with the system.