Augmented Reality Head Mounted Display for In-Bore Magnetic Resonance Guided Inte

描述(由申请人提供)：用于介入磁共振(MR)程序的增强现实(AR)技术集成了仪器跟踪，以生成增强患者真实世界视角的计算机视觉。这可以简化学习和执行图像引导干预。然而，现有的AR可视化界面不容易使用，因为它们需要广泛的校准，不提供实时图像更新，因为程序是在钻孔外进行的，并且没有使用最适合干预的仪器跟踪。拟议的项目旨在通过将3D立体头盔显示器(HMD)与从EndoScout跟踪模块(FDA批准的MRI跟踪系统，帮助扫描仪内孔内的介入操作)获得的仪器导航相结合来生成计算机合成的可视化。该显示器用于增强从安装在头盔显示器上的两个摄像头获得的真实世界视图，并通过另一个EndoScout传感器进行跟踪。该项目的具体目标是与经验丰富的介入放射科医生合作，创建一种直观、易于使用并进行准确性测试的内置式AR HMD。由于拟议的系统将与实时成像一起使用，因此干预将更快、更准确。它将改善医疗保健，并增加外科医生在磁共振扫描仪上采用介入程序的情况。该项目的可行性论证将为未来开发钻孔内的远程操作介入系统奠定基础，该系统包括一个电动机械手，在其上安装两个与MRI兼容的摄像头，并由EndoScout传感器进行跟踪。未来的商业产品将在扫描仪的孔内提供AR环境，包括EndoScout跟踪系统、膛内立体摄像系统、头盔显示器和扫描仪孔内的电动机械手的遥控器。 公共卫生相关性：磁共振(MR)成像非常适合检测和表征许多人类疾病。该项目旨在建立一个准确，易于使用和直观的头盔显示器，用于磁共振扫描仪上的图像引导介入手术。与现有设备相比，拟议系统的准确性更高，将导致重复程序更少，干预更快，外科医生更多地采用介入程序对磁共振扫描仪进行检查。

DESCRIPTION (provided by applicant): Augmented reality (AR) technology for Interventional Magnetic Resonance (MR) procedures integrates instrument tracking to generate computer visuals that augment the real world view of the patient. This can simplify both learning and performing image guided interventions. However existing AR visualization interfaces are not easy to use as they need extensive calibration, do not provide real time image updates as procedures are done outside the bore and do not use instrument tracking that is best suitable for interventions. The proposed project aims to address these drawbacks by integrating a 3D stereoscopic head mounted display (HMD) with instrument navigation obtained from EndoScout tracking modules (an FDA cleared tracking system for MRI that assists interventional procedures inside the bore of the scanner) to generate a computer synthesized visualization. This display is used to augment the real world view obtained from two cameras mounted on the HMD and tracked by means of another EndoScout sensor. The specific aim of the project is to create an in-bore AR HMD which is intuitive, easy to use and tested for accuracy in collaboration with an experienced interventional radiologist. As the proposed system is to be used with real time imaging, interventions will be faster and more accurate. It will result in improved healthcare and increased adoption of interventional procedures on MR scanners by surgeons. The feasibility demonstration in this project will set the basis for the future development of a remotely operated interventional system inside the bore, consisting of a motorized manipulator on which two MRI compatible cameras are mounted and tracked by an EndoScout sensor. A future commercial product will provide AR environment inside the bore of the scanner, including the EndoScout tracking system, in-bore stereoscopic camera system, HMD and a remote controller of a motorized manipulator inside the bore of the scanner. PUBLIC HEALTH RELEVANCE: Magnetic resonance (MR) imaging is excellent for detection and characterization of many human diseases. This project aims to build a head mounted display which is accurate, easy to use and intuitive for Image Guided Interventional Procedures on MR scanners. The higher accuracy of the proposed system as compared to existing devices will result in less repeat procedures, faster interventions and increased adoption of interventional procedures on MR scanners by surgeons.