DEX-RAY: AUGMENTED REALITY NEUROSURGICAL NAVIGATION WITH A HANDHELD VIDEO PROBE
DEX-RAY: AUGMENTED REALITY NEUROSURGICAL NAVIGATION WITH A HANDHELD VIDEO PROBE
复制标题
DOI：
10.1227/01.neu.0000349918.36700.1c
复制
发表时间：
2009-10-01
期刊：
影响因子：
4.8
通讯作者：
Serra, Luis
中科院分区：
文献类型：
--
作者：
Kockro, Ralf A.;Tsai, Yeo Tseng;Serra, Luis
目的：我们开发了一种增强现实系统，通过使用覆盖在视频流上的三维（3D）图形来实现术中图像引导。我们将该系统称为DEX-Ray，并报告了其开发和12例病例的初步术中经验。方法：DEX-Ray由一个跟踪手持式探头组成，该探头集成了口红大小的摄像机。摄像头从探头尖端观察手术野。摄像机的视频流增强了共配准，多模态3D图形和地标获得神经外科计划与3D工作站。手持式探头可作为导航设备进行查看和指示，并作为交互设备调整3D图形。我们在实验室测试了该系统的准确性，并在手术中与一系列的肿瘤和血管cases.RESULTS：DEX射线提供了准确和实时的基于视频的增强现实显示。该系统可以无缝集成到手术工作流程中。在手术暴露表面下显示3D信息的透视效果被证明具有重要价值，特别是在手术的宏观阶段，提供易于理解的结构导航信息。导航在深和狭窄的手术走廊是有限的摄像机分辨率和光sensitivity.CONCLUSION：该系统被认为是一个改进的导航体验，因为增强的透视效果允许直接了解手术解剖结构以外的可见表面和直接指导手术目标。
OBJECTIVE: We developed an augmented reality system that enables intraoperative image guidance by using 3-dimensional (3D) graphics overlaid on a video stream. We call this system DEX-Ray and report on its development and the initial intraoperative experience in 12 cases.METHODS: DEX-Ray consists of a tracked handheld probe that integrates a lipstick-size video camera. The camera looks over the probe's tip into the surgical field. The camera's video stream is augmented with coregistered, multimodality 3D graphics and landmarks obtained during neurosurgical planning with 3D workstations. The handheld probe functions as a navigation device to view and point and as an interaction device to adjust the 3D graphics. We tested the system's accuracy in the laboratory and evaluated it intraoperatively with a series of tumor and vascular cases.RESULTS: DEX-Ray provided accurate and real-time video-based augmented reality display. The system could be seamlessly integrated into the surgical workflow. The see-through effect revealing 3D information below the surgically exposed surface proved to be of significant value, especially during the macroscopic phase of an operation, providing easily understandable structural navigational information. Navigation in deep and narrow surgical corridors was limited by the camera resolution and light sensitivity.CONCLUSION: The system was perceived as an improved navigational experience because the augmented see-through effect allowed direct understanding of the surgical anatomy beyond the visible surface and direct guidance toward surgical targets.