Registration of partially overlapping surfaces for range image based augmented reality on mobile devices

Registration of partially overlapping surfaces for range image based augmented reality on mobile devices
复制标题

移动设备上基于距离图像的增强现实的部分重叠表面的配准

DOI:
--
复制
发表时间:
2012
期刊:
Medical Imaging
影响因子:
--
通讯作者:
L. Maier
L. Maier
中科院分区:
--
文献类型:
--
作者:
T. Kilgus;A. Franz;A. Seitel;K. März;L. Bartha;M. Fangerau;Sven Mersmann;A. Groch;H. Meinzer;L. Maier

文献摘要

参考文献

被引文献

相似文献

用于疾病诊断、手术计划或介入治疗期间定位的解剖数据的可视化是现代医疗保健的组成部分。然而,由于解剖信息通常显示在由放射工作站提供的监视器上,因此医生必须在精神上将屏幕上显示的内部结构传递给患者。为了解决这个问题,我们最近提出了一种新的方法来对患者进行3D医学图像的可视化,该方法将增强现实(AR)的概念与直观的交互方案相结合。我们的方法需要将距离成像设备(例如飞行时间(ToF)相机)安装到便携式显示器(例如平板PC)。在可视化过程中,摄像机的姿态以及因此用户的观看方向通过表面匹配算法连续确定。通过沿着患者的身体移动该装置,给予医生直视人体的印象。在本文中,我们提出并评估了一种新的方法,相机姿态估计的基础上各向异性修剪变量的著名的迭代最近点(ICP)算法。根据计算机断层扫描(CT)和ToF数据的人脸,膝盖和膝盖进行的在硅片和体内实验,我们的新方法是更好地适用于表面配准与ToF数据比建立修剪变量的ICP,减少目标配准误差(TRE)超过60%。获得的TRE(近似值)4-5 mm)对于AR可视化是有希望的,但是临床应用需要最大化鲁棒性和运行时间。
Visualization of anatomical data for disease diagnosis, surgical planning, or orientation during interventional therapy is an integral part of modern health care. However, as anatomical information is typically shown on monitors provided by a radiological work station, the physician has to mentally transfer internal structures shown on the screen to the patient. To address this issue, we recently presented a new approach to on-patient visualization of 3D medical images, which combines the concept of augmented reality (AR) with an intuitive interaction scheme. Our method requires mounting a range imaging device, such as a Time-of-Flight (ToF) camera, to a portable display (e.g. a tablet PC). During the visualization process, the pose of the camera and thus the viewing direction of the user is continuously determined with a surface matching algorithm. By moving the device along the body of the patient, the physician is given the impression of looking directly into the human body. In this paper, we present and evaluate a new method for camera pose estimation based on an anisotropic trimmed variant of the well-known iterative closest point (ICP) algorithm. According to in-silico and in-vivo experiments performed with computed tomography (CT) and ToF data of human faces, knees and abdomens, our new method is better suited for surface registration with ToF data than the established trimmed variant of the ICP, reducing the target registration error (TRE) by more than 60%. The TRE obtained (approx. 4-5 mm) is promising for AR visualization, but clinical applications require maximization of robustness and run-time.
DOI: 10.1109/tpami.2011.248
发表时间: 2012-08-01
影响因子: 23.6
作者:
Maier-Hein, Lena;Franz, Alfred M.;Fitzpatrick, J. Michael
通讯作者: Fitzpatrick, J. Michael