Automated instrument-tracking for 4D video-rate imaging of ophthalmic surgical maneuvers.
Automated instrument-tracking for 4D video-rate imaging of ophthalmic surgical maneuvers.
复制标题
DOI：
10.1364/boe.450814
复制
发表时间：
2022-02
影响因子：
3.4
通讯作者：
Eric M. Tang;Mohamed T. El-Haddad;Shriji N. Patel;Yuankai K. Tao
中科院分区：
文献类型：
--
作者：
Eric M. Tang;Mohamed T. El-Haddad;Shriji N. Patel;Yuankai K. Tao
术中图像引导提供了增强的反馈，方便了各种医学领域的手术决策，在触觉反馈有限的情况下尤其有用。在这些情况下，自动器械跟踪和定位对于指导手术操作和防止对下面组织的损害是必不可少的。然而，仪器跟踪是具有挑战性的，而且经常受到手术环境变化的影响，导致在精度和速度之间进行权衡。由于仪器运动和眼内仪器变形之间的非刚性关系、图像场失真、图像伪影以及由于患者运动和生理性颤动而导致的整体运动，眼科显微手术面临着额外的挑战。我们提出了一种利用多模式成像和深度学习来动态检测手术器械位置和重新定位成像区域的自动化器械跟踪方法，以实现眼科手术动作的4D视频率可视化。我们能够实现分辨率受限的跟踪精度，在不同的仪器方向，以及在极端的仪器速度和图像散焦超出典型的使用案例。作为概念验证，我们执行自动器械跟踪和模拟手术任务的4D成像。在这里，我们将我们的方法应用于眼科显微手术中的特定应用，但所提出的技术广泛适用于术中高速和准确的图像引导。
Intraoperative image-guidance provides enhanced feedback that facilitates surgical decision-making in a wide variety of medical fields and is especially useful when haptic feedback is limited. In these cases, automated instrument-tracking and localization are essential to guide surgical maneuvers and prevent damage to underlying tissue. However, instrument-tracking is challenging and often confounded by variations in the surgical environment, resulting in a trade-off between accuracy and speed. Ophthalmic microsurgery presents additional challenges due to the nonrigid relationship between instrument motion and instrument deformation inside the eye, image field distortion, image artifacts, and bulk motion due to patient movement and physiological tremor. We present an automated instrument-tracking method by leveraging multimodal imaging and deep-learning to dynamically detect surgical instrument positions and re-center imaging fields for 4D video-rate visualization of ophthalmic surgical maneuvers. We are able to achieve resolution-limited tracking accuracy at varying instrument orientations as well as at extreme instrument speeds and image defocus beyond typical use cases. As proof-of-concept, we perform automated instrument-tracking and 4D imaging of a mock surgical task. Here, we apply our methods for specific applications in ophthalmic microsurgery, but the proposed technologies are broadly applicable for intraoperative image-guidance with high speed and accuracy.