Registration of Endoscopic Optical Information to Volumetric Imaging

背景：在医学实践中，放射学和内窥镜/光学成像各自提供互补和独特的临床信息。放射成像测量以3D空间坐标提供的大块组织属性，精确匹配物理对象的属性。然而，它的对比度和分辨率不足以识别临床上重要的粘膜信息。内镜下光学成像对疾病诊断和监测粘膜解剖治疗反应具有重要意义。然而，这样的二维光学图像在空间上与主体的三维空间坐标/解剖结构是脱节的，或者它们的空间关系可能由观看者间接推断出来。***从临床角度来看，缺少的是解剖学背景和内窥镜信息与放射成像提供的大块组织特性之间的关系。对于许多发生在头颈部、胃肠道、肺部等中空器官的疾病，将内窥镜成像在空间上精确映射到整体放射成像，可以提高诊断和治疗水平。***尝试使用跟踪技术和计算机视觉实现这种配准是不准确的或难以在空心器官中实现。中空器官的真正三维内窥镜成像仍然难以捉摸；特别是一个版本注册到标准放射成像，包括地下信息。***我们的长期目标是开发符合标准放射成像的“完整”3D光学/内窥镜成像包。该系统将专门为使用内窥镜成像的中空器官设计，其目标是将表面拓扑的二维光学图像和从光学断层扫描获得的地下信息注册为三维解剖成像。本提案的主要目标是核心技术的技术开发和测试，而不是临床验证和部署。为了实现这一目标，我们提出了两个总体目标。第一个目标是3D内窥镜，其中二维内窥镜图像被映射到物体的三维表面上。我们的目标是表面拓扑与CT图像之间的配准误差达到80%。***就其本身而言，所提出的目标是独特的，在每个领域都提供了重大进展：任何形式的中空器官3D内窥镜检查都将具有实质性的临床益处，而越来越多的临床采用光学断层扫描需要提高此处提出的重建精度。光学和放射成像的整合将大大提高空心器官疾病的诊断和治疗计划。

Background: In medical practice, radiological and endosopic/optical imaging each supply complimentary and unique clinical information. Radiological imaging measures bulk tissue properties supplied in 3D spatial coordinates that accurately match those of the physical subject. However, it has insufficient contrast and resolution to identify clinically important mucosal information. Endoscopic optical imaging is invaluable for disease diagnosis, and monitoring treatment response of mucosal anatomy. However, such 2D optical images are spatially disconnected from the subject's 3D spatial coordinates/anatomy or their spatial relationship may be inferred indirectly by the viewer. ***From the clinical perspective, what is missing is the anatomical context and relationship of the endoscopy information with respect to the bulk tissue properties supplied by the radiological imaging. For many diseases in hollow organs such as the head and neck, gastrointestinal tract and lung, spatially accurate mapping of endoscopic imaging to bulk radiological imaging would improve diagnosis and treatment. ***Attempts to achieve such registration using tracking technologies and computer vision are inaccurate or difficult to implement in hollow organs. True 3D endoscopic imaging for hollow organs remains elusive; especially a version registered to standard radiological imaging that includes subsurface information.***Our long-term vision is the development of a “full” 3D optical/endoscopic imaging package registered to standard radiological imaging. The system will be designed specifically for hollow organs using endoscopic imaging, with the goal of registering both 2D optical images of the surface topology and subsurface information derived from optical tomography to 3D anatomical imaging. The primary objective in this proposal is the technology development and testing of the core technologies, not clinical verification and deployment. We propose two general objectives to achieve this goal. The first objective is 3D endoscopy in which 2D endoscopic images are mapped onto a 3D surface of the object in view. Our goal is registration error between the surface topology and CT images 80%.***On their own, the proposed objectives are unique, offering significant advances in each field: any form of 3D endoscopy for hollow organs will have substantial clinical benefit while increased clinical adoption of optical tomography requires the improved reconstruction accuracy proposed here. Integration of optical and radiological imaging will substantially improve disease diagnosis and treatment planning in hollow organs.