"FLEXIBLE LIGHT FIELD 3D ENDOSCOPY

“灵活光场 3D 内窥镜

• 批准号: 10160906
• 负责人: Liang Gao
• 金额: $ 19.5万
• 依托单位: UNIVERSITY OF CALIFORNIA LOS ANGELES
• 依托单位国家: 美国
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-06-01 至 2022-03-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10160906
• 关键词: 3-Dimensional; Adopted; Algorithms; Architecture; Assessment tool; Benchmarking; Biological; Biopsy; Calibration; Categories; Colon; Color; Data; Development; Diagnosis; Diagnostic; Disease; Duodenum; Endoscopes; Endoscopy; Esophagus; Exploratory/Developmental Grant; Family suidae; Fiber; Future; Gastrointestinal tract structure; General Anesthesia; Generations; Goals; Gold; Image; Imaging Phantoms; Injury; Intervention; Lead; Lesion; Light; Location; Malignant Neoplasms; Measures; Methods; Operative Surgical Procedures; Optics; Organ; Pathologic; Patients; Performance; Phenotype; Photography; Physicians; Research; Research Project Grants; Resected; Resolution; Risk; Sampling; Scanning; Site; Stomach; Structure; Surgical incisions; System; Technology; Temperature; Testing; Three-Dimensional Image; Three-Dimensional Imaging; Time; Tissue imaging; Tissues; Visualization; Work; base; data acquisition; ex vivo imaging; flexibility; high resolution imaging; image registration; imager; imaging capabilities; imaging probe; in vivo; instrument; lens; real time monitoring; spectrograph; three dimensional structure; three-dimensional visualization

Project Summary: The overall goal of this research is to develop a three-dimensional (3D) and multispectral fiber-bundle endoscope for the real-time, non-invasive assessment of biological tissue. Optical endoscopy has been extensively employed worldwide by physicians to diagnose or treat diseases, such as cancer. These probes are inserted into the body through small incisions or natural body openings, providing high-resolution images of internal organs and tissue. Depending on whether the image is transmitted through lenses alone or fibers, optical endoscopes are generally classified into two categories, rigid and flexible. Compared with the rigid counterparts, flexible endoscopes feature a lower rate of complications, increased patient comfort, and a lack of requirement for general anesthesia. Moreover, they allow the visualization of the entire gastrointestinal tract, such as esophagus, stomach, and duodenum, which are generally inaccessible by rigid endoscopes. Despite widespread use, conventional flexible optical endoscopes have been crucially limited to 2D views of pathological sites. Because most tissue lesions manifest themselves as abnormal 3D structural changes, the lack of depth information frequently jeopardizes the diagnostic usefulness. On the other hand, the value of spectral imaging for phenotype description and as a quantitative assessment tool for tissue abnormalities has continued to grow exponentially. Nonetheless, to acquire the color information, most conventional spectral imagers rely on scanning, either in the spatial or spectral domain. Limited by the scanning mechanism, these imagers are generally slow in data acquisition and therefore unsuitable for imaging dynamics. To overcome above limitations, we propose flexible light field endoscopy (Flex-LFE) which will enable 3D and multispectral imaging of tissue lesions in real time. The Flex-LFE will be built upon a computational imaging architecture that has been previously demonstrated in photography. However, rather than imaging macroscopic objects, we will tailor Flex-LFE for flexible endoscopic imaging in two specific aims: i) develop a Flex-LFE for 3D and multispectral imaging of biological tissue, ii) evaluate the probe’s imaging performance both in phantoms and ex vivo. The proposed Flex-LFE will have broad impacts on the endoscopic diagnosis and treatment. The acquisition of 3D and spectral information will facilitate the identification of a variety of tissue lesions, alleviating the need for invasive tissue biopsy. Moreover, the probe’s fast 3D imaging capability will enable real-time monitoring of laparoscopic interventions, providing accurate 3D visualization of surgical sites and thereby reducing the risk of misidentifying structures, a situation that can cause severe patient injuries. As the first instrument of its kind, the development of Flex-LFE will ultimately lead to a new generation of optical 3D endoscopes and make transformative advancements to the state-of-the-art approaches.

项目概述：本研究的总体目标是开发三维(3D)和多光谱 用于对生物组织进行实时、非侵入性评估的纤维束内窥镜。光学内窥镜检查有 被世界各地的医生广泛用于诊断或治疗癌症等疾病。这些 探头通过小切口或自然的身体开口插入人体内，提供高分辨率 内脏和组织的图像。取决于图像是仅通过透镜传输还是通过透镜传输 光纤、光学内窥镜一般分为两类，刚性和柔性。与僵化的 与之对应的是，柔性内窥镜的特点是并发症发生率较低，患者舒适度较高，且缺乏 全身麻醉的要求。此外，它们还可以显示整个胃肠道， 如食道、胃和十二指肠，通常是硬质内窥镜无法接触到的。 尽管广泛使用，但传统的柔性光学内窥镜主要局限于2D视角 病变部位的数量。由于大多数组织损伤表现为异常的3D结构变化， 缺乏深度信息常常危及诊断的有效性。另一方面，它的价值在于 光谱成像用于表型描述和作为组织异常的定量评估工具 继续呈指数级增长。尽管如此，为了获取颜色信息，最常规的光谱 成像器依赖于扫描，无论是在空间域还是在光谱域。受扫描机制的限制，这些 成像仪的数据采集速度普遍较慢，因此不适合用于成像动力学。 为了克服上述限制，我们提出了柔性光场内窥镜(Flex-LFE)，它将使3D 以及组织损伤的实时多光谱成像。Flex-LFE将建立在计算成像的基础上 以前已经在摄影中展示过的建筑。然而，与宏观成像相比， 对象，我们将定制Flex-LFE用于灵活的内窥镜成像，具体有两个目标：i)开发用于3D的Flex-LFE 和生物组织的多光谱成像，II)评估探头在模体中的成像性能 和体外实验。 提出的Flex-LFE将对内窥镜诊断和治疗产生广泛的影响。这个 获取3D和光谱信息将有助于识别各种组织损伤，从而缓解 有必要进行侵入性组织活检。此外，探测器的快速3D成像能力将使实时 监测腹腔镜干预，提供手术部位的准确3D可视化，从而 减少错误识别结构的风险，这种情况可能会导致严重的患者受伤。作为第一个 在同类仪器中，Flex-LFE的发展最终将导致新一代光学3D 内窥镜，并对最先进的方法进行变革性的进步。

项目成果

Developing an optical design pipeline for correcting lens aberrations and vignetting in light field cameras.

• DOI: 10.1364/oe.399735
• 发表时间: 2020-10
• 期刊: Optics express
• 影响因子: 3.8
• 作者: Qi Cui;Shuaishuai Zhu;Liang Gao

Toward the next-generation VR/AR optics: a review of holographic near-eye displays from a human-centric perspective.

• DOI: 10.1364/optica.406004
• 发表时间: 2020-11-20
• 期刊: Optica
• 影响因子: 10.4
• 作者: Chang C;Bang K;Wetzstein G;Lee B;Gao L
• 通讯作者: Gao L

Deep-learning-based image reconstruction for compressed ultrafast photography.

• DOI: 10.1364/ol.397717
• 发表时间: 2020-08-15
• 期刊: Optics letters
• 影响因子: 3.6
• 作者: Ma Y;Feng X;Gao L
• 通讯作者: Gao L

Development of a fast calibration method for image mapping spectrometry.

• DOI: 10.1364/ao.395988
• 发表时间: 2020-07
• 期刊: Applied optics
• 影响因子: 1.9
• 作者: Qi Cui;Jongchan Park;Rishyashring R. Iyer;Mantas Žurauskas;S. Boppart;R. T. Smith;Liang Gao