Novel Pixelwise Co-Registered Hematoxylin-Eosin and Multiphoton Microscopy Image Dataset for Human Colon Lesion Diagnosis.
Novel Pixelwise Co-Registered Hematoxylin-Eosin and Multiphoton Microscopy Image Dataset for Human Colon Lesion Diagnosis.
复制标题
DOI：
10.1016/j.jpi.2022.100012
复制
发表时间：
2022
影响因子：
--
通讯作者：
Saratxaga CL
中科院分区：
文献类型：
--
作者：
Picon A;Terradillos E;Sánchez-Peralta LF;Mattana S;Cicchi R;Blover BJ;Arbide N;Velasco J;Etzezarraga MC;Pavone FS;Garrote E;Saratxaga CL
结直肠癌是世界上发病率最高的癌症之一。结肠镜检查依赖于切除组织的苏木精-伊红（H&E）图像的组织病理学分析。新技术，如多光子显微镜（MPM）显示出有前途的结果进行实时光学活检。然而，临床医生不习惯这种成像模式，MPM和H&E信息之间的相关性尚不清楚。本文的目的是描述并公开提供一个广泛的数据集，充分共同注册的H&E和MPM图像，使研究界能够分析MPM和H&E组织病理学图像之间的关系，以及语义差距的影响，防止临床医生正确诊断MPM图像。该数据集提供了通过结肠镜检查和结肠切除术获得的50个病变样本的10倍光学分辨率（0.5 µm/px）的全扫描组织图像。比较了TPF和H&E图像的诊断能力。此外，TPF瓷砖通过深度学习模型虚拟地染色到H&E图像中。由5名专家病理学家组成的小组将不同的模式分为三类（健康、腺瘤/增生和腺癌）。结果表明，病理学家对MPM图像的性能是H&E性能的65%，而虚拟染色方法达到90%。MPM成像可以提供适当的信息，用于诊断结直肠癌，而无需H&E染色。然而，需要纠正方式之间现有的语义差距。
Colorectal cancer presents one of the most elevated incidences of cancer worldwide. Colonoscopy relies on histopathology analysis of hematoxylin-eosin (H&E) images of the removed tissue. Novel techniques such as multi-photon microscopy (MPM) show promising results for performing real-time optical biopsies. However, clinicians are not used to this imaging modality and correlation between MPM and H&E information is not clear. The objective of this paper is to describe and make publicly available an extensive dataset of fully co-registered H&E and MPM images that allows the research community to analyze the relationship between MPM and H&E histopathological images and the effect of the semantic gap that prevents clinicians from correctly diagnosing MPM images. The dataset provides a fully scanned tissue images at 10x optical resolution (0.5 µm/px) from 50 samples of lesions obtained by colonoscopies and colectomies. Diagnostics capabilities of TPF and H&E images were compared. Additionally, TPF tiles were virtually stained into H&E images by means of a deep-learning model. A panel of 5 expert pathologists evaluated the different modalities into three classes (healthy, adenoma/hyperplastic, and adenocarcinoma). Results showed that the performance of the pathologists over MPM images was 65% of the H&E performance while the virtual staining method achieved 90%. MPM imaging can provide appropriate information for diagnosing colorectal cancer without the need for H&E staining. However, the existing semantic gap among modalities needs to be corrected.