Assuring AI/ML-readiness of digital pathology in diverse existing and emerging multi-omic datasets through quality control workflows

通过质量控制工作流程，确保现有和新兴的多组学数据集中数字病理学的 AI/ML 就绪性

• 批准号: 10841333
• 负责人: Julie Ann Bletz
• 金额: $ 27万
• 依托单位: SAGE BIONETWORKS
• 依托单位国家: 美国
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-09-14 至 2024-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10841333
• 关键词: Adoption; Area; Artificial Intelligence; Basic Science; Biomedical Research; Biopsy; Classification; Clinical; Clinical Research; Collaborations; Data; Data Commons; Data Set; Deposition; Development; Diagnosis; Division of Cancer Biology; Drops; Ensure; Evaluation; Exclusion; FAIR principles; Failure; Funding; Future; Genotype; Genotype-Tissue Expression Project; Grant; Health Resources; Histology; Image; Inferior; Infrastructure; Learning; Link; Machine Learning; Manuals; Masks; Modeling; Morphologic artifacts; Morphology; Multiomic Data; National Cancer Institute; Nephrotic Syndrome; Output; Performance; Play; Process; Prognosis; Quality Control; Reader; Readiness; Reporting; Reproducibility; Research; Research Personnel; Role; Sampling; Science; Slide; Synapses; Techniques; The Cancer Genome Atlas; Time; Tissues; Training; Translational Research; Trust; United States National Institutes of Health; Universities; Validation; Work; anticancer research; biomarker discovery; cohort; comparative; cost; data management; data mining; data quality; data sharing; deep learning; digital pathology; generalist repository; histological image; imaging biomarker; imaging detection; improved; interest; machine learning method; machine learning model; multiple omics; open data; open source; parent grant; programs; prospective; prototype; public repository; repository; success; tool; treatment response; whole slide imaging

Abstract In an era of multi-omics, histology remains an essential approach for basic, translational, and clinical research providing valuable, low-cost, and non-destructive information about tissue morphology. The adoption of whole slide imaging (WSI) and digital pathology (DP) has led to large clinical and research repositories being instantiated for computational data mining of image-based biomarkers associated with genotype, diagnosis, prognosis, and therapy response. Importantly, data quality plays a critical role in the usage of these WSI, especially when employing artificial intelligence (AI) and machine learning (ML) methods. Artifacts and batch effects may arise at many points in the process from biopsy to digitization, and while several tools to detect them have been developed, consistent application and reporting are lacking, with none being routinely applied in public repositories. This leaves a unique opportunity to immediately provide added value to existing and future NIH- supported datasets. This proposal sees a collaboration between Sage Bionetworks, experts in FAIR data sharing and Team Science, and Dr. Andrew Janowczyk, a leader in automated quality control (QC) of WSI who has spearheaded the development of an open-source DP QC tool, HistoQC. We propose to enhance the AI/ML readiness of existing and future DP data by providing transparent, reproducible, reporting of detected imaging artifacts and batch effects within NIH-sponsored datasets in an automated fashion via the extension of our existing QC workflows. Implementing transparent reporting of DP data quality will enable researchers to exclude artifacts from their training sets in a consistent cross-investigator manner. Our work will provide greater trust in dataset reuse and experimental reproducibility while also easing AI/ML model creation and enhancing their performance. We will build on strong preliminary data and prototypes, demonstrating both significantly improved cross-reader QC reproducibility and technical feasibility, with three specific aims. Aim 1 sees this enrichment process will be applied to WSI from NIH-supported public datasets, including TCGA and GTEx, and for NIH/NCI Division of Cancer Biology research programs supported by the Multi-Consortia Coordinating (MC2) Center parent grant. Aim 2 employs the lessons learned from the enhancement of raw DP data to be AI/ML ready in Aim 1 to deploy a scalable workflow for QC of all incoming DP data from MC2-supported programs, providing continual prospective data enrichment to assure AI/ML readiness. Lastly, Aim 3 demonstrates enhanced AI/ML readiness of DP data subjected to our automated QC processes using a prototypical self-supervised tissue classification task. Our deliverables include (a) 5000 WSI annotated by our QC workflow and enhanced into AI/ML ready datasets; (b) workflows to enable processing of incoming datasets for AI-readiness, (c) a failure rate of identifying poor quality slides is <1%; and (d) our QC comparative AI/ML demonstration yields an improvement of >10% performance in terms of tissue classification performance as a result of our data enhancements.

摘要