ENRICHing NIH Imaging Datasets to Prepare them for Machine Learning

项目摘要 目的：母提案的目标是开发和优化深度学习（DL）以提高检测能力 先天性心脏病（CHD）的胎儿超声成像。这项工作包括评价成像 收集跨越二十年，数万名患者，和几个临床中心在一系列 医疗保健设置。背景：通过这项工作，我们发现DL模型的性能 这与用于训练和测试它们的数据集的质量密切相关。然而，AI/ML领域缺乏 全面了解如何衡量“质量”。到目前为止，图像数据集要么是主观描述的， 或者粗略地通过大小来测量，即它们包含的图像的数量。然而，“越多越好”并没有说明 多样性在图像数据集质量中的关键重要性。在目标1中，我们试图开发 数据集质量和内容的更好指标，建立在信息理论和利用多样性的基础上。这项工作 已经证明对于我们的父用例非常有用，但对于所有成像也非常重要 数据集，以节省数据存储/传输成本，智能地协调数据，节省费力的图像 标签，筛选预期和非预期的伪影，并确保多个级别的多样性。 初步研究：我们在成像，DL和信息理论方面的多学科团队已经成功地 开发了一个框架来分析图像数据集，称为ENRICH。ENRICH包括两个主要步骤。第一、 为给定数据集中的所有图像对计算相似性度量，形成成对相似性矩阵 价值观其次，实例选择算法对矩阵进行操作以描述其多样性和/或策展性。 最具信息性的图像。ENRICH是可定制的，因为成对图像相似性的不同选择 度量和策展算法可用于不同的任务。ENRICH的初步实施旨在 减少冗余使我们能够在CHD分类任务中仅从 原始训练数据的一小部分。它还可以识别数据结构和成像伪影，而无需先验 标签，以及其他成就（见研究策略）。补充的目标：下一个合乎逻辑的步骤是 将ENRICH应用于更多的生物医学数据集，以进一步验证其实用性，并提供定量的 数据集质量描述符对研究界很重要。目标：（1）我们将在 几个NIH成像数据集，包括（2）验证标签并向目标子集添加注释， 这些数据集。(3)我们将记录并公布这些方法供研究界使用，包括 与每个数据集的原始NIH存储库连接。环境和影响：拟议的这项工作是 在数据科学、成像和信息理论交叉点的出色环境中提供支持 并将提供有价值的工具和洞察力，以了解如何最好地衡量图像数据集的内容和质量， 严格培训和测试DL的生物医学任务。

PROJECT SUMMARY Objective: The goal of the parent proposal is to develop and optimize deep learning (DL) to improve detection of congenital heart disease (CHD) from fetal ultrasound imaging. This work includes evaluation of an imaging collection spanning two decades, tens of thousands of patients, and several clinical centers across a range of healthcare settings. Background: Through this work, we have found that performance of DL models is critically linked to the quality of the datasets used to train and test them. However, the AI/ML field lacks a complete understanding of how to measure “quality.” To date, image datasets are either described subjectively or measured crudely by size, i.e. the number of images they contain. However, “more is better” fails to account for the key importance of diversity in the quality of image datasets. In parent Aim 1, we sought to develop better metrics for dataset quality and content, founded in information theory and leveraging diversity. This work has already proven quite useful for our parent use case, but it is also extremely important for all imaging datasets in order to save on data storage/transfer costs, harmonize data intelligently, save on laborious image labeling, screen for artifacts both anticipated and un-anticipated, and ensure diversity at several levels. Preliminary Studies: Our multi-disciplinary team in imaging, DL, and information theory has successfully developed a framework to analyze image datasets, called ENRICH. ENRICH consists of two main steps. First, a similarity metric is calculated for all pairs of images in a given dataset, forming a matrix of pairwise-similarity values. Second, an instance-selection algorithm operates on the matrix to describe its diversity and/or curate the most informative images. ENRICH is customizable in that different choices for pairwise image similarity metric and for curation algorithm can be used for different tasks. An initial implementation of ENRICH aimed at reducing redundancy allowed us to get the same DL model performance in a CHD classification task from only a fraction of the original training data. It also identified data structure and imaging artifacts without a priori labeling, among other achievements (see Research Strategy). Goals of Supplement: The next logical step is to apply ENRICH to more biomedical datasets, both to further validate its utility and to provide quantitative descriptors of quality on datasets important for the research community. Aims: (1) We will run ENRICH on several NIH imaging datasets, including (2) validating labels and adding annotations to targeted subsets of these datasets. (3) We will document and publish these methods for the research community to use, including connecting with the original NIH repository for each dataset. Environment and Impact: This work proposed is supported in an outstanding environment at the crossroads of data science, imaging, and information theory and will provide valuable tools and insight into how best to measure image dataset content and quality in order to rigorously train and test DL for biomedical tasks.