EAGER: SciDatBench: Principles and Prototypes of Science Data Benchmarks

对大型科学数据集的分析需要在数据分析方法以及在分析中使用的信息技术硬件和软件方面进行新的研究。该项目正在调查一套新的科学数据基准，并将其制作成原型，该基准被称为本科学数据基准。它建立了一个新的重要和有代表性的大科学数据集，以及最佳实践分析所需的机器学习算法的典型软件实现。本报告所附文件可用于对研究人员进行快速发展的大数据分析技术的培训。该项目有可能影响广泛的科学学科，最终包括材料科学、环境科学、生命科学(包括流行病学、核聚变、粒子物理、天文学、地震和地球科学)，每个领域都有不止一个具有代表性的问题。本网站生成大数据分析基准的特定实例，并建立维护和增强这些基准的可持续过程。此集合既包括独立的示例，也包括需要多个组件的端到端示例，这些示例在许多科学实验的分析中都可以看到。本网站是一个经批准的科学数据工作组，拥有非常成功的MLPerf活动，有80名组织成员关注行业机器学习基准。正如NSF的使命所表明的那样，本科学数据中心的最新实例正在为促进国家健康、繁荣和福利的科学发现方面的进步做出贡献。该项目正在积极地让代表性不足的社区参与其活动。本奖项支持比较研究，并确定对未来网络基础设施的要求，以支持科学数据分析。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Analysis of large scientific data sets requires new research in both the data analysis methods and the information technology hardware and software to use in the analysis. This project is investigating and prototyping a new set of science data benchmarks, dubbed SciDatBench. It establishes a new collection of important and representative big scientific datasets together with typical software implementations of the machine learning algorithms that are needed for best practice analysis. The SciDatBench collection is accompanied by documentation allowing it to be used in the training of researchers in the rapidly evolving Big Data analysis techniques. The project has a potential to impact a broad range of scientific disciplines including eventually material sciences, environmental sciences, life sciences including epidemiology, fusion, particle physics, astronomy, earthquake, and earth sciences, with more than one representative problem from each of these domains.SciDatBench generates particular instances of big data analysis benchmarks and establishes a sustainable process for maintaining and enhancing them. This collection includes both standalone examples and end-to-end examples needing multiple components that are seen in the analysis of many science experiments. SciDatBench is affiliated as an approved Science Data working group with the very successful MLPerf activity with 80 organizational members looking at Industry machine learning benchmarks. The state-of-the-art examples in SciDatBench are contributing to progress in scientific discovery that advances the national health, prosperity, and welfare, as stated by NSF's mission. The project is proactively involving under-represented communities in its activities. SciDatBench supports comparative studies and identifies requirements for future cyberinfrastructure to support scientific data analysis.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.