Elements: Development of Assumption-Free Parallel Data Curing Service for Robust Machine Learning and Statistical Predictions

庞大而不完整的数据集给研究中的统计预测带来了重大挑战。该项目将开发一种数据固化服务，能够管理大型、不完整和多样化的数据集，并为固化数据提供不确定性度量。该项目确定并与几个社区合作，这些社区的数据服务是科学研究的核心，包括土木工程、建筑科学、城市能源和社会科学。该工作创建了一个并行数据固化服务，为固化数据提供了不确定性度量，并开发了补充的输入算法。该团队开发了一个数据处理平台，可以对不完整的异构数据进行输入；强大的机器学习（ML）和统计预测将通过开发一个易于使用，通用，大型数据友好的imputation程序来建立。重点是三种已建立的插补方法的新组合：基于两级有限混合模型的插补（FMMI），分数热甲板插补（FHDI）和基于高斯混合模型的插补（GMMI），也将提供R中的并行实现。该奖项由美国国家科学基金会高级网络基础设施办公室颁发，由刺激竞争研究的既定计划（EPSCoR）共同资助。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Large, incomplete datasets create major challenges for statistical prediction in research. This project will develop a data curing service that is able to manage large, incomplete, and diverse datasets, and would provide uncertainty measures for the cured data. The project identifies and collaborates with several communities where this data service is central to scientific research, including civil engineering, building science, urban energy, and social science. The effort creates a parallel data curing service, provides uncertainty measures for the cured data, and develops supplementary imputing algorithms. The team develops a data curing platform with imputation for incomplete, heterogeneous data; robust machine learning (ML) and statistical predictions would be established by developing an easy-to-use, general-purpose, large data-friendly imputation program. The focus is on a novel combination of three established imputation methods: two-level finite mixture model-based imputation (FMMI), fractional hot deck imputation (FHDI), and Gaussian mixture model-based imputation (GMMI), for which parallel implementations in R would also be provided. This award by the NSF Office of Advanced Cyberinfrastructure is jointly funded by the Established Program to Stimulate Competitive Research (EPSCoR).This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.