EAGER: Preserve/Destroy Decisions for Simulation Data in Computational Physics and Beyond

科学研究界越来越多地开发共享和重用研究数据的方法，从而允许从以前的研究投资中获得更多的发现。对共享和可重用性的关注主要集中在实验和观测数据上。这个项目解决了同样令人烦恼的挑战，即如何最好地利用和重用计算模拟中产生的大量数据。指导本项目的重要研究问题包括：模拟结果可复制的程度；与提供计算软件以便其他人可以重新运行模拟相比，存储仿真数据本身以供他人重用的优点；了解哪些软件测试实践可以促进模拟数据的复制/重用以及产生这些数据的模拟软件。主要研究人员将通过对一组计算物理模拟数据集和软件代码进行广泛的复制和软件代码测试来解决这些问题，这些数据集和软件代码是他们通过先前的研究收集的。该项目将产生公开可用的、完全可复制的计算物理作品，作为以数据和代码可有效重用的方式发布结果的示例。主要研究人员的目标是提高对与基于仿真的研究相关的代码和数据的可重用性的理解和增加。该项目旨在更好地为模拟环境中的数据销毁/保存决策提供信息，以提高模拟数据和代码的可重用性和互操作性。该项目还将考虑一些重要的问题，例如软件工程测试实践如何与计算物理实践相关联，以及计算环境中的变化如何影响代码执行和模拟数据的再生。最终，这项工作的结果旨在指导研究社区如何最好地生产和传播研究代码。预计计算物理学的结果可以扩展到为其他社区制定模拟数据和代码共享的一般准则，为此进行适当的代码测试，以及开发相关网络基础设施和工具的最佳实践。该项目由美国国家科学基金会公共访问计划提供支持，该计划由美国国家科学基金会高级网络基础设施办公室代表基金会管理。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The scientific research community has been increasingly developing ways to share and re-use research data, thereby allowing more discoveries to be made from previous research investments. Much of the focus on sharing and reusability has been on experimental and observational data. This project addresses the equally vexing challenge of how to make best use and re-use of the massive data produced in computational simulations. Important research questions guiding this project include: the degree to which simulation results can be replicated; the advantages of storing the simulation data itself for others to reuse as compared to providing the computational software so that others can re-run the simulations; and understanding which software testing practices can facilitate the replication/reuse of simulation data and the simulation software that produces those data. The principal investigators will address these questions by performing extensive replication and software code testing on a set of computational physics simulation datasets and software code that they had gathered through a previous study. The project will produce publicly available, fully reproducible computational physics works as examples for publishing results in a way that the data and code are effectively reusable.The principal investigators aim to improve understanding of, and increase, the reusability of the code and data associated with simulation-based research. This project specifically aims to better inform data destroy/preservation decisions in the simulation context, toward improving the reusability and interoperability of simulation data and code. The project will also consider important questions such as how software engineering testing practices relate to computational physics practices, and how changes in computational environments affect code execution and the regeneration of simulation data. Ultimately, the results of this work are intended to guide the research community on how to best produce and disseminate research code. It is anticipated that the results for computational physics can be extended to develop general guidelines for simulation data and code sharing for other communities, the appropriate code testing to do so, and best practices for development of associated cyberinfrastructure and tools. This project is supported by the National Science Foundation's Public Access Initiative which is managed by the NSF Office of Advanced Cyberinfrastructure on behalf of the Foundation.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.