CRI: A Hierarchical Data Storage System for Large Data Simulation, Comparison, and Visualization

该项目获得了一个大规模分层存储管理（HSM）系统，提供了对犹他州科学计算与成像（SCI）研究所成员和合作者产生和分析的日益庞大的数据集的访问。该研究所创造了新的技术、工具和系统，科学家们可以通过这些技术、工具和系统来解决许多学科中的计算和成像问题。解决这些问题所使用的专业知识包括图像和信号处理、建模、仿真和可视化。这项工作充分发挥了SCI的多学科使命。大规模HSM解决方案提供了生成规范数据集的能力，可供SCI内部的研究人员和外部的许多合作者访问。科学计算领域受到数据集管理和存储问题的限制。数据集的大小和复杂性随着可用的计算资源而并行增长。对建模、仿真和分析数据的集中、随时可用的访问是成功的基础。数据集复杂性是计算资源和算法效率的产物；而复杂问题的研究则依赖于这种不断提高的效率来取得进展。虽然计算速度急剧提高，但产生的模型的复杂性也增加了，因此，虽然模型和模拟提高了它们的研究效率，但生成给定模拟所需的实际计算时间并没有减少。先进的存储架构有助于简化各种数据密集型研究项目的工作流程。更广泛的影响：该机构在通过免费访问的数据集和软件输出其研究成果方面有着坚实的历史。此外，SCI为许多研究生和本科生提供服务。

This project, acquiring a large-scale hierarchical storage management (HSM) system, provides access to the increasingly large datasets produced and analyzed by the members and collaborators of the Scientific Computing and Imaging (SCI) Institute at Utah. This institute creates new techniques, tools, and systems by which scientists may solve computational and imaging problems in many disciplines. The expertise utilized in addressing the problems include image and signal processing, modeling, simulation, and visualization. The work exploits the multidisciplinary mission of SCI. A large-scale HSM solution provides the ability to generate canonical datasets, accessible by researchers within SCI and many collaborators outside. The field of scientific computing is constrained by the problems posed by dataset management and storage. Dataset size and complexity has grown in parallel with available compute resource. Centralized, ready access to the modeling, simulation, and analysis data is fundamental to success. Dataset complexity grows as a product of compute resource and algorithm efficiency; while research in complex problems relies on this ever-increasing efficiency for its progress. Although computational speeds have increased dramatically, the complexity of the models produced has also increased, so that while models and simulations have improved their research effectiveness, the actual computation time needed to generate a given simulation has not declined. An advanced storage architecture helps in streamlining the workflow for a variety of data intensive research projects.Broader Impact: The facility has a solid history of exporting its research via freely accessible datasets and software. Furthermore, SCI services many graduate and undergraduate students.