EAGER: Collaborative Research: A Peer-to-Peer based Storage System for High-End Computing

克莱姆森大学和阿拉巴马大学伯明翰分校(UAB)共同提出了高端计算(HEC)文件系统领域的变革性计算机科学。该项目对于NSF的EIGER计划的任务来说是独一无二的，因为以一种新颖的方式，这项工作的结果将用基于对等(P2P)的可扩展得多的存储系统取代当前的并行文件系统，该存储系统将支持即将到来的亿级计算系统。基于P2P的文件共享概念与HEC的需求和关注点相结合，是一种新的具有性能要求的大规模计算方法。与重构部署在Terascale和Petascale系统上的文件系统的现有方法不同，研究人员试图验证比现有HEC文件系统的逻辑演变及其在Petascale体系结构上的实例提供的高可伸缩性、可用性、完整性和健壮性的替代设计更高的可扩展性、可用性、完整性和健壮性，这一迫切需要的项目将寻求为完全不同的文件系统生成初步/研究原型。该项目将共同研究、设计和创建分布式软件基础设施和相关技术的初步/研究原型，以支持依赖结构化P2P网络的HEC可扩展和可靠的文件存储和检索。如果此项目成功，基于艾级的存储系统的设计/体系结构/战略将在现有文件系统的逻辑演进扩展上发生重大变化，在创建实用的艾级存储系统方面，关键的机会和障碍将得到更清楚的了解。将考虑艾级联合设计方法，并将其与本工作的结果进行比较，从而向其他研究人员介绍基于第一原理方法研究文件系统时艾级联合设计方法的相对优点。

Clemson University and the University of Alabama at Birmingham (UAB) jointly propose transformative computer science in the area of file systems in High-End Computing (HEC). The project is unique to the mission of NSF's EAGER program because, in a novel way, the outcomes of this work will replace current parallel file systems with a substantially more scalable Peer-to-Peer (P2P)-based storage system that will enable forthcoming exascale computing systems. The combination of P2P-based file sharing concepts and HEC requirements and concerns is a novel approach to large-scale computing with performance requirements. The study of exascale storage from first principles is an important class of research to be undertaken, as opposed to refactoring existing approaches to file systems that are deployed on Terascale and Petascale systems.Because the investigators seek to validate alternative designs of high scalability, availability, integrity and robustness than those offered by the logical evolution of existing HEC file systems and their instantiations on Petascale architectures, this EAGER project will seek to produce a preliminary/research prototype for a radically different file system. This project will jointly study, design, and create a preliminary/research prototype for a distributed software infrastructure and related techniques that support scalable and reliable file storage and retrieval for HEC relying on a structured P2P network. If this project is successful, the design/architecture/strategy for exascale-based storage systems will change greatly over the logical evolutionary extensions of existing file systems and key opportunities and barriers will be more clearly understood in regards to the creation of practical exascale storage systems. Exascale co-design approaches will be considered and compared to the outcomes of this work, thereby informing other researchers of the relative merits of co-design approaches for exascale when file systems are studied based on a first-principles approach.