Collaborative Research: Programming Models and Storage System for High Performance Computation with Many-Core Processors

未来使用多核芯片构建的高端计算(HEC)系统的一个主要挑战是存储系统，因为随着每个芯片的核心数量迅速增加，每个处理器核心的可用内存和带宽开始以惊人的速度下降。需要大数据集和/或高输入输出带宽的数据密集型应用程序尤其容易受到这些趋势的影响。在历史上，HEC系统的存储体系结构在很大程度上受到底层操作系统(OS)中的文件系统接口的限制。本研究的重点是探索一种新的基于一次写入树结构的存储模型。这项研究将为存储系统的用户探索三种编程模型，它们都可以通过共享的持久数据来互操作：1)声明性编程模型，其中任何数据结构可以直接在存储系统中持久，而无需程序员干预；2)强类型命令式编程模型，其中类型系统扩展将用于强制区分可以直接持久的数据结构和不能持久的数据结构；以及3)弱类型的运行时接口，使得低级C程序能够访问存储系统。

A major challenge for future High End Computing (HEC) systems built using many-core chips is the storage system since the available memory and bandwidth per processor core is starting to decline at an alarming rate, with the rapid increase in the number of cores per chip. Data-intensive applications that require large data sets and/or high input-output bandwidth will be especially vulnerable to these trends. Historically, the storage architecture of an HEC system has been constrained to a large degree by the filesystem interfaces in the underlying Operating System (OS). The specific focus of this research is on exploring a new storage model based on write-once tree structures. This research will explore three programming models for users of the storage system, all of which can inter-operate through shared persistent data: 1) a declarative programming model in which any data structure can be directly made persistent in the storage system, with no programmer intervention, 2) a strongly-typed imperative programming model in which a type system extension will be used to enforce a separation between data structures that can be directly made persistent and those that cannot, and 3) a weakly-typed runtime interface that enables low-level C programs to access the storage system.