Utilizing Memory Parallelism for High Performance Data Processing

虽然微处理器设计的进步继续提高计算速度，但计算系统的数据访问速度的改进远远落后。与此同时，信息检索、计算机动画和大数据分析等数据密集型大规模应用正在兴起。数据访问延迟已成为现代高性能计算的重要性能瓶颈。存储器并发存在于现代存储器层次结构的每一层;然而，传统的计算系统主要被设计为提高CPU利用率，并且在解决HPC中的数据移动的关键问题方面具有固有的限制。在本研究中，PI提出了内存并行的概念和定制并行内存（CuPM）系统架构，以解决数据移动瓶颈问题。CuPM是一种旨在利用内存并发来支持高性能数据处理（HPDP）的体系结构。这个新的抽象提取的并行存储系统的一般原则，通过建立在新的并发AMAT指标，一组新的理论结果，在数据访问并发性，一系列最近的成功，在并行I/O优化，和新的技术机会。CuPM是一种新的跨层和跨领域的方法，用于探索和利用当前和未来的存储技术，其基础是存储器并发性带来的机会。CuPM的关键新思想是建立一种系统的方法来探索，增强，利用和定制内存并发，以构建有效的内存系统。它的发展有两个目标：理解和揭示内存并发及其属性，并探索和利用现有的HPDP内存并发。前者将评估后者的潜力;而后者将验证和测试前者。它们共同使CuPM能够解决极端计算的核心挑战？高效的记忆系统所提出的CuPM体系结构有可能从应用程序到运行时，通过架构转换系统。

While advances in microprocessor design continue to increase computing speed, improvements in data access speed of computing systems lag far behind. At the same time, data-intensive large-scale applications, such as information retrieval, computer animation, and big data analytics are emerging. Data access delay has become the vital performance bottleneck of modern high performance computing (HPC). Memory concurrency exists at each layer of modern memory hierarchies; however, conventional computing systems are primarily designed to improve CPU utilization and have inherent limitations in addressing the critical issue of data movement in HPC. In this research, the PI proposes the concept of memory parallelism and the customized parallel memory (CuPM) system architecture in order to address data movement bottleneck issues. CuPM is an architecture designed to exploit memory concurrency to support high performance data processing (HPDP). This new abstraction extracts the general principles of parallel memory system by building on the new Concurrent-AMAT metric, a set of fresh theoretical results in data access concurrency, a series of recent successes in parallel I/O optimization, and new technology opportunities. CuPM is a novel cross-layer and cross-cutting approach for exploring and utilizing current and future memory technologies based on opportunities arising from memory concurrency.Current HPC systems do not fully recognize or exploit the concurrency that modern memory systems provide. The key new idea of CuPM is to establish a systematic way of exploring, enhancing, utilizing, and customizing memory concurrency to build effective memory systems. It will be developed with two goals: to understand and reveal the memory concurrency and its properties, and to explore and utilize current memory concurrency for HPDP. The former will evaluate the potential of the latter; while the latter will verify and testing the former. Together, they enable CuPM to address a central challenge for extreme computing ? efficient memory systems. The proposed CuPM architecture has the potential to transform systems from application through runtime through architecture.