SPX: CISIT: Computing In Situ and In Memory for Hierarchical Numerical Algorithms

SPX：CISIT：分层数值算法的原位和内存计算

• 批准号: 1725743
• 负责人: George Biros
• 金额: $ 80万
• 依托单位: University of Texas at Austin
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-10-01 至 2020-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1725743&HistoricalAwards=false
• 关键词: SPX; CISIT; Computing; Situ; Memory

High performance computing holds an enormous promise for revolutionizing science, technology, and everyday life through modeling and simulation, statistical inference, and artificial intelligence. Despite the numerous successes in software and hardware technologies, energy efficiency barriers have become a major hurdle towards more powerful computers -- from mobile devices all the way to supercomputers. The originally natural separation between the memory subsystem and the central processing unit (CPU) of a computer has emerged as one the main reasons for energy inefficiency. Data movement between the memory and the CPU requires orders of magnitude more energy than the computations themselves. To address these challenges, this project will consider novel architectural design paradigms and algorithms that are aimed at blurring these traditional boundaries between separated memory and computation subsystems and, by distributing computations to be performed directly in the memory or as part of the memory data transfers, achieve order of magnitude gains inenergy efficiency and performance. This project will investigate such novel approaches in the context of a class of methods in computational mathematics, which appear at the core of many problems in computational science, large-scale data analytics, and machine learning.Specifically, this project will focus on data-driven rather than compute-driven co-design of algorithms and architectures for the construction, approximation, and factorization of hierarchical matrices. The end-goal of the project is the design of a novel architecture, CISIT (for ``Computing In Situ and In Transit''), that specifically aims to address acceleration of both computation and data movement in the context of hierarchical matrices. CISIT will uniquely combine traditional general-purpose CPU and GPU cores with: (1) acceleration of core algorithmic primitives using custom hardware; (2) in-situ computing capabilities that will comprise both processing in or near main memory as well as computing within on-chip caches and memory close to the cores; (3) novel in-transit compute capabilities that will enable cutting down on and in many cases completely eliminating unnecessary roundtrip data transfers by processing of data transparently as it is transferred between main memory and local compute cores across the cache hierarchies. Upon success, CISIT will influence future architectural implementations. Along with the research activities, an educational and dissemination program will be designed to communicate the results of this work to both students and researchers, as well as a more general audience of computational and application scientists.

通过建模和模拟、统计推理和人工智能，高性能计算为科学、技术和日常生活带来了巨大的变革前景。尽管在软件和硬件技术方面取得了许多成功，但从移动设备到超级计算机，能源效率障碍已经成为迈向更强大计算机的主要障碍。计算机的存储子系统和中央处理单元(CPU)之间最初的自然分离已经成为能源效率低下的主要原因之一。内存和CPU之间的数据移动需要比计算本身多几个数量级的能量。为了应对这些挑战，该项目将考虑新的架构设计范例和算法，旨在模糊这些独立的内存和计算子系统之间的传统界限，并通过将计算直接在内存中执行或作为内存数据传输的一部分进行分配，在能效和性能方面实现数量级的收益。这个项目将在计算数学中的一类方法的背景下研究这样的新方法，这些方法出现在计算科学、大规模数据分析和机器学习中的许多问题的核心。具体地说，这个项目将专注于针对分层矩阵的构造、逼近和因式分解的算法和架构的数据驱动而不是计算驱动的协同设计。该项目的最终目标是设计一种新的体系结构--CIIT(用于“原地计算和在途计算”)，其具体目的是在分层矩阵的背景下加速计算和数据移动。CISIT将以独特的方式将传统的通用CPU和GPU内核结合在一起：(1)使用定制硬件加速内核算法原语；(2)原位计算功能，包括在主内存中或主内存附近进行处理，以及在片上缓存和接近内核的内存中进行计算；(3)新颖的在途计算功能，通过在跨缓存层次结构的主内存和本地计算内核之间传输数据时透明地处理数据，减少甚至在许多情况下完全消除不必要的往返数据传输。一旦成功，CISIT将影响未来的体系结构实现。除了研究活动，还将设计一个教育和传播计划，向学生和研究人员以及更广泛的计算和应用科学家受众传达这项工作的结果。

项目成果

Off-Chip Congestion Management for GPU-based Non-Uniform Processing-in-Memory Networks

基于 GPU 的非均匀处理内存网络的片外拥塞管理

• DOI: 10.1109/pdp50117.2020.00050
• 发表时间: 2020
• 期刊: and Network-Based Processing (PDP
• 作者: Punniyamurthy, Kishore;Gerstlauer, Andreas
• 通讯作者: Gerstlauer, Andreas

CLAIRE: A DISTRIBUTED-MEMORY SOLVER FOR CONSTRAINED LARGE DEFORMATION DIFFEOMORPHIC IMAGE REGISTRATION.

• DOI: 10.1137/18m1207818
• 发表时间: 2019
• 期刊: SIAM journal on scientific computing : a publication of the Society for Industrial and Applied Mathematics
• 作者: Mang A;Gholami A;Davatzikos C;Biros G
• 通讯作者: Biros G

Cacheline Utilization-Aware Link Traffic Compression for Modular GPUs

模块化 GPU 的缓存线利用率感知链路流量压缩

• DOI: 10.1109/vlsid49098.2020.00041
• 发表时间: 2020
• 期刊: IEEE International Conference on VLSI Design and Embedded Systems (VLSID
• 作者: Punniyamurthy, Kishore;Das, Shomit;Gerstlauer, Andreas
• 通讯作者: Gerstlauer, Andreas

HALO: A Hierarchical Memory Access Locality Modeling Technique For Memory System Explorations

• DOI: 10.1145/3205289.3205323
• 发表时间: 2018-06
• 期刊: Proceedings of the 2018 International Conference on Supercomputing
• 作者: Reena Panda;L. John

A Case for Granularity Aware Page Migration

• DOI: 10.1145/3205289.3208064
• 发表时间: 2018-06
• 期刊: Proceedings of the 2018 International Conference on Supercomputing
• 作者: Jee Ho Ryoo;L. John;Arkaprava Basu