CAREER: Architecting a Hardware-Software Co-Designed Data Management System for Heterogeneous Memory Computers

职业:为异构内存计算机构建软硬件协同设计的数据管理系统

基本信息

  • 批准号:
    2144883
  • 负责人:
  • 金额:
    $ 60.51万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Continuing Grant
  • 财政年份:
    2022
  • 资助国家:
    美国
  • 起止时间:
    2022-07-01 至 2027-06-30
  • 项目状态:
    未结题

项目摘要

Data processing is integral to society, and the amount of data our computing systems are asked to process is growing rapidly. For example, some of today’s artificial intelligence (AI) and machine learning (ML) workloads have billions of parameters requiring terabytes of working memory for training and inference. To efficiently process this deluge of data, the data must first be moved from distant random-access memory to memory closer to the processor. In today’s systems, this data movement itself is one of the most expensive aspects of computation in terms of both performance and energy/power. To improve the efficiency of computing systems, this CAREER project aims to answer the question “where should data be placed and when should it move from one memory type to another?” The main insight driving this CAREER proposal is that bridging the semantic gap between the application which knows how the data is used and the hardware which directly interacts with the data will enable a new set of optimizations. Leveraging this insight, this CAREER project will develop a new interface for data movement which separates the data movement mechanism from the data movement policies. This separation of concerns will enable programmer hints and runtime-directed data movement which will significantly increase the performance and efficiency of heterogeneous memory systems.This CAREER project will improve the efficiency and performance of a wide variety of applications including AI/ML which increasingly depend on both high memory performance and large memory capacities. To broaden the impact, the techniques developed in this project will be realized in software, as a hardware-software codesign, and as hardened logic. Further, the software models, systems, and hardware prototypes will be released open source as they are developed. This CAREER project will also lay the foundation for a sustainable undergraduate research internship program at UC Davis. This program will give experience with open-source software development, career development opportunities, and hands-on hardware-software co-design experience.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
数据处理是社会不可或缺的一部分,我们的计算系统需要处理的数据量正在迅速增长。例如,当今的一些人工智能(AI)和机器学习(ML)工作负载具有数十亿个参数,需要TB的工作内存进行训练和推理。为了有效地处理这些海量数据,必须首先将数据从远程随机存取存储器移动到离处理器较近的存储器。在当今的系统中,这种数据移动本身是性能和能量/功率方面最昂贵的计算方面之一。为了提高计算系统的效率,这个CAREER项目旨在回答“数据应该放在哪里,什么时候应该从一种内存类型移动到另一种内存类型?”推动这一CAREER提案的主要观点是,弥合知道如何使用数据的应用程序与直接与数据交互的硬件之间的语义差距,将实现一组新的优化。利用这一洞察力,这个CAREER项目将开发一个新的数据移动接口,将数据移动机制与数据移动策略分开。这种关注点的分离将使程序员提示和运行时导向的数据移动成为可能,这将显著提高异构内存系统的性能和效率。这个CAREER项目将提高包括AI/ML在内的各种应用的效率和性能,这些应用越来越依赖于高内存性能和大内存容量。为了扩大影响,在这个项目中开发的技术将在软件中实现,作为硬件-软件协同设计,并作为硬化逻辑。此外,软件模型,系统和硬件原型将在开发时开源发布。这个职业生涯项目也将为加州大学戴维斯分校的可持续本科研究实习计划奠定基础。该计划将提供开源软件开发经验,职业发展机会和实际操作的硬件-软件协同设计经验。该奖项反映了NSF的法定使命,并通过使用基金会的智力价值和更广泛的影响审查标准进行评估,被认为值得支持。

项目成果

期刊论文数量(2)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Efficient Large Scale DLRM Implementation On Heterogeneous Memory Systems
异构内存系统上的高效大规模 DLRM 实现
  • DOI:
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Hildebrand, Mark;Lowe-Power, Jason;Akella, Venkatesh
  • 通讯作者:
    Akella, Venkatesh
SoK: Limitations of Confidential Computing via TEEs for High-Performance Compute Systems
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Jason Lowe-Power其他文献

Jason Lowe-Power的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Jason Lowe-Power', 18)}}的其他基金

Collaborative Research: Frameworks: Advancing Computer Hardware and Systems' Research Capability, Reproducibility, and Sustainability with the gem5 Simulator Ecosystem
协作研究:框架:利用 gem5 模拟器生态系统提升计算机硬件和系统的研究能力、可重复性和可持续性
  • 批准号:
    2311888
  • 财政年份:
    2023
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
Travel: NSF Student Travel Grant for 2023 Workshop on Modeling & Simulation of Systems and Applications (ModSim 2023)
旅行:2023 年建模研讨会 NSF 学生旅行补助金
  • 批准号:
    2330207
  • 财政年份:
    2023
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
The International Symposium on Computer Architecture (ISCA) 2019 Travel Grant
计算机体系结构国际研讨会 (ISCA) 2019 旅费资助
  • 批准号:
    1928783
  • 财政年份:
    2019
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
CRII: CSR: Programmable Heterogeneous Memory Systems via Multiple Address Spaces and RAM Lake
CRII:CSR:通过多个地址空间和 RAM Lake 的可编程异构内存系统
  • 批准号:
    1850566
  • 财政年份:
    2019
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
CCRI: ENS: Collaborative Research: Modernizing gem5: Expanding the Reach of Computer Architecture Simulation
CCRI:ENS:协作研究:现代化 gem5:扩大计算机体系结构仿真的范围
  • 批准号:
    1925724
  • 财政年份:
    2019
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant

相似海外基金

Collaborative Research: CSR: Medium: Architecting GPUs for Practical Homomorphic Encryption-based Computing
协作研究:CSR:中:为实用的同态加密计算构建 GPU
  • 批准号:
    2312276
  • 财政年份:
    2023
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Continuing Grant
DMREF/Collaborative Research: Architecting DNA Nanodevices into Metamaterials, Transducing Materials, and Assembling Materials
DMREF/合作研究:将 DNA 纳米器件构建为超材料、转换材料和组装材料
  • 批准号:
    2323968
  • 财政年份:
    2023
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
Conference: Towards Re-architecting Today's Internet for Survivability
会议:重新构建当今互联网的生存能力
  • 批准号:
    2332178
  • 财政年份:
    2023
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
DMREF/Collaborative Research: Architecting DNA Nanodevices into Metamaterials, Transducing Materials, and Assembling Materials
DMREF/合作研究:将 DNA 纳米器件构建为超材料、转换材料和组装材料
  • 批准号:
    2323969
  • 财政年份:
    2023
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
CAREER: Architecting Datacenters for Optimized Tail Latency at Scale
职业:构建数据中心以大规模优化尾部延迟
  • 批准号:
    2237434
  • 财政年份:
    2023
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: Architecting GPUs for Practical Homomorphic Encryption-based Computing
协作研究:CSR:中:为实用的同态加密计算构建 GPU
  • 批准号:
    2312275
  • 财政年份:
    2023
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Continuing Grant
Explaining and Architecting Intelligent and Connected Software Systems
解释和构建智能互联软件系统
  • 批准号:
    RGPIN-2018-05923
  • 财政年份:
    2022
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Discovery Grants Program - Individual
Aircraft systems architecting methodologies for more electric, hybrid and unconventional configurations
用于更多电动、混合动力和非常规配置的飞机系统架构方法
  • 批准号:
    RGPIN-2019-05515
  • 财政年份:
    2022
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Discovery Grants Program - Individual
SHF: Small: Architecting the COSMOS:A Combined System of Optical Phase Change Memory and Optical Links
SHF:小型:构建 COSMOS:光学相变存储器和光学链路的组合系统
  • 批准号:
    2131127
  • 财政年份:
    2021
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
Collaborative Research: Theory-Grounded Guidelines for Solver-Aware System Architecting (SASA)
协作研究:基于理论的求解器感知系统架构指南 (SASA)
  • 批准号:
    2129539
  • 财政年份:
    2021
  • 资助金额:
    $ 60.51万
  • 项目类别:
    Standard Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了