Collaborative Research: PPoSS: Planning: Model-Driven Compiler Optimization and Algorithm-Architecture Co-Design for Scalable Machine Learning
协作研究:PPoSS:规划:用于可扩展机器学习的模型驱动编译器优化和算法架构协同设计
基本信息
- 批准号:2118737
- 负责人:
- 金额:$ 6.3万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2021
- 资助国家:美国
- 起止时间:2021-08-01 至 2022-07-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
There is an inexorable need for increased computational performance and improved energy efficiency in the development and use of machine-learning (ML) models. Currently available frameworks for ML have limitations in developing non-traditional models, e.g., using tensor networks, as well as in developing and using models that are too large to fit in the physical memory of processors. The design of efficient hardware accelerators and the mapping of ML algorithms to them is another challenge. This planning project presents a plan of action to address these needs via advances to model-driven compiler optimization. The research conducted in this project is enhancing productivity, performance, and portability in developing software for ML. It is enabling new ML applications to be developed with high productivity, with high achieved performance, and performance-portability over a diverse set of hardware platforms. It is enabling greater "democratization of ML", permitting researchers who only have access to low-end hardware platforms to be able to run the largest models -- infeasible today due to limitations of existing ML frameworks. The project involves training activities tailored for K-12 students, undergraduate students, and graduate students. In this planning project, the following primary technical directions are explored: (1) ML Algorithms: flexible new ML models, offering trade-offs between model size, model execution time, model accuracy, and energy efficiency; (2) Optimizing Compilers: advances in polyhedral compiler optimization to enable parametric tilesize optimization and code generation for diverse target platforms, including CPUs, GPUs, and accelerators; (3) ML Accelerators: new ML accelerator designs for sparse and dense operators, optimized for multiple criteria via comprehensive design space exploration. Broader impact aims of the project include the "Democratization of AI”, to enable state-of-the-art ML models to be used by all, on widely available non-state-of-the-art hardware. To achieve these goals, the project integrates expertise in computer architecture, optimizing compilers, ML algorithms, and high-performance computing.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
在机器学习(ML)模型的开发和使用中,迫切需要提高计算性能和提高能源效率。目前可用的ML框架在开发非传统模型方面存在局限性,例如,使用张量网络,以及开发和使用太大而无法容纳在处理器的物理内存中的模型。高效硬件加速器的设计以及ML算法到它们的映射是另一个挑战。这个规划项目提出了一个行动计划,以解决这些需求,通过模型驱动的编译器优化的进步。在这个项目中进行的研究正在提高ML软件开发的生产力,性能和可移植性。它使新的机器学习应用程序能够以高生产力,高性能和在各种硬件平台上的性能可移植性进行开发。它正在实现更大的“ML民主化”,允许只能访问低端硬件平台的研究人员能够运行最大的模型-由于现有ML框架的限制,这在今天是不可行的。该项目涉及为K-12学生,本科生和研究生量身定制的培训活动。在这个计划项目中,探索了以下主要技术方向:(1)ML算法:灵活的新ML模型,提供模型大小,模型执行时间,模型准确性和能源效率之间的权衡;(2)优化编译器:多面体编译器优化的进步,以实现参数瓦片大小优化和代码生成,用于各种目标平台,包括CPU,GPU和加速器;(3)ML加速器:针对稀疏和密集运算符的新ML加速器设计,通过全面的设计空间探索针对多个标准进行优化。该项目更广泛的影响目标包括“人工智能民主化”,使所有人都能在广泛使用的非最先进硬件上使用最先进的ML模型。为了实现这些目标,该项目整合了计算机体系结构、优化编译器、ML算法和高性能计算方面的专业知识。该奖项反映了NSF的法定使命,并通过使用基金会的智力价值和更广泛的影响审查标准进行评估,被认为值得支持。
项目成果
期刊论文数量(2)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Comprehensive Accelerator-Dataflow Co-design Optimization for Convolutional Neural Networks
- DOI:10.1109/cgo53902.2022.9741281
- 发表时间:2022-04
- 期刊:
- 影响因子:0
- 作者:Miheer Vaidya;Aravind Sukumaran-Rajam;A. Rountev;P. Sadayappan
- 通讯作者:Miheer Vaidya;Aravind Sukumaran-Rajam;A. Rountev;P. Sadayappan
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Atanas Rountev其他文献
Atanas Rountev的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Atanas Rountev', 18)}}的其他基金
Collaborative Research: PPoSS: Large: A comprehensive framework for efficient, scalable, and performance-portable tensor applications
协作研究:PPoSS:大型:高效、可扩展和性能可移植的张量应用程序的综合框架
- 批准号:
2216903 - 财政年份:2022
- 资助金额:
$ 6.3万 - 项目类别:
Standard Grant
SHF: Small: PrivAid: Differentially-Private Analytics for Android Apps
SHF:小型:PrivAid:Android 应用程序的差分隐私分析
- 批准号:
1907715 - 财政年份:2019
- 资助金额:
$ 6.3万 - 项目类别:
Standard Grant
SHF: Small: Control-Flow and Data-Flow Analysis of Android Software: Foundations and Applications
SHF:小:Android 软件的控制流和数据流分析:基础和应用
- 批准号:
1526459 - 财政年份:2015
- 资助金额:
$ 6.3万 - 项目类别:
Standard Grant
SHF: Small: LeakDroid: Exposing Leaks and Jank in Android Applications
SHF:小:LeakDroid:暴露 Android 应用程序中的泄漏和卡顿
- 批准号:
1319695 - 财政年份:2013
- 资助金额:
$ 6.3万 - 项目类别:
Standard Grant
SHF: Small: Algorithms for Dynamic Analysis of Run-Time Bloat
SHF:小:运行时膨胀动态分析算法
- 批准号:
1017204 - 财政年份:2010
- 资助金额:
$ 6.3万 - 项目类别:
Standard Grant
CAREER: Dataflow Analysis for Modern Software Systems
职业:现代软件系统的数据流分析
- 批准号:
0546040 - 财政年份:2006
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant
相似国自然基金
Research on Quantum Field Theory without a Lagrangian Description
- 批准号:24ZR1403900
- 批准年份:2024
- 资助金额:0.0 万元
- 项目类别:省市级项目
Cell Research
- 批准号:31224802
- 批准年份:2012
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research
- 批准号:31024804
- 批准年份:2010
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research (细胞研究)
- 批准号:30824808
- 批准年份:2008
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
- 批准号:10774081
- 批准年份:2007
- 资助金额:45.0 万元
- 项目类别:面上项目
相似海外基金
Collaborative Research: PPoSS: Large: A Full-stack Approach to Declarative Analytics at Scale
协作研究:PPoSS:大型:大规模声明性分析的全栈方法
- 批准号:
2316161 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant
Collaborative Research: PPoSS: LARGE: Research into the Use and iNtegration of Data Movement Accelerators (RUN-DMX)
协作研究:PPoSS:大型:数据移动加速器 (RUN-DMX) 的使用和集成研究
- 批准号:
2316176 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant
Collaborative Research: PPoSS: Large: A Full-stack Approach to Declarative Analytics at Scale
协作研究:PPoSS:大型:大规模声明性分析的全栈方法
- 批准号:
2316158 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant
Collaborative Research: PPoSS: LARGE: Cross-layer Coordination and Optimization for Scalable and Sparse Tensor Networks (CROSS)
合作研究:PPoSS:LARGE:可扩展和稀疏张量网络的跨层协调和优化(CROSS)
- 批准号:
2316201 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Standard Grant
Collaborative Research: PPoSS: LARGE: Cross-layer Coordination and Optimization for Scalable and Sparse Tensor Networks (CROSS)
合作研究:PPoSS:LARGE:可扩展和稀疏张量网络的跨层协调和优化(CROSS)
- 批准号:
2316203 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant
Collaborative Research: PPoSS: LARGE: Research into the Use and iNtegration of Data Movement Accelerators (RUN-DMX)
协作研究:PPoSS:大型:数据移动加速器 (RUN-DMX) 的使用和集成研究
- 批准号:
2316177 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant
Collaborative Research: PPoSS: LARGE: Cross-layer Coordination and Optimization for Scalable and Sparse Tensor Networks (CROSS)
合作研究:PPoSS:LARGE:可扩展和稀疏张量网络的跨层协调和优化(CROSS)
- 批准号:
2316202 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Standard Grant
Collaborative Research: PPoSS: LARGE: General-Purpose Scalable Technologies for Fundamental Graph Problems
合作研究:PPoSS:大型:解决基本图问题的通用可扩展技术
- 批准号:
2316235 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant
Collaborative Research: PPoSS: LARGE: Principles and Infrastructure of Extreme Scale Edge Learning for Computational Screening and Surveillance for Health Care
合作研究:PPoSS:大型:用于医疗保健计算筛查和监视的超大规模边缘学习的原理和基础设施
- 批准号:
2406572 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant
Collaborative Research: PPoSS: Large: A Full-stack Approach to Declarative Analytics at Scale
协作研究:PPoSS:大型:大规模声明性分析的全栈方法
- 批准号:
2316159 - 财政年份:2023
- 资助金额:
$ 6.3万 - 项目类别:
Continuing Grant