CSR: Small: ARTEMIS: Algorithm-Hardware Co-Design for Efficient Machine Learning Systems

CSR：小型：ARTEMIS：高效机器学习系统的算法硬件协同设计

• 批准号: 1815780
• 负责人: Gauri Joshi
• 金额: $ 50万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-10-01 至 2022-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1815780&HistoricalAwards=false
• 关键词: CSR; Small; ARTEMIS; Algorithm; Hardware

With the increased popularity of machine learning algorithms deployed on a variety of hardware systems, the problem of identifying the best model among numerous possible configurations has drawn significant attention. The problem is compounded by the need to select the right platform to run these applications, under given power or latency constraints. This "hardware wall" forces machine learning service providers to constantly redesign the underlying hardware fabric to satisfy certain constraints. This project develops tools for automatic and efficient co-design of machine learning algorithms and hardware platforms that will result in significant cost and time-to-market reduction for machine learning systems.The project introduces efficient meta-learning for machine learning systems and algorithm-hardware platform co-design. Specifically, the project will develop meta-learning algorithms for the optimization of machine learning models under system hardware constraints and formulate the hardware design of efficient machine learning systems as a machine learning problem itself, that can be effectively solved by meta-learning optimization algorithms. Finally, the project will develop multi-objective algorithms for the co-design of machine learning applications and hardware platforms they need to run on, and exploit domain knowledge from hardware engineering and design schemes to substantially accelerate hardware-aware model optimization.The results of the project seek to change the landscape of modeling, optimization, and design methodologies for efficient machine learning systems. Furthermore, the work aims to have an important educational and mentoring component by potentially changing how engineers are trained in a multidisciplinary fashion for dealing with next generation technological advances in general, and the problem of efficiently and intelligently co-designing machine learning algorithms and the hardware platforms they are running on, in particular. The project will involve a diverse graduate and undergraduate trainee population, while expanding the project's outreach to high-school and middle-school students.The data, code, results, and simulators developed in this project will be made available publicly throughout the duration of the project and for at least four years after the end of the project. The location of the repository is on the website of Carnegie Mellon University's Energy Aware Computing group (www.ece.cmu.edu/~enyac).This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

随着部署在各种硬件系统上的机器学习算法的日益普及，在众多可能的配置中识别最佳模型的问题已经引起了极大的关注。在给定的功率或延迟限制下，需要选择正确的平台来运行这些应用程序，这使得问题更加复杂。这种“硬件墙”迫使机器学习服务提供商不断重新设计底层硬件结构，以满足某些限制。该项目开发了机器学习算法和硬件平台的自动和高效协同设计工具，这将显著降低机器学习系统的成本和上市时间。该项目为机器学习系统和算法硬件平台协同设计引入了高效的元学习。具体而言，该项目将开发元学习算法，用于在系统硬件约束下优化机器学习模型，并将高效机器学习系统的硬件设计制定为机器学习问题本身，可以通过元学习优化算法有效解决。最后，该项目将开发多目标算法，用于机器学习应用程序及其所需运行的硬件平台的协同设计，并利用硬件工程和设计方案中的领域知识，大幅加速硬件感知模型优化。该项目的成果旨在改变高效机器学习系统的建模、优化和设计方法的格局。此外，这项工作旨在通过潜在地改变工程师以多学科方式接受培训的方式来处理下一代技术进步，以及有效和智能地共同设计机器学习算法及其运行的硬件平台的问题，来提供重要的教育和指导。该项目将涉及多样化的研究生和本科生培训人群，同时将项目扩展到高中和初中学生。该项目中开发的数据，代码，结果和模拟器将在整个项目期间公开，并在项目结束后至少四年公开。该存储库的位置在卡内基梅隆大学的能源感知计算小组的网站上（www.ece.cmu.edu/Eschenyac）。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Designing Adaptive Neural Networks for Energy-Constrained Image Classification

• DOI: 10.1145/3240765.3240796
• 发表时间: 2018-08
• 期刊: 2018 IEEE/ACM International Conference on Computer-Aided Design (ICCAD)
• 作者: Dimitrios Stamoulis;Ting-Wu Chin;Anand P. Krishnan;Haocheng Fang;S. Sajja;Mitchell Bognar;Diana Marculescu

DeepNVM++: Cross-Layer Modeling and Optimization Framework of Nonvolatile Memories for Deep Learning

• DOI: 10.1109/tcad.2021.3127148
• 发表时间: 2020-12
• 期刊: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
• 影响因子: 2.9
• 作者: A. Inci;Mehmet Meric Isgenc;Diana Marculescu

Single-Path Mobile AutoML: Efficient ConvNet Design and NAS Hyperparameter Optimization

• DOI: 10.1109/jstsp.2020.2971421
• 发表时间: 2019-07
• 期刊: IEEE Journal of Selected Topics in Signal Processing
• 影响因子: 7.5
• 作者: Dimitrios Stamoulis;Ruizhou Ding;Di Wang;Dimitrios Lymberopoulos;B. Priyantha;Jie Liu;Diana Marculescu

Hardware-Aware Machine Learning: Modeling and Optimization

• DOI: 10.1145/3240765.3243479
• 发表时间: 2018-09
• 期刊: 2018 IEEE/ACM International Conference on Computer-Aided Design (ICCAD)
• 作者: Diana Marculescu;Dimitrios Stamoulis;E. Cai

Single-Path NAS: Device-Aware Efficient ConvNet Design

• 发表时间: 2019-05
• 期刊: ArXiv
• 作者: Dimitrios Stamoulis;Ruizhou Ding;Di Wang;Dimitrios Lymberopoulos;B. Priyantha;Jie Liu-;Diana Marculescu