I-Corps: Algorithm-Hardware Co-Design for Large-Scale Machine Learning

I-Corps：大规模机器学习的算法硬件协同设计

• 批准号: 2137080
• 负责人: Gu-Yeon Wei
• 金额: $ 5万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-06-15 至 2023-11-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2137080&HistoricalAwards=false
• 关键词: Corps; Algorithm; Hardware; Co; Design

The broader impact/commercial potential of this I-Corps project is the reduction of the economic and technical barriers preventing the adoption of current and future advancements in machine learning technologies. Advances in artificial intelligence (AI) have pushed machine learning models to be computationally larger and larger. Relatively few organizations currently have access to the most sophisticated models due to the necessary computational and memory requirements required to train and deploy such models. This lack of access results in high costs for researchers and businesses attempting to apply AI in applications such as robotics, natural language processing, drug discovery, and computer vision. The technology developed here reduces the size of the models and optimizes hardware so that large-scale models can be used on existing systems. Improved access to state-of-the-art models will accelerate adoption of AI in the economy and potentially drive more rapid improvements in cutting edge AI-based discoveries.This I-Corps project develops a combination of several innovations in the field of machine learning acceleration. The innovation is aimed at simultaneous optimization at the hardware and software levels. By targeting both levels simultaneously, the technology enables speeds which are not possible by combining existing technologies individually. The core technology combines model compression techniques, custom kernels and hardware utilization designs for acceleration, and cloud orchestration algorithms. Prior results have shown capabilities to significantly reduce model sizes and speed inference results.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这个I-Corps项目的更广泛的影响/商业潜力是减少了阻止采用机器学习技术当前和未来进步的经济和技术障碍。 人工智能（AI）的进步推动机器学习模型在计算上变得越来越大。 由于训练和部署这些模型所需的必要计算和内存要求，目前相对较少的组织可以访问最复杂的模型。这种缺乏访问权限的情况导致研究人员和企业试图将人工智能应用于机器人、自然语言处理、药物发现和计算机视觉等应用中的成本高昂。这里开发的技术减小了模型的大小并优化了硬件，以便可以在现有系统上使用大规模模型。 改进对最先进模型的访问将加速人工智能在经济中的采用，并可能推动基于人工智能的前沿发现的更快改进。这个I-Corps项目开发了机器学习加速领域的几项创新组合。这项创新旨在同时优化硬件和软件级别。通过同时针对这两个级别，该技术可以实现单独结合现有技术无法实现的速度。 其核心技术结合了模型压缩技术、自定义内核和硬件利用率加速设计以及云编排算法。先前的研究结果表明，该奖项能够显著减小模型尺寸并加快推理结果的速度。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。