CAREER: Efficient Algorithms and Hardware for Accelerated Machine Learning

人工智能（AI）正在为人类社会带来重大利益，并具有解决未来人类基本问题的巨大潜力。深度神经网络在许多人工智能应用中表现出显着的改进。然而，这种好处是以计算资源和工程师资源的高成本为代价的。对于具有紧张的功率预算的移动的设备，对计算的这种高要求变得令人望而却步。另一方面，缺乏能够设计神经网络的专家，而神经网络的调整是出了名的困难。该项目系统地研究了高效的神经网络架构及其硬件加速器，以使它们在低功耗下快速运行。它还旨在通过基于AI的设计自动化（AI设计的AI）加速设计周期。这种设计方法可以支持机器学习研究和教育，同时显着提高机器学习模型的生产力。人们不再需要手动调整模型，而是自动化的，使非专家能够构建高效的机器学习模型。它将使AI民主化，成为一个更加多样化的社区。该项目旨在通过自动机器学习（AutoML）技术自动生成高效的神经网络及其硬件实现，这些实现可以推广到高维表示。它将设计一个硬件加速器，以提供更多的计算单位成本。算法硬件协同设计方法揭示了传统智慧受限的更大设计空间。它有望将神经结构搜索的设计周期缩短两个数量级。借助AutoML、强大的硬件和协同设计的高效算法，可以解决高维数据上更具挑战性的人工智能任务，这些任务以前很难或不可能完成，受到计算资源的阻碍，例如视频和3D点云。这些技术使人们对高维表示有了更深入的理解，并产生了最先进的神经网络架构，可以有效地在移动的设备上运行，同时保护用户隐私。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

Artificial Intelligence (AI) is bringing significant benefits to human society with outstanding potential to address essential human concerns in the future. Deep neural networks have shown significant improvements in many AI applications. However, the benefit comes at the high cost of computational resources and engineer resources. For mobile devices with a tight power budget, such high demands for computation become prohibitive. On the other side, there is a shortage of experts who can design neural networks, which are notoriously hard to tune. This project systematically investigates efficient neural network architectures and their hardware accelerators to make them run fast at low power. It also aims to accelerate the design cycle by AI-based design automation (AI-designed AI). Such design methodology can support machine learning research and education,, while significantly improving the productivity of machine learning models. People no longer have to hand-tune the model, but it is automated, enabling non-experts to build efficient machine learning models. It will democratize AI to a more diverse community. The project aims to auto-generate both efficient neural networks and their hardware implementations that can generalize to high-dimensional representations, through automatic machine learning (AutoML) techniques. It will design a hardware accelerator to provide more computation per unit cost. The algorithm hardware co-design approach unveils a larger design space that conventional wisdom has been limited to. It is expected to shorten the design cycle of neural architecture search by two orders of magnitude over existing work. With AutoML, powerful hardware, and the co-designed efficient algorithms, it is possible to solve more challenging AI tasks on high-dimensional data that are previously difficult or impossible, hindered by the computation resource, such as videos and 3D point clouds. These techniques give rise to a deeper understanding of the high dimensional representations and produce state-of-the-art neural network architectures that can efficiently run on mobile devices as well as protect user privacy.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.