Hardware/Software Co-Design for Machine Learning Accelerators

人工智能（AI）主导着我们的日常生活，从自动语言翻译到人脸检测。这一成功是由于人工神经网络的广泛采用。这些网络受到大脑的启发，通过让机器自动学习来解决任务，而不需要事先编程。这种机器学习方法已经存在了30多年；然而，到目前为止，还没有足够的计算能力来处理实际的尺寸问题。高性能并行处理器的广泛采用，如图形处理单元（gpu），使复杂神经网络的发展能够解决实际尺寸问题。这引发了深度学习革命，它将彻底改变从机器人到商业的几乎所有领域。然而，这些新的网络需要能够提供更大计算能力的设备，更重要的是，具有高能效。这些工作负载大多运行在云或互联网边缘（例如移动设备）上，其中能源消耗是主要关注的问题。因此，公司之间开始了一场新的竞赛，设计最节能的专门用于机器学习的加速器。新硬件的开发是一个非常耗时的、长达数年的过程。这涉及到大量的手工设计和测试，需要大量的设计师团队。此外，硬件公司倾向于采取保守的方法，并为知名的、成熟的机器学习技术设计他们的新硬件。这阻碍了新机器学习技术的采用，因为硬件总是为过时的技术设计的。该提案的长期目标是制定一套完全自动化加速器设计的通用原则，短期五年目标特别关注神经网络。这包括自动化硬件设计和软件接口设计，在社区中称为协同设计。当一个新的加速器出现时，它可以简单地作为旧加速器的替代品，并且可以开箱即用。这也将导致从设计到硬件的快速周转时间，这最终意味着更多的加速器多样性，每个加速器专门针对特定类型的问题。这将使人们能够采用新的革命性机器学习应用程序，否则这些应用程序可能永远不会出现。加拿大被许多人认为是机器学习的领导者，其研究人员在该领域率先取得了许多进展。鉴于专用硬件在实现机器学习应用方面的重要性，该研究计划将通过培训下一代以系统为中心的机器学习专家来加强系统方面的地位。我们打算以开源的方式发布我们所有的软件，以鼓励研究人员和行业参与者采用我们的技术。

Artificial intelligence (AI) dominates our daily life, from automatic language translation to face detection. This success is due to the widespread adoption of artificial neural networks. These networks are inspired by the brain and solve tasks by letting the machine learn automatically, without requiring to be programmed beforehand. This machine learning approach has been known for over 30 years; however, up until now, there were simply not enough computational power available to handle real size problems. The widespread adoption of high performance parallel processors, such as Graphics Processing Units (GPUs), has enabled the development of complex neural networks able to solve real size problems. This has triggered the deep learning revolution, which is set to revolutionize virtually every field, from robotics to business. However, these new networks require devices capable of delivering even greater computational power, and more importantly, with high energy efficiency. Most of these workloads runs on the cloud or on Internet's edge (e.g. mobile devices) where energy consumption is the prime concern. As a result, a new race among companies has started to design the most energy efficient accelerators specialized for machine learning. The development of new hardware is a very time consuming, multi-years, process. This involves a lot of manual design and testing requiring large teams of designers. Furthermore, hardware companies tend to take a conservative approach and design their new hardware for well known, well established machine learning techniques. This hinders the adoption of new machine learning techniques since hardware is always designed for obsolete techniques. The long term goal of this proposal is to develop a set of common principles for fully automating the design of accelerators, with the short term five years goal focusing on neural networks in particular. This involves both automating hardware design as well as software interface design, known in the community as co-design. When a new accelerator emerges, it can simply be dropped in as a replacement for the older one and will just work out of the box. This will also lead to a rapid turnaround time from design to hardware, which ultimately means more accelerator diversity, each specialized for a particular type of problems. This will enable the adoption of new revolutionary machine learning applications that might otherwise never see daylight. Canada is considered by many as the leader for machine learning and its researchers have pioneered many advances in the field. Given the importance that specialized hardware plays in enabling machine learning applications, this research program will strengthen this position on the system side by training the next generation of system-focused machine learning expert. We intend to release all our software as open source, to encourage uptake of our techniques among researchers and industry players.