Recent Progress on Memristive Convolutional Neural Networks for Edge Intelligence
Recent Progress on Memristive Convolutional Neural Networks for Edge Intelligence
复制标题
用于边缘智能的忆阻卷积神经网络的最新进展
DOI：
10.1002/aisy.202000114
复制
发表时间：
2020-11-01
影响因子：
7.4
通讯作者：
Miao, Xiang-Shui
中科院分区：
文献类型：
--
作者：
Qin, Yi-Fan;Bao, Han;Miao, Xiang-Shui
近年来，由于大数据和计算机技术的发展，人工智能（AI）受到广泛关注并取得长足进步。边缘智能将AI的计算中心从云端推向个人用户，让AI更加贴近生活，但同时对硬件的实现尤其是边缘加速提出了更高的要求。以卷积神经网络（CNN）为例，它在学术界和工业界的不同领域表现出了出色的解决问题的能力，但它仍然面临着巨大的计算量和复杂的映射架构的问题。基于新兴非易失性忆阻器阵列的内存计算特性和并行乘法累加（MAC）运算，总结了边缘智能忆阻卷积加速器的最新研究进展。此外，针对忆阻卷积加速器的改进，还讨论了两种潜在的优化方案：以量化为代表的压缩方法在静态图像处理方面显示出巨大的潜力，而CNN与长短期记忆（LSTM）神经网络的结合弥补了CNN在动态目标处理方面的缺点。最后，还讨论了基于忆阻器阵列的边缘智能加速器的未来挑战和机遇。
Recently, due to the development of big data and computer technology, artificial intelligence (AI) has received extensive attention and made great progress. Edge intelligence pushes the computing center of AI from the cloud to individual users, making AI closer to life, but at the same time puts forward higher requirements for the realization of hardware, especially for edge acceleration. Taking convolutional neural networks (CNNs) as an example, which show excellent problem-solving capabilities in different fields of academia and industry, it still faces issues of enormous computing volume and complex mapping architecture. Based on the computing-in-memory property and parallel multiply accumulate (MAC) operations of the emerging nonvolatile memristor arrays, herein the recent research progress of the edge intelligence memristive convolution accelerator is summarized. Furthermore, aiming at improving memristive convolutional accelerators, two potential optimization schemes are also discussed: The compression methods represented by quantization show great potential for static image processing, and the combination of a CNN with a long short-term memory (LSTM) neural network makes up for the CNN's shortcomings of dynamic target processing. Finally, the future challenges and opportunities of edge intelligence accelerators based on memristor arrays are also discussed.