Hyper-Parallel Calculator-Free Neural Network Accelerator for Edge AI Applications

在这项研究中，我们的目标是为边缘AI应用开发一个超并行的无计算器神经网络加速器。我们的框架通过无计算器的神经网络和超并行加速器协同加速边缘智能应用。具体而言，计算器的自由神经网络的尖峰范式的基础上，我们的新的超稀疏二分法神经网络拓扑结构进行了探索，从而超并行神经网络加速器的开发基于我们的多粒度可重构平台和建议的拓扑结构。于2022财政年度，具有梯度隔离记忆机制的新型脉冲神经网络框架在同行评审国际会议（HPCC 2022）上发表。因此，DiaNet使用所提出的尖峰范例实现了无计算器的NN拓扑，并在MNIST和NMNIST基准测试中以Python代码进行了评估。此外，计算单元由查找表而不是传统的乘法和加法运算来实现，相应的数字电路设计在Verilog代码上实现。然后，我们在真实的硬件（PYNQ-Z1 FPGA）上测试了所提出的无计算器神经网络加速器。目前，我们正在进行实验并撰写论文，将于2023财年提交给期刊。为了探索加速器应用的多样性，我们还实施了一个初步的问题相关性应用，该应用已在同行评审的国际会议（HPCC 2022）上发表。

In this research, we aim to develop a hyper-parallel calculator-free neural network accelerator for edge AI applications. Our framework collaboratively accelerates edge intelligence application through the calculator-free neural network and hyper-parallel accelerator. Specifically, the calculator-free neural network is explored by the spiking paradigm on the basis of our novel ultra-sparse bisection neural network topology, and thus the hyper-parallel neural network accelerator is developed based on our multi-grained reconfigurable platform and the proposed topology. In FY2022, a novel spiking neural network framework with gradient-isolated memorizing mechanism was published at the peer-reviewed international conference (HPCC 2022). Accordingly, the calculator-free NN topology was implemented by DiaNet with the proposed spiking paradigm, which was evaluated on MNIST and NMNIST benchmark in Python code. Furthermore, the computing units are implemented by the LUT rather than the conventional multiplication and addition operations, and corresponding digital circuit designs are implemented on Verilog code. We then test the proposed calculator-free neural network accelerator on real hardware (PYNQ-Z1 FPGA). Currently, we are conducting experiments and writing a paper that will be submitted to a journal in FY2023. To explore the diversity of applications for our accelerator, we have also implemented a preliminary question-relatedness application, which was published at the peer-reviewed international conference (HPCC 2022).