Preliminary Study to Demonstrate the Performance and Power Advantages of FPGAs over GPUs for Deep Learning in Computer Vision

我们正站在深度学习算法取得巨大进步的边缘，这将很快使基于计算机视觉的物体识别在科学探究、商业应用和日常生活中得到广泛采用。然而，这一领域的实际大规模应用目前受到传统计算机系统计算能力的限制。近年来，计算机处理器（cpu）的技术改进速度明显放缓。这导致人们对使用图形处理单元（gpu）来加速深度学习计算机视觉算法的兴趣增加。尽管gpu可以比cpu更快地执行这些任务，但它们缺乏灵活性和非常高的功耗成本。另一种被称为现场可编程门阵列（FPGA）的技术由于其灵活性和功耗效率而对该领域的问题非常有吸引力。然而，fpga在这一领域尚未得到充分利用，很大程度上是由于不熟悉和误解。该项目的目标是通过硬实验证据证明fpga在基于深度学习的计算机视觉问题上优于gpu的功率和性能优势。pi将向整个研究界传播他们的发现，目的是鼓励在解决深度学习和计算机视觉的重大挑战的突破性工作中使用fpga。本项目包括三个阶段的研究计划。首先，pi将准备并验证基于卷积神经网络的最先进的图像检测应用程序。这将利用流行的Caffe库，它允许卷积网络在CPU和GPU上进行评估。其次，pi将对该应用程序在GPU上的性能进行详细的表征和分析，试图了解性能特征及其潜在原因。第三，pi将在FPGA上实现部分算法，并进行深入分析，以发现和解释该平台提供的优点和缺点。pi预测，由于对不规则细粒度并行的有效支持，GPU上算法最慢的部分将在FPGA上实现显着的加速。同时，该算法在GPU上最快的部分预计将在FPGA上以相当的性能运行，但功耗要低得多。这个项目将把研究与研究生和本科教育结合起来。博士生将接触到GPU优化和特定应用的高性能FPGA设计。硕士和本科生将通过计算机科学硕士高级项目和电气与计算机工程本科高级设计项目获得协助项目的宝贵技能。研究结果将在重要地点公布，以确保相关研究团体最大程度地了解研究结果。

We stand on the verge of dramatic advances in deep learning algorithms, which will soon enable widespread adoption of computer-vision-based object recognition in scientific inquiry, commercial applications, and everyday life. However, practical large-scale applications in this area are currently limited by the computational capabilities of conventional computer systems. In recent years, technological improvement in computer processors (CPUs) has considerably slowed. This has led to an increase in interest in using Graphics Processing Units (GPUs) to accelerate deep learning computer vision algorithms. Although GPUs can perform these tasks faster than CPUs, they suffer from inflexibility and very high power cost. An alternative technology called the Field-Programmable Gate Array (FPGA) is very attractive for problems in this domain thanks to its flexibility and power efficiency. However, FPGAs have been underutilized in this area, in large part due to unfamiliarity and misconceptions. The goal of this project is to demonstrate the power and performance advantages of FPGAs over GPUs for deep-learning-based computer vision problems via hard experimental evidence. The PIs will disseminate their findings to the research community at large with the goal of encouraging the use of FPGAs in ground-breaking work tackling the grand challenges of deep learning and computer vision.This project consists of a three-stage research plan. First, the PIs will prepare and validate a state-of-the-art image detection application based on convolutional neural networks. This will utilize the popular Caffe library, which allows convolutional networks to be evaluated on CPU and GPU. Second, the PIs will perform a detailed characterization and profiling of the performance of this application on GPU, seeking to understand the performance characteristics and their underlying causes. Third, the PIs will implement portions of the algorithm on an FPGA, and perform an in-depth analysis to find and explain the advantages and disadvantages offered by the platform. The PIs anticipate demonstrating that the slowest portion of the algorithm on the GPU will achieve significant speedup on the FPGA, arising from the efficient support of irregular fine-grain parallelism. Meanwhile, the fastest portion of the algorithm on the GPU is anticipated to run with comparable performance on the FPGA, but at dramatically lower power consumption.This project will integrate research with graduate and undergraduate education. PhD students will be exposed to GPU optimization and application-specific high-performance FPGA design. Masters and undergraduate students will gain valuable skills assisting the project through the Masters Advanced Project in Computer Science and the Undergraduate Senior Design Project in Electrical and Computer Engineering. The results of the study will be published at prominent venues to ensure maximum exposure for the relevant research communities.