Elements: Portable Library for Homomorphic Encrypted Machine Learning on FPGA Accelerated Cloud Cyberinfrastructure

隐私保护计算(PPC)利用同态加密(HE)直接对加密数据进行计算，近年来引起了人们的关注。基于HE的机器学习(HE ML)推理支持在从医疗保健、金融交易、边缘网络物理系统等广泛的应用领域保护隐私。依赖于公共云或数据中心处理的隐私敏感应用程序可以使用HE ML推理来保护隐私。虽然HE ML推理提供了强大的隐私保证，但加密数据的计算速度比未加密的计算慢了几个数量级，并且需要大量的硬件资源才能使其对最终用户具有吸引力。新兴数据中心和云平台使用现场可编程门阵列(FGA)进行扩展。凭借现场可编程门阵列的细粒度可编程架构，这些平台非常适合加速HE ML。这项工作将利用现场可编程门阵列上新颖的算法、架构和内存优化来开发可移植和可配置的库，以实现安全、弹性和可信的网络基础设施，用于端到端隐私敏感的ML推理。该库将提供用于HE内核的FPGA加速知识产权(IP)核心(L1库)，以及用于推断广泛研究的HE ML模型的FPGA专用处理器(ASP)(L2库)。该库将支持各种HE方案、安全级别、机器学习模型和FPGA平台。它将包括几个软件和硬件创新以及各种特定于HE的优化，例如高效的数据布局、内存高效调度和可扩展的互连，以最大限度地提高内存利用率，并使用片上内存提高数据重用。使用L1库中的IP核，该项目将组成一个具有域特定指令集体系结构(ISA)和编译器的FPGA ASP。该加速器可通过软件编程实现实时的HE-ML计算。该库将发布给计算机与信息科学与工程(CEISE)社区，包括机器学习、软件和数据科学社区，以加速采用同态加密来保护隐私计算。该奖项反映了NSF的法定使命，并已通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Privacy Preserving Computations (PPC) that utilize Homomorphic Encryption (HE) to perform computations on encrypted data directly have become attractive recently. HE based Machine Learning (HE ML) inference enables preservation of privacy in a wide variety of application domains that range from healthcare, financial transactions, edge cyber physical systems, etc. Privacy sensitive applications that rely on processing in a public cloud or data center can use HE ML inference to preserve privacy. While HE ML inference offers strong privacy guarantees, computations on encrypted data are orders of magnitude slower than unencrypted computations and require significant hardware resources to make them attractive for end users. Emerging data centers and cloud platforms are augmented with Field Programmable Gate Arrays (FPGAs). With the fine grained programmable architecture of FPGAs, these platforms are well suited for accelerating HE ML.This work will leverage novel algorithmic, architectural and memory optimizations on FPGAs to develop a portable and configurable library to enable secure, resilient, and trustworthy cyberinfrastructure for end-to-end privacy sensitive ML inference. The library will provide FPGA accelerated Intellectual Property (IP) cores for HE kernels (L1 Library) as well as a FPGA Application Specific Processor (ASP) for inference of widely studied HE ML models (L2 Library). The library will support various HE schemes, security levels, machine learning models and FPGA platforms. It will include several software and hardware innovations along with various HE specific optimizations such as efficient data layout, memory efficient scheduling and scalable interconnect to maximize memory utilization and to improve data reuse using on-chip memory. Using the IP cores in the L1 Library, this project will compose a FPGA ASP with a domain-specific Instruction Set Architecture (ISA) and a compiler. The FPGA accelerator can be programmed in software to realize real-time HE ML computations. The library will be released to the Computer & Information Science & Engineering (CISE) communities, including Machine Learning, Software, and Data Science communities, to accelerate the adoption of homomorphic encryption for privacy preserving computations.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.