Collaborative Research: PPoSS: Planning: Making Smart Use of SmartNICs

随着底层技术的变化，计算范例有时会经历相当戏剧性的变化，从而显著修改主要用例。其中一些革命很早就被预见到了，并大张旗鼓地预示着，炒作早在实际回报之前就被炒作了。其他人则更倾向于机会主义，利用最初为另一目的开发的技术，这种技术的采用在更广泛的社区没有太多通知的情况下开始改变实践。计算现在正处于这样一场“安静革命”的边缘，这场革命就是在将计算机连接到网络的设备上插入计算。这种被称为SmartNIC(用于计算增强型网络接口卡)的趋势在使应用程序更快和确保数据更安全方面显示出巨大的前景。本项目将重点介绍如何最好地利用SmartNIC来提高应用程序性能和安全性。SmartNIC最初设计用于从主机CPU分流数据包处理负载，在某些设置中，主机CPU处理是在数据路径上执行加密和其他计算密集型任务所必需的。SmartNIC将这种分组处理能力与其他三个特征相结合：(I)与主机CPU隔离，(Ii)直接访问内存，以及(Iii)一般可编程性。事实证明，这种结合使SmartNIC有可能在整个计算生态系统中发挥强大而独特的作用。特别是，通过位于网络和主机之间的边界，它们可以更改向两者开放的接口，从而使SmartNIC能够显著提高应用程序性能，同时还提供更高的安全性和保密性。然而，实现这些成果需要在三个不同的问题上取得进展。首先，SmartNIC的硬件设计必须结合几个不同的单元(专用分组处理单元、远程直接存储器访问单元和通用计算单元)，并在它们之间以及与主机存储器之间提供快速互联。设计空间是巨大的，对于哪些设计代表最佳权衡，几乎没有达成一致意见。其次，这些SmartNIC必须为应用程序提供一组可提高其性能和安全性的原语。必须明智地选择这些原语，以便SmartNIC能够支持这些原语，同时便于应用程序利用这些原语来获得更好的性能和安全性。第三，需要验证工具以确保SmartNIC上的程序正确执行，以及在多台主机及其SmartNIC上运行的整个系统是正确的。这将需要扩展目前的验证技术。这一裁决反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Computing paradigms occasionally undergo rather dramatic shifts as underlying technologies change, significantly modifying the dominant use cases. Some of these revolutions are seen far in advance and are heralded by great fanfare, with the hype long preceding the actual payoffs. Others are more opportunistic in nature, leveraging a technology initially developed for another purpose, and the adoption of this technology starts altering practice without much notice from the broader community. Computing is now on the verge of such a “quiet revolution” having to do with inserting computation on the devices that connect computers to the network. This trend towards what are called SmartNICs (for computationally enhanced network interface cards) shows great promise in both making applications faster and in keeping data more secure. This project will focus on how to best leverage SmartNICs in order to improve application performance and security.SmartNICs were originally designed to offload packet-processing from the host CPU, which processing is necessary in certain settings to perform encryption and other compute-intensive tasks on the data path. SmartNICs combine this packet-processing power with three other characteristics: (i) isolation from the host CPU, (ii) direct access to memory, and (iii) general programmability. It turns out that this combination gives SmartNICs the potential to play a powerful and unique role in the overall computational ecosystem. In particular, by sitting on the boundary between the network and hosts, they can change the interfaces being exposed to both, allowing SmartNICs to substantially improve application performance while also providing greater security and privacy. However, realizing these gains requires making progress on three separate issues. First, the hardware design of SmartNICs must combine several different units (a specialized packet-handling unit, an remote direct memory access unit, and a general computation unit), and provide fast interconnections between them and with the host memory. The design space is vast, and there is little agreement on what designs represent the best trade-offs. Second, these SmartNICs must offer applications a set of primitives that can improve their performance and security. These primitives must be chosen wisely to be feasible for SmartNICs to support while being easy for applications to leverage for better performance and security. Third, verification tools are needed to ensure that the programs on the SmartNIC are correctly executed and that the overall system -- running on multiple hosts and their SmartNICs -- is correct. This will require extensions to current verification techniques.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.