Evaluating InfiniBand performance with PCI Express
Evaluating InfiniBand performance with PCI Express
复制标题
使用 PCI Express 评估 InfiniBand 性能
作者：
Jiuxing Liu;Amith R. Mamidala;Abhinav Vishnu;D. Panda
InfiniBand架构是一种行业标准，可提供低延迟和高带宽以及远程直接内存访问（RDMA）、原子操作、多播和服务质量等高级功能。InfiniBand产品可以实现小消息的几微秒延迟和700至900 Mbytes/s的带宽。因此，它作为构建高性能集群的高速互连技术越来越受欢迎。在过去的10年里，外围组件互连（PCI）一直是标准的本地I/O总线技术。然而，更多的应用需要比PCI总线所能提供的更低的延迟和更高的带宽。作为扩展，PCI-X提供更高的峰值性能和效率。与使用64位、133 MHz PCI-X接口的HCA相比，采用PCI Express的InfiniBand主机通道适配器（HCA）可将小消息的延迟降低20%至30%。PCI Express还提高了MPI级别的性能，实现了小消息4.1/spl mu/s的延迟。它还可以提高MPI集体通信和带宽受限的MPI应用程序的性能。
The InfiniBand architecture is an industry standard that offers low latency and high bandwidth as well as advanced features such as remote direct memory access (RDMA), atomic operations, multicast, and quality of service. InfiniBand products can achieve a latency of several microseconds for small messages and a bandwidth of 700 to 900 Mbytes/s. As a result, it is becoming increasingly popular as a high-speed interconnect technology for building high-performance clusters. The Peripheral Component Interconnect (PCI) has been the standard local-I/O-bus technology for the last 10 years. However, more applications require lower latency and higher bandwidth than what a PCI bus can provide. As an extension, PCI-X offers higher peak performance and efficiency. InfiniBand host channel adapters (HCAs) with PCI Express achieve 20 to 30 percent lower latency for small messages compared with HCAs using 64-bit, 133-MHz PCI-X interfaces. PCI Express also improves performance at the MPI level, achieving a latency of 4.1/spl mu/s for small messages. It can also improve MPI collective communication and bandwidth-bound MPI application performance.