DART: a substrate for high speed asynchronous data IO
DART: a substrate for high speed asynchronous data IO
复制标题
DART：高速异步数据IO的底层
DOI：
--
复制
发表时间：
2008
期刊：
影响因子：
--
通讯作者：
S. Klasky
中科院分区：
文献类型：
--
作者：
C. Docan;M. Parashar;S. Klasky
复杂物理现象的大规模模拟有很长的运行时间和产生大量的数据。将这些数据保存到外部存储系统或将其传输到远程位置进行分析是一项成本高昂的操作，很快就会成为性能瓶颈。在本文中，我们提出了DART（解耦和异步远程传输），这是一种有效的数据传输基板，可以有效地减少运行模拟时的数据I/O开销。DART是一个基于RDMA技术的瘦软件层，可以实现对运行模拟数据的快速、低开销和异步访问，并支持高吞吐量、低延迟的数据传输。
Large scale simulations of complex physics phenomena have long run times and generate massive amounts of data. Saving this data to external storage systems or transferring it to remote locations for analysis is a costly operation that quickly becomes a performance bottleneck. In this paper, we present DART (Decoupled and Asynchronous Remote Transfers), an efficient data transfer substrate that effectively minimizes the data I/O overhead on the running simulations. DART is a thin software layer built on RDMA technology to enable fast, low-overhead and asynchronous access to data from a running simulation, and support high-throughput, low-latency data transfers.