Towards efficient data distribution on computational desktop grids with BitTorrent
Towards efficient data distribution on computational desktop grids with BitTorrent
复制标题
DOI：
10.1016/j.future.2007.04.006
复制
发表时间：
2007-11
期刊：
影响因子：
--
通讯作者：
B. Wei;G. Fedak;F. Cappello
中科院分区：
文献类型：
--
作者：
B. Wei;G. Fedak;F. Cappello
以数据为中心的应用仍然是大规模分布式计算系统的一个具有挑战性的问题。用于在因特网上协作内容分发的新协议和软件的出现为高效和快速地递送大量数据提供了新的机会。本文提出了一种计算桌面网格的BitTorrent协议的评估。我们首先提出了一个原型的通用子系统，致力于数据管理和设计作为任何桌面网格系统的构建块。基于这个原型，我们进行实验，以评估BitTorrent的潜力相比，基于FTP数据服务器的经典方法。使用65节点集群获得的初步结果测量了BitTorrent在延迟和带宽方面的基本特性，并评估了BitTorrent在交付大型输入文件方面的可扩展性。此外，我们表明，BitTorrent有相当大的延迟开销相比，FTP，但明显优于FTP时，分发大文件或文件到大量的节点。合成应用程序的测试表明，BitTorrent显着提高了通信/计算的应用程序的资格在桌面网格系统上运行的比率。
Datacentric applications are still a challenging issue for large-scale distributed computing systems. The emergence of new protocols and software for collaborative content distribution over the Internet offers a new opportunity for efficient and fast delivery of a high volume of data. This paper presents an evaluation of the BitTorrent protocol for computational desktop grids. We first present a prototype of a generic subsystem dedicated to data management and designed to serve as a building block for any desktop grid system. Based on this prototype we conduct experiments to evaluate the potential of BitTorrent compared to a classical approach based on FTP data server. The preliminary results obtained with a 65-node cluster measure the basic characteristics of BitTorrent in terms of latency and bandwidth and evaluate the scalability of BitTorrent for the delivery of large input files. Moreover, we show that BitTorrent has a considerable latency overhead compared to FTP but clearly outperforms FTP when distributing large files or files to a high number of nodes. Tests on a synthetic application show that BitTorrent significantly increases the communication/computation ratio of the applications eligible to run on a desktop grid system.