Data Reservoir: Utilization of Multi-Gigabit Backbone Network for Data-Intensive Research
Data Reservoir: Utilization of Multi-Gigabit Backbone Network for Data-Intensive Research
复制标题
数据储存库：利用多千兆骨干网络进行数据密集型研究
DOI：
10.5555/762761.762826
复制
发表时间：
2002
期刊：
影响因子：
--
通讯作者：
A. Zinzaki
中科院分区：
文献类型：
--
作者：
K. Hiraki;M. Inaba;J. Tamatsukuri;Ryutaro Kurusu;Yukichi Ikuta;Hisashi Koga;A. Zinzaki
我们提出了数据密集型科学研究的数据共享设施“数据库”；充分利用千兆骨干网，在远距离传输海量数据文件。此外，无需修改服务器软件，“Data Reservoir”可以作为本地网络中的普通UNIX服务器使用。我们使用底层协议和分层条带来实现(1)通过cash实现批量数据传输和本地访问的分离；(2)文件系统透明性，即比磁盘驱动程序更高层的任何东西都可以互操作，包括文件系统。(3)网络和存储的可扩展性。本文介绍了我们使用iSCSI协议b[1]的设计和实现，以及b[1]在实际网络中的1Gbps模型和我们实验室的10Gbps模型下的性能。
We propose data sharing facility for data intensive scientific research, "Data Reservoir"; which is optimized to transfer huge amount of data files between distant places fully Utilizing multi-gigabit backbone network. In addition, "Data Reservoir" can be used as an ordinary UNIX server in local network without any modification of server softwares. We use low-level protocol and hierarchical striping to realize (1) separation of bulk data transfer and local accesses by cashing, (2) file-system transparency, I.e. interoperable whatever in higher layer than disk driver, including file system. (3) scalability for network and storage. This paper shows our design, implementation using iSCSI protocol [1] and their performances for both 1Gbps model in the real network and 10Gbps model in our laboratory.