J-TEXT distributed data storage and management system
J-TEXT distributed data storage and management system
复制标题
J-TEXT分布式数据存储与管理系统
DOI：
10.1016/j.fusengdes.2018.02.058
复制
发表时间：
2018-04
影响因子：
1.7
通讯作者：
Yu K
中科院分区：
文献类型：
--
作者：
Zheng W;Liu Q;Zhang M;Wan K;Hu F;Yu K
随着核聚变实验进入稳态以及高性能数据采集系统的发展，传统的存储方案已经不能科普核聚变实验数据存储的需要。像Lustre这样的分布式文件系统正被越来越多的设施所采用。性能和容量功能的横向扩展解决了传统SAN（存储区域网络）存储的主要问题。然而，传统的基于文件系统的软件解决方案仍然与分布式文件系统一起使用。它们缺乏现代的数据管理功能，限制了并行存储的性能。J-TEXT云数据库（JCDB）是利用分布式数据库提供聚变实验数据存储和管理服务的软件栈。它配备了由Cassandra数据库驱动的存储引擎。该存储引擎是为融合实验数据而设计的，具有良好的性能。数据在写入并存储在跨集群的专门设计的分布式数据库中时被划分为块。它有一个MongoDB驱动的元数据管理系统，可以与存储引擎无缝协作。JCDB是完全模块化的，处理不同的数据类型和元数据管理功能集成为插件。甚至存储引擎也可以改变。尽管J-TEXT不支持长脉冲实验，但JCDB的设计旨在满足长脉冲放电要求，为中国聚变工程试验堆（CFETR）等未来聚变装置带来分布式数据库技术。JCDB具有分布式文件系统的优点，提供了复杂的元数据管理功能，并具有良好的性能。
As fusion experiment goes to steady state and high-performance data acquisition system been developed, traditional storage solutions cannot cope with the needs of fusion experiment data storage. Distributed file systems such as Lustre are being adopted by more and more facilities. The scaling-out of performance and capacity features addressed the main issue of traditional SAN (Storage Area Network) based storage. However, traditional file system based software solutions are still being used with the distributed file system. They lack modern data manage functions and limiting the performance of parallel storage. J-TEXT Cloud Database (JCDB) is a software stack that uses distributed database to provide fusion experiment data storage and management services. It ships with a storage engine powered by Cassandra database. This storage engine is designed for fusion experiment data and provides great performance. Data is divided into chunks when written and stored in a specially designed distributed database across the cluster. It has a MongoDB powered metadata management system which works seamlessly with the storage engine. JCDB is fully modular, handling different data type and metadata management functions are integrated as plugins. Even the storage engine can be changed. Though J-TEXT not supports long pulse experiments, the design of JCDB is aiming to meet long pulse discharge requirements, bring distributed database technology for future fusion devices such as China fusion engineering test reactor (CFETR). JCDB has the benefit of distributed file systems, provides complex metadata manage functions and comes with great performance.
登录
查看更多内容
DOI：
--
发表时间：
2007
期刊：
--
影响因子：
--
作者：
A.J.Capel;N.J.Cook;A.M.Edwards;E.M.Jones;R.A.Layne;D. McDonald;M.W.Wheatley;J.W.Farthing
通讯作者：
A.J.Capel;N.J.Cook;A.M.Edwards;E.M.Jones;R.A.Layne;D. McDonald;M.W.Wheatley;J.W.Farthing
影响因子：
1.7
作者：
J. Písačka;M. Hron;F. Janky;R. Pánek
通讯作者：
J. Písačka;M. Hron;F. Janky;R. Pánek
影响因子：
1.7
作者：
B. Sammuli;J. Barr;N. Eidietis;K. Olofsson;S. Flanagan;M. Kostuk;D. Humphreys
通讯作者：
B. Sammuli;J. Barr;N. Eidietis;K. Olofsson;S. Flanagan;M. Kostuk;D. Humphreys
影响因子：
1.7
作者：
G. Manduchi
通讯作者：
G. Manduchi
影响因子：
1.7
作者：
H. Nakanishi;Ohsuna Masaki;Kojima Mamoru;Imazu Setsuo;Nonomura Miki;Emoto Masahiko;Yamamoto Takashi;Nagayama Yoshio;Ozeki Takahisa;Nakajima Noriyoshi;Ida Katsumi;Kaneko Osamu
通讯作者：
H. Nakanishi;Ohsuna Masaki;Kojima Mamoru;Imazu Setsuo;Nonomura Miki;Emoto Masahiko;Yamamoto Takashi;Nagayama Yoshio;Ozeki Takahisa;Nakajima Noriyoshi;Ida Katsumi;Kaneko Osamu