Innovation Method of Distributed Storage for Huge Data of Geological and Mineral Resources Based on Hadoop
Innovation Method of Distributed Storage for Huge Data of Geological and Mineral Resources Based on Hadoop
复制标题
基于Hadoop的地矿大数据分布式存储创新方法
DOI：
10.11648/j.ajasr.20190501.12
复制
发表时间：
2019-03
期刊：
影响因子：
--
通讯作者：
xiaokeyan
中科院分区：
文献类型：
--
作者：
lichaokui;zhao yanan;xiaokeyan
With the emergence of big data of TB and PB geological and mineral resources, the storage of large geological data has become a worldwide problem puzzling geologists. The traditional storage and service model of geological data is facing a great challenge. For example, when the scale of data increases dramatically, general relational database can not solve the problem of insufficient scalability, stability and efficiency of database system. In response to the above problems, this paper proposes a new method of geological and mineral data storage based on cloud computing environment combined with hadoop. Taking the mineral resources potential evaluation data of Chongqing as the research object, The proposed method in this paper is compared with the traditional Oracle database storage method in data storage experiments: (1) Small file optimization comparative experiment; (2) Hadoop and Oracle comparative experiment. The performance of writing operation, memory occupancy, data import and data export are tested in different way, and the comparison chart of performance is given. The experimental results show that the new storage method proposed in this paper is more efficient than the traditional method. At the same time, it effectively overcomes the problem of small file storage in Hadoop storage. The research results provide a new technical for the storage and management of geological and mineral data all over the country.
登录
查看更多内容
DOI：
10.1145/503272.503279
发表时间：
2002-01
期刊：
--
影响因子：
--
作者：
T. Henzinger;Ranjit Jhala;R. Majumdar;G. Sutre
通讯作者：
T. Henzinger;Ranjit Jhala;R. Majumdar;G. Sutre
影响因子：
--
作者：
Henzinger, TA;Jhala, R;Sutre, G
通讯作者：
Sutre, G
DOI：
10.2991/ijndc.2013.1.1.2
发表时间：
2013
期刊：
Int. J. Networked Distributed Comput.
影响因子：
--
作者：
Juhnyoung Lee
通讯作者：
Juhnyoung Lee
影响因子：
--
作者：
Li Chaokui;Yan Wenying;Xiao Keyan
通讯作者：
Li Chaokui;Yan Wenying;Xiao Keyan
DOI：
10.11873/j.issn.1004-0323.1991.3.31
发表时间：
2012-04
期刊：
Remote Sensing Technology and Application
影响因子：
--
作者：
Zhao Bingxian
通讯作者：
Zhao Bingxian