Research on optimization of real-time efficient storage algorithm in data information serialization.

Research on optimization of real-time efficient storage algorithm in data information serialization.
复制标题

DOI:
10.1371/journal.pone.0260697
复制
发表时间:
2021
期刊:
影响因子:
3.7
通讯作者:
Tang Y
Tang Y
中科院分区:
综合性期刊3区
文献类型:
--
作者:
Huang B;Tang Y

文献摘要

参考文献

被引文献

相似文献

沿着互联网技术的蓬勃发展,各类设备的功能不断增加,网络通信方便多样,同时,数据量非常巨大,在网络带宽的限制下,通过时间长导致一个数据需要分割成多个,一个一个传输,传输时间长,信息延迟大等问题。针对传统数据存储信息存在数据完整性差、存储效率低、串行化效率差等问题,引入Protobuf技术对数据存储信息的串行化进行研究。采用蛇形间隙法完成序列节点的分配间隔,使工作状态和休息状态始终保持动态平衡。根据第一级规则,得到完成的目标节点的存储数据,分析目标数据的语法结构和语义,建立相应的对应关系,将数据存储信息序列化。为了验证Protobuf数据存储信息序列化方法的有效性,设计了一个对比实验。通过使用HDVM、Redis和Protobuf三种方法对JSON数据进行序列化,对比分析表明HDVM处理时间最长,Protobuf处理时间最短,且数据完整性不受影响。仿真数据表明,Protobuf串行化方法转换时间短,空间利用率高,在正确性和完整性方面具有明显优势。它非常适合在带宽有限的情况下对JSON数据进行序列化。
Along with the vigorous development of Internet technology, increasing the functions of the various types of equipment, network communication easy and diversity, at the same time, the amount of data is very huge, under the network bandwidth limitations, through long lead to a data need to be cut into more, one by one, transfer times, information delay problems. Aiming at the problems of poor data integrity, low efficiency and poor serialization efficiency of traditional data storage information, this article introduces Protobuf technology to study the serialization of data storage information. The serpentine gap method is used to complete the allocation interval of the sequence nodes, so that the working state and the resting state always maintain a dynamic balance. According to the first-level rules, the storage data of the completed target node is obtained, and the grammatical structure and the semantics of the target data are analyzed, Meanwhile corresponding correspondences are established, and the data storage information is serialized. In order to verify the effectiveness of Protobuf’s data storage information serialization method, a comparative experiment is designed. By using three methods of HDVM, Redis and Protobuf to serialize JSON data, the comparative analysis shows that HDVM has the longest processing time and Protobuf has the shortest processing time, and the data integrity is not affected. The simulation data shows that the Protobuf serialization method has short conversion time, high space utilization, and the Obvious advantages in correctness and integrity. It is vary suitable for serialization of JSON data in the case of limited bandwidth.
关系数据库中基于模式的 JSON 数据存储
DOI: 10.4018/jdm.2019070103
发表时间: 2019-07-01
影响因子: 2.6
作者:
Irshad, Lubna;Yan, Li;Ma, Zongmin
通讯作者: Ma, Zongmin
DOI: 10.7494/csci.2018.19.1.2505
发表时间: 2018-01-01
影响因子: 0.5
作者:
Piech, Mateusz;Marcjan, Robert
通讯作者: Marcjan, Robert
DOI: 10.1016/j.bdr.2021.100205
发表时间: 2021-02-01
期刊: BIG DATA RESEARCH
影响因子: 3.3
作者:
Truica, Ciprian-Octavian;Apostol, Elena-Simona;Pedersen, Torben Bach
通讯作者: Pedersen, Torben Bach
DOI: 10.1016/j.autcon.2017.01.011
发表时间: 2017-05-01
影响因子: 10.3
作者:
Afsari, Kereshmeh;Eastman, Charles M.;Castro-Lacouture, Daniel
通讯作者: Castro-Lacouture, Daniel
DOI: 10.1155/2020/8857346
发表时间: 2020
影响因子: --
作者:
Alanazi SA;Kamruzzaman MM;Alruwaili M;Alshammari N;Alqahtani SA;Karime A
通讯作者: Karime A