[1]孙杜靖,李玲娟. 面向Redis的数据序列化算法研究[J].计算机技术与发展,2017,27(05):77-81.
　SUN Du-jing,LI Ling-juan. Investigation on Data Serialization Algorithm for Redis[J].,2017,27(05):77-81.
点击复制

 面向Redis的数据序列化算法研究()
分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
27
期数:
2017年05期
页码:
77-81
栏目:
智能、算法、系统工程
出版日期:
2017-05-10

文章信息/Info

Title:
 Investigation on Data Serialization Algorithm for Redis
文章编号:
1673-629X（2017)05-0077-05
作者:
 孙杜靖; 李玲娟
 南京邮电大学 计算机学院
Author(s):
 SUN Du-jing; LI Ling-juan
关键词:
 ; Redis; 序列化; 半结构化; 非结构化; Storm
Keywords:
 ; Redis; serialization; semi-structured; unstructured; Storm
分类号:
TP391
文献标志码:
A
摘要:
 为了解决实时计算中半结构化和非结构化数据的存储问题,借助内存数据库Redis可以存储键值型数据和支持全内存运算的优势,结合文件序列化、图像序列化、JSON序列化和Java对象序列化技术,设计了面向Redis的半结构化和非结构化数据的序列化算法.该序列化算法不仅解决了半结构化和非结构化数据无法直接存入Redis的问题,而且由于在序列化过程中实现了对这些数据的深拷贝,使得反序列化可以完美地还原初始数据.此外,序列化过程还支持通过加解密来保障数据安全.基于Storm平台的实验结果表明,所设计的序列化算法快速、有效且性能稳定.在海量数据实时计算中,无论使用哪种开发语言,将该算法与Redis数据库结合,既能利用Redis带来的高读写效率,又能存储任何半结构化和非结构化数据对象而无需重复开发代码.
Abstract:
 In order to deal with the problem of storing semi-structured and unstructured data in real-time calculation,a data serialization algorithm for Redis is designed.It takes advantage of Redis which can store key-value data and support full memory operation and uses the technologies of file serialization,image serialization,JSON serialization and Java object serialization.The algorithm can not only solve the problem that the semi-structured and unstructured data cannot be directly stored into Redis,but also enable the deserialization to restore the original data perfectly by keeping a deep copy of the data.In addition,encrypting and decrypting can be added to the serialization process to ensure the security of data.The experimental results on Storm platform show that the proposed algorithm is fast,effective and stable.In the real-time processing of massive data integration,this algorithm with Redis can not only make reading and writing highly efficient,but also store any semi-structured and unstructured data without rewriting code no matter which programming language is employed.

相似文献/References:

[1]张志宏,吴庆波,邵立松,等.基于飞腾平台TOE协议栈的设计与实现[J].计算机技术与发展,2014,24(07):1.
　ZHANG Zhi-hong,WU Qing-bo,SHAO Li-song,et al. Design and Implementation of TCP/IP Offload Engine Protocol Stack Based on FT Platform[J].,2014,24(05):1.
[2]梁文快,李毅. 改进的基因表达算法对航班优化排序问题研究[J].计算机技术与发展,2014,24(07):5.
　LIANG Wen-kuai,LI Yi. Research on Optimization of Flight Scheduling Problem Based on Improved Gene Expression Algorithm[J].,2014,24(05):5.
[3]黄静,王枫,谢志新,等. EAST文档管理系统的设计与实现[J].计算机技术与发展,2014,24(07):13.
　HUANG Jing,WANG Feng,XIE Zhi-xin,et al. Design and Implementation of EAST Document Management System[J].,2014,24(05):13.
[4]侯善江[],张代远[][][]. 基于样条权函数神经网络P2P流量识别方法[J].计算机技术与发展,2014,24(07):21.
　HOU Shan-jiang[],ZHANG Dai-yuan[][][]. P2P Traffic Identification Based on Spline Weight Function Neural Network[J].,2014,24(05):21.
[5]李璨,耿国华,李康,等. 一种基于三维模型的文物碎片线图生成方法[J].计算机技术与发展,2014,24(07):25.
　LI Can,GENG Guo-hua,LI Kang,et al. A Method of Obtaining Cultural Debris’ s Line Chart Based on Three-dimensional Model[J].,2014,24(05):25.
[6]翁鹤,皮德常. 混沌RBF神经网络异常检测算法[J].计算机技术与发展,2014,24(07):29.
　WENG He,PI De-chang. Chaotic RBF Neural Network Anomaly Detection Algorithm[J].,2014,24(05):29.
[7]刘茜[],荆晓远[],李文倩[],等. 基于流形学习的正交稀疏保留投影[J].计算机技术与发展,2014,24(07):34.
　LIU Qian[],JING Xiao-yuan[,LI Wen-qian[],et al. Orthogonal Sparsity Preserving Projections Based on Manifold Learning[J].,2014,24(05):34.
[8]尚福华,李想,巩淼. 基于模糊框架-产生式知识表示及推理研究[J].计算机技术与发展,2014,24(07):38.
　SHANG Fu-hua,LI Xiang,GONG Miao. Research on Knowledge Representation and Inference Based on Fuzzy Framework-production[J].,2014,24(05):38.
[9]叶偲,李良福,肖樟树. 一种去除运动目标重影的图像镶嵌方法研究[J].计算机技术与发展,2014,24(07):43.
　YE Si,LI Liang-fu,XIAO Zhang-shu. Research of an Image Mosaic Method for Removing Ghost of Moving Targets[J].,2014,24(05):43.
[10]余松平[][],蔡志平[],吴建进[],等. GSM-R信令监测选择录音系统设计与实现[J].计算机技术与发展,2014,24(07):47.
　YU Song-ping[][],CAI Zhi-ping[] WU Jian-jin[],GU Feng-zhi[]. Design and Implementation of an Optional Voice Recording System Based on GSM-R Signaling Monitoring[J].,2014,24(05):47.
[11]王康[],李东静[],陈海光[]. 分布式存储系统中改进的一致性哈希算法[J].计算机技术与发展,2016,26(07):24.
　WANG Kang[],LI Dong-jing[],CHEN Hai-guang[]. An Improved Consistent Hashing Algorithm in Distributed Storage System[J].,2016,26(05):24.
[12]姚经纬[],杨福军[]. Redis分布式缓存技术在Hadoop平台上的应用[J].计算机技术与发展,2017,27(06):146.
　YAO Jing-wei[],YANG Fu-jun[]. Application of Redis Distributed Caching Technology in Hadoop Framework[J].,2017,27(05):146.
[13]孙杜靖,李玲娟,马可. 面向流数据的DPFP-Stream算法的设计与实现[J].计算机技术与发展,2017,27(07):29.
　SUN Du-jing,LI Ling-juan,MA Ke. Realization and Implementation of Distributed Parallel Mining of Frequent Patterns for Data Streams[J].,2017,27(05):29.

更新日期/Last Update: 2017-07-07