[1]韦 立,陈珊珊.基于 Redis 单位最大效益自适应迁移策略研究[J].计算机技术与发展,2018,28(10):53-58.[doi:10.3969/ j. issn.1673-629X.2018.10.011]
　WEI Li,CHEN Shan-shan.Research on an Adaptive Migration Strategy of Unit Maximum Benefit Based on Redis[J].,2018,28(10):53-58.[doi:10.3969/ j. issn.1673-629X.2018.10.011]
点击复制

基于 Redis 单位最大效益自适应迁移策略研究()
分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
28
期数:
2018年10期
页码:
53-58
栏目:
智能、算法、系统工程
出版日期:
2018-10-10

文章信息/Info

Title:
Research on an Adaptive Migration Strategy of Unit Maximum Benefit Based on Redis
文章编号:
1673-629X(2018)10-0053-06
作者:
韦 立1; 2; 陈珊珊1; 2
1. 南京邮电大学 计算机学院,江苏 南京 210003; 2. 江苏省大数据安全与智能处理重点实验室,江苏 南京 210003
Author(s):
WEI Li1; 2; CHEN Shan-shan1; 2
1. School of Computer Science,Nanjing University of Posts and Telecommunications,Nanjing 210003,China; 2. Jiangsu Key Laboratory of Big Data Security &Intelligent Processing,Nanjing 210003,China
关键词:
Redis; Key-Value; 负载平衡; 自适应迁移策略; 单位最大迁移效益
Keywords:
Redis; Key-Value; load balance; adaptive migration strategy; unit maximum benefit
分类号:
TP39
DOI:
10.3969/ j. issn.1673-629X.2018.10.011
文献标志码:
A
摘要:
Key-Value 存储以其高扩展性和强一致性在如今热门的大数据时代中扮演着重要角色。而实现其扩展性重要的关键技术在于数据迁移机制的完善,数据迁移机制同时直接影响集群节点的负载均衡。Redis 集群采用哈希算法将数据均匀分布在集群节点上,然而随着节点的不断扩展,Redis 集群手动分配槽的迁移机制日益不足。针对上述问题,提出单位最大效益自适应迁移策略。一方面,负载自适应平衡策略通过实时判断集群负载情况解决 Redis 手动迁移的不足,有策略的数据迁移使其静态存储均衡化,从而实现系统之间的自适应调控;另一方面,单位最大效益迁移方案每次优先选择单位效益最大的节点进行迁移,直至迁移完成。和 Redis 性能相比,自适应迁移策略的迁移时间大概缩短了6.2% ~14. 1%,吞吐量约提高了 4.9% ~12.5%。
Abstract:
Nowadays,Key-Value storage has played an important role in the era of big data for its high extension and strong consistency.The key technology to achieve extensibility is to improve the data migration mechanism which also has affected load balancing of cluster node. Redis cluster utilizes hash algorithm to uniformly distribute data over cluster nodes. However,with the increasing of nodes,the mechanism of manually allocating slots in Redis cluster becomes inadequate. In order to solve the above problems,we present an adaptive migration strategy of unit maximum benefit. On the one hand,the strategy solves the shortage of manual migration of Redis by judging load of cluster system real-time and achieves adaptive control between systems by strategic migration,which leads to static storage equilibrium. On the other hand,we propose a migration scheme of unit maximum benefit to optimize migration plan. The scheme will choose the optimal node and find the best strategy until all migration are finished. Compared to Redis,the migration time of adaptive strategy has shortened by 6.2% ~14.1% and the throughput has increased by 4.9% ~12.5%.

相似文献/References:

[1]王康[],李东静[],陈海光[]. 分布式存储系统中改进的一致性哈希算法[J].计算机技术与发展,2016,26(07):24.
　WANG Kang[],LI Dong-jing[],CHEN Hai-guang[]. An Improved Consistent Hashing Algorithm in Distributed Storage System[J].,2016,26(10):24.
[2]孙杜靖,李玲娟. 面向Redis的数据序列化算法研究[J].计算机技术与发展,2017,27(05):77.
　SUN Du-jing,LI Ling-juan. Investigation on Data Serialization Algorithm for Redis[J].,2017,27(10):77.
[3]姚经纬[],杨福军[]. Redis分布式缓存技术在Hadoop平台上的应用[J].计算机技术与发展,2017,27(06):146.
　YAO Jing-wei[],YANG Fu-jun[]. Application of Redis Distributed Caching Technology in Hadoop Framework[J].,2017,27(10):146.
[4]孙杜靖,李玲娟,马可. 面向流数据的DPFP-Stream算法的设计与实现[J].计算机技术与发展,2017,27(07):29.
　SUN Du-jing,LI Ling-juan,MA Ke. Realization and Implementation of Distributed Parallel Mining of Frequent Patterns for Data Streams[J].,2017,27(10):29.
[5]艾丽蓉,李凯.基于Postgres-XL 的数据管理优化技术研究[J].计算机技术与发展,2018,28(03):11.[doi:TP311]
　AI Li-rong,LI Kai.Study on Optimization Technology of Data Management Based on Postgres-XL[J].,2018,28(10):11.[doi:TP311]
[6]蒋园,阳许军.基于人脸识别的海量图片的存储和索引优化[J].计算机技术与发展,2019,29(03):85.[doi:10.3969/ j. issn.1673-629X.2019.03.018]
　JIANG Yuan,YANG Xu-jun.Storage and Index Optimization of Massive Images Based on Facial Recognition[J].,2019,29(10):85.[doi:10.3969/ j. issn.1673-629X.2019.03.018]

更新日期/Last Update: 2018-10-10