[1]苏跃明[]],李晨[],田丽华[]. 基于分片一致性哈希负载均衡策略与应用[J].计算机技术与发展,2017,27(11):62-65.
 SU Yue-ming[][],LI Chen[],TIAN Li-hua[]. A Consistent Hashing Load Balancing Strategy Based on Fragmentation and Its Application[J].,2017,27(11):62-65.
点击复制

 基于分片一致性哈希负载均衡策略与应用()
分享到:

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
27
期数:
2017年11期
页码:
62-65
栏目:
智能、算法、系统工程
出版日期:
2017-11-10

文章信息/Info

Title:
 A Consistent Hashing Load Balancing Strategy Based on Fragmentation and Its Application
文章编号:
1673-629X(2017)11-0062-04
作者:
 苏跃明[1]2]李晨[2]田丽华[2]
 1.西安交通大学 软件学院;2.百度(中国)有限公司
Author(s):
 SU Yue-ming[1][2] LI Chen[2] TIAN Li-hua[2]
关键词:
 一致性哈希分片动态负载均衡分布式键值存储
Keywords:
 consistent hashingfragmentdynamic load balancingdistributed key-value storage
分类号:
TP39
文献标志码:
A
摘要:
 采用一致性哈希进行数据分区和负载均衡的分布式键值存储系统具有高可扩展性的特点,但一致性哈希中哈希函数静态负载均衡的特性不能满足日益多样化的应用场景需求.为了适应以上需求,从一致性哈希策略出发,结合动态负载均衡技术,设计了一种基于一致性哈希的动态负载均衡策略.该策略使用与物理节点解耦的分片代替传统的虚拟节点,并利用针对分片的监控信息,从分片级和节点级两个层面对系统负载进行均衡调度,通过更细的调度粒度优化均衡效果.实验结果表明,该策略保留了一致性哈希策略在系统扩展性上的优势,同时优化了一致性哈希策略负载均衡的总体效果.利用基于分片的一致性哈希负载均衡策略,可以有效地均衡系统负载,提高存储系统的效率.
Abstract:
 The distributed key-value storage system,which uses consistent hashing for data partitioning and load balancing,has high ex-pansibility. However,the static load balancing strategy in consistent hashing cannot meet the increasingly diverse needs of application. In order to adapt to above needs,a dynamic load balancing strategy is designed based on the consistent hashing and combined with dynamic load balancing. It adopts the fragment decoupled physical nodes instead of traditional virtual nodes and uses the monitoring information of fragments to make decisions for load balancing scheduling from two aspects of fragment level and node level. Experimental results show that it has retained the advantage of consistent hashing strategy in system scalability,while optimizing the overall performance of consist-ent hashing load balancing. The system load can be effectively balanced and the utilization of the system can be improved.

相似文献/References:

[1]张志宏,吴庆波,邵立松,等.基于飞腾平台TOE协议栈的设计与实现[J].计算机技术与发展,2014,24(07):1.
 ZHANG Zhi-hong,WU Qing-bo,SHAO Li-song,et al. Design and Implementation of TCP/IP Offload Engine Protocol Stack Based on FT Platform[J].,2014,24(11):1.
[2]梁文快,李毅. 改进的基因表达算法对航班优化排序问题研究[J].计算机技术与发展,2014,24(07):5.
 LIANG Wen-kuai,LI Yi. Research on Optimization of Flight Scheduling Problem Based on Improved Gene Expression Algorithm[J].,2014,24(11):5.
[3]黄静,王枫,谢志新,等. EAST文档管理系统的设计与实现[J].计算机技术与发展,2014,24(07):13.
 HUANG Jing,WANG Feng,XIE Zhi-xin,et al. Design and Implementation of EAST Document Management System[J].,2014,24(11):13.
[4]侯善江[],张代远[][][]. 基于样条权函数神经网络P2P流量识别方法[J].计算机技术与发展,2014,24(07):21.
 HOU Shan-jiang[],ZHANG Dai-yuan[][][]. P2P Traffic Identification Based on Spline Weight Function Neural Network[J].,2014,24(11):21.
[5]李璨,耿国华,李康,等. 一种基于三维模型的文物碎片线图生成方法[J].计算机技术与发展,2014,24(07):25.
 LI Can,GENG Guo-hua,LI Kang,et al. A Method of Obtaining Cultural Debris’ s Line Chart Based on Three-dimensional Model[J].,2014,24(11):25.
[6]翁鹤,皮德常. 混沌RBF神经网络异常检测算法[J].计算机技术与发展,2014,24(07):29.
 WENG He,PI De-chang. Chaotic RBF Neural Network Anomaly Detection Algorithm[J].,2014,24(11):29.
[7]刘茜[],荆晓远[],李文倩[],等. 基于流形学习的正交稀疏保留投影[J].计算机技术与发展,2014,24(07):34.
 LIU Qian[],JING Xiao-yuan[,LI Wen-qian[],et al. Orthogonal Sparsity Preserving Projections Based on Manifold Learning[J].,2014,24(11):34.
[8]尚福华,李想,巩淼. 基于模糊框架-产生式知识表示及推理研究[J].计算机技术与发展,2014,24(07):38.
 SHANG Fu-hua,LI Xiang,GONG Miao. Research on Knowledge Representation and Inference Based on Fuzzy Framework-production[J].,2014,24(11):38.
[9]叶偲,李良福,肖樟树. 一种去除运动目标重影的图像镶嵌方法研究[J].计算机技术与发展,2014,24(07):43.
 YE Si,LI Liang-fu,XIAO Zhang-shu. Research of an Image Mosaic Method for Removing Ghost of Moving Targets[J].,2014,24(11):43.
[10]余松平[][],蔡志平[],吴建进[],等. GSM-R信令监测选择录音系统设计与实现[J].计算机技术与发展,2014,24(07):47.
 YU Song-ping[][],CAI Zhi-ping[] WU Jian-jin[],GU Feng-zhi[]. Design and Implementation of an Optional Voice Recording System Based on GSM-R Signaling Monitoring[J].,2014,24(11):47.
[11]周文琼[],王乐球[],郑述招[]. 云环境下的数据库扩展策略的设计[J].计算机技术与发展,2014,24(09):213.
 ZHOU Wen-qiong[],WANG Le-qiu[],ZHENG Shu-zhao[]. Design of Database Expansion Strategy under Cloud Computing[J].,2014,24(11):213.
[12]王康[],李东静[],陈海光[]. 分布式存储系统中改进的一致性哈希算法[J].计算机技术与发展,2016,26(07):24.
 WANG Kang[],LI Dong-jing[],CHEN Hai-guang[]. An Improved Consistent Hashing Algorithm in Distributed Storage System[J].,2016,26(11):24.

更新日期/Last Update: 2017-12-26