[1]陈敬静,马明栋,王得玉.MongoDB 负载均衡算法优化研究[J].计算机技术与发展,2020,30(03):88-92.[doi:10. 3969 / j. issn. 1673-629X. 2020. 03. 017]
　CHEN Jing-jing,MA Ming-dong,WANG De-yu.Research on Optimization of MongoDB Load Balancing Algorithm[J].Computer Technology and Development,2020,30(03):88-92.[doi:10. 3969 / j. issn. 1673-629X. 2020. 03. 017]
点击复制

MongoDB 负载均衡算法优化研究()
分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
30
期数:
2020年03期
页码:
88-92
栏目:
智能、算法、系统工程
出版日期:
2020-03-10

文章信息/Info

Title:
Research on Optimization of MongoDB Load Balancing Algorithm
文章编号:
1673-629X(2020)03-0088-05
作者:
陈敬静1; 马明栋2; 王得玉2
1.南京邮电大学 通信与信息工程学院,江苏 南京 210003; 2.南京邮电大学 地理与生物信息学院,江苏 南京 210003
Author(s):
CHEN Jing-jing1; MA Ming-dong2; WANG De-yu2
1.School of Telecommunications & Information Engineering,Nanjing University of Posts and Telecommunications,Nanjing 210003,China; 2.School of Geographical and Biological Information,Nanjing University of Posts and Telecommunications, Nanjing 210003,China
关键词:
非关系型数据库; MongoDB; 自动分片; 负载均衡; 节点负载
Keywords:
NoSQL; MongoDB; auto-sharding; load balancing; node balancing
分类号:
TP393.0
DOI:
10. 3969 / j. issn. 1673-629X. 2020. 03. 017
摘要:
随着Web2.0网络应用的兴起和大数据技术的发展,传统的关系型数据库(ORDBMS)已经难以满足海量数据的存 储需求。 非关系型数据库(NoSQL)因其高扩展性、高伸缩性、高可用性和容错性等特点,得到了越来越多的应用。 作为一 种新兴的NoSQL数据库,MongoDB数据库因具有模式自由、易于扩展、故障自动恢复、支持自动分片等特点,被广泛应用于 大数据处理与分析中。 文中首先介绍了MongoDB自动分片架构原理和实现机制,然后分析了MongoDB自带的负载均衡 算法,其虽能使各个节点数据量达到平衡,但没有考虑各个节点的负载均衡。 为了解决节点的负载平均问题,在原算法基 础上提出了一种基于节点实时负载的负载均衡改进算法,改进算法的主要思想是引入节点负载指数作为chunk块迁移的 一个判断条件。 通过搭建测试环境并进行实验,验证了改进的负载均衡算法可以有效地均衡分片中的数据,提高集群的 并发读写性能,从而证明了算法的有效性。
Abstract:
With the rise of Web 2.0 network applications and the development of big data technology,the traditional relational database (ORDBMS) has been difficult to meet the storage requirements of massive data. Non-relational database (NoSQL) has been applied more and more because of its high expansibility,high scalability,high availability and fault to lerance. As a new NoSQL database, MongoDB is widely used in big data processing and analysis because of its free mode,easy expansion,automatic fault recovery and automatic fragmentation. We firstly introduce the principle and implementation mechanism of MongoDB automatic fragmentation architecture,and then analyze the load balancing algorithm of MongoDB. Although it can balance the data volume of each node,the load balancing of each node is not considered. In order to solve the load averaging problem of nodes,an improved load balancing algorithm based on real-time load of nodes is proposed. Its main idea is to introduce the load index of node as a judgment condition for chunk block migration. By setting up the test environment and conducting experiments,it is verified that the improved load balancing algorithm can effectively balance the data in the fragment and improve the concurrent read-write performance of the cluster,which proves its effectiveness.

相似文献/References:

[1]杨扬笛[][],吴海燕[],李虎[].基于非关系型数据库的卫星参数存储与处理[J].计算机技术与发展,2018,28(02):5.[doi:10．3969/j．issn．1673－629X．2018．02．002]
[2]戴传飞,马明栋.MongoDB 分页技术优化研究[J].计算机技术与发展,2018,28(06):97.[doi:10.3969/ j. issn.1673-629X.2018.06.022]
　DAI Chuan-fei,MA Ming-dong.Research on Optimization of MongoDB Paging Technology[J].Computer Technology and Development,2018,28(03):97.[doi:10.3969/ j. issn.1673-629X.2018.06.022]
[3]祁兰,毛燕琴,沈苏彬. 一种传感数据的压缩和高效存储方案[J].计算机技术与发展,2016,26(11):177.
　QI Lan,MAO Yan-qin,SHEN Su-bin. A Compressed and Efficient Storage Scheme of Sensor Network Data[J].Computer Technology and Development,2016,26(03):177.
[4]张国华,徐建军,刘丽娟. 基于NoSQL的新农合高效云存储方法[J].计算机技术与发展,2017,27(10):197.
　ZHANG Guo-hua,XU Jian-jun,LIU Li-juan. An Efficient Cloud Storage Method with NoSQL for New Rural Cooperative Medical Care[J].Computer Technology and Development,2017,27(03):197.
[5]陈振武,杨 洋*,兰添才*,等.RFID 与 MongoDB 融合的分布式云仓储管理系统[J].计算机技术与发展,2021,31(01):204.[doi:10. 3969 / j. issn. 1673-629X. 2021. 01. 036]
　CHEN Zhen-wu,YANG Yang *,LAN Tian-cai *,et al.Distributed Cloud Warehousing Management System forRFID and MongoDB Fusion[J].Computer Technology and Development,2021,31(03):204.[doi:10. 3969 / j. issn. 1673-629X. 2021. 01. 036]
[6]何杭锋.基于FODO算法MongoDB自动分片的改进[J].计算机技术与发展,2013,(07):127.
　HE Hang-feng.Improvement of MongoDB Auto-sharding Based on FODO[J].Computer Technology and Development,2013,(03):127.
[7]梁海. MongoDB数据库中Sharding技术应用研究[J].计算机技术与发展,2014,24(07):60.
　LIANG Hai. Application and Research on Sharding Technology in MongoDB Database[J].Computer Technology and Development,2014,24(03):60.

更新日期/Last Update: 2020-03-10