[1]杨永凯,彭明田,王炜东.集群内高效可靠的数据文件分发方案的设计[J].计算机技术与发展,2019,29(11):163-167.[doi:10. 3969 / j. issn. 1673-629X. 2019. 11. 033]
　YANG Yong-kai,PENG Ming-tian,WANG Wei-dong.Design of Efficient and Reliable Data File Distribution Solution in Cluster[J].,2019,29(11):163-167.[doi:10. 3969 / j. issn. 1673-629X. 2019. 11. 033]
点击复制

集群内高效可靠的数据文件分发方案的设计()
分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
29
期数:
2019年11期
页码:
163-167
栏目:
应用开发研究
出版日期:
2019-11-10

文章信息/Info

Title:
Design of Efficient and Reliable Data File Distribution Solution in Cluster
文章编号:
1673-629X(2019)11-0163-05
作者:
杨永凯1; 2 ; 彭明田1; 2 ; 王炜东1
1. 中国民航信息网络股份有限公司,北京 101318; 2. 民航旅客服务智能化应用技术重点实验室,北京 101318
Author(s):
YANG Yong-kai 1; 2 ; PENG Ming-tian 1; 2 ; WANG Wei-dong 1
1. TravelSky Technology Limited,Beijing 101318,China; 2. Key Laboratory of Intelligent Passenger Service of Civil Aviation,Beijing 101318,China
关键词:
集群; 文件分发; ZeroMQ; 多播; 传输控制
Keywords:
cluster; file distribution; ZeroMQ; multicast; transmission control
分类号:
TP301
DOI:
10. 3969 / j. issn. 1673-629X. 2019. 11. 033
摘要:
为了实现局域网集群内数据文件的高效和可靠的分发,设计了数据流和控制流相结合的数据文件分发方案。 在数据流方面,以 ZeroMQ 为基础设计了 UDP 协议下的多播数据文件传输方案。 在控制流方面,基于 TCP 协议设计了多播数据文件传输控制方案。 传输控制方案包括监控模块、检测模块、调速模块和计速模块,监控模块和检测模块实现了对数据文件传输开关的控制,调速模块和计速模块实现了对数据文件传输速率的控制,两方面结合实现了对多播数据文件传输的有效调度,达到了数据文件分发过程中的高效和可靠的双重目的。 工程实践表明,在保证一定的多播传输速率的基础上,可以提升数据文件分发的一次多播成功率,减少多播传输的轮次,能够实现集群内高效可靠的数据文件分发。
Abstract:
In order to achieve efficient and reliable data file distribution in cluster,a data file distribution solution combining data flow and control flow is designed. In the data flow,based on ZeroMQ,the multicast data file transmission scheme based on UDP is designed,and in the control flow,a multicast data file transmission control scheme based on TCP is designed. The transmission control scheme includes monitor module,check module,shift module and meter module. The monitor module and check module realize the control of the data file transmission switch,the shift module and the meter module realize the control of the data file transmission rate,and the ombination of the two aspects realizes the effective scheduling of the multicast data file transmission,achieving the dual purpose of high efficiency and reliability in the data file distribution. Engineering practice shows that,on the basis of guaranteeing a certain multicast transmission rate,the success rate of one multicast for data file distribution can be improved,the round of multicast transmission can be reduced,and the efficient and reliable data file distribution within the cluster can be ealized.

相似文献/References:

[1]卢照 张锦娟 师军 鱼佳欣.MPI动态负载平衡策略的研究与实现[J].计算机技术与发展,2010,(05):132.
　LU Zhao,ZHANG Jin-juan,SHI Jun,et al.Dynamic Load Balancing Strategies in MPI Parallel Environment[J].,2010,(11):132.
[2]郭静 祝永志 王延玲.基于MPI的动态负载平衡算法的研究[J].计算机技术与发展,2009,(05):150.
　GUO Jing,ZHU Yong-zhi,WANG Yan-ling.Research on Dynamic Load Balancing Algorithm Based on MPI[J].,2009,(11):150.
[3]徐群 祝永志.集群系统中的负载均衡问题的研究[J].计算机技术与发展,2009,(08):129.
　XU Qun,ZHU Yong-zhi.Research on Load Balancing Strategy for Cluster Systems[J].,2009,(11):129.
[4]陆磊 王锋.基于流负载均衡的入侵检测系统[J].计算机技术与发展,2009,(11):135.
　LU Lei,WANG Feng.Intrusion Detection System Based on Flow Load Balance[J].,2009,(11):135.
[5]李丹 金庆 吴国新.基于DRM的版权管理系统的研究与设计[J].计算机技术与发展,2008,(03):188.
　LI Dan,JIN Qing,WU Guo-xin.Research and Design for Copyright Management System Based on DRM[J].,2008,(11):188.
[6]刘必雄 许榕生[].大规模文件上传接收服务的负载均衡引擎研究[J].计算机技术与发展,2008,(06):16.
　LIU Bi-xiong,XU Rong-sheng.Research of Load - Balancing Engine for Large - Scale Up - Transfer Files Receiving Service[J].,2008,(11):16.
[7]王勇超 张璟 王新卫 马静.基于MPICH2的高性能计算集群系统研究[J].计算机技术与发展,2008,(09):101.
　WANG Yong-chao,ZHANG Jing,WANG Xin-wei,et al.Research of High Performance Cluster System Based on MPICH2[J].,2008,(11):101.
[8]王延玲 祝永志 郭静.基于HPJava集群系统的环境搭建与性能分析[J].计算机技术与发展,2008,(11):94.
　WANG Yan-ling,ZHU Yong-zhi,GUO Jing.Constructing and Perfomance Analysis of Cluster System Based on HPJava[J].,2008,(11):94.
[9]宋伟 宋玉.基于SMP集群系统的并行编程模式研究与分析[J].计算机技术与发展,2007,(02):164.
　SONG Wei,SONG Yu.Research and Analysis of Parallel Programming Model Based on SMP Cluster System[J].,2007,(11):164.
[10]许普乐 夏明波 金士尧.主动式集群中模糊逻辑及其改进研究[J].计算机技术与发展,2007,(07):120.
　XU Pu-le,XIA Ming-bo,JIN Shi-yao.Fuzzy Logic and Its Improvement in Active Self-Allocating Cluster[J].,2007,(11):120.

更新日期/Last Update: 2019-11-10