[1]徐肖,胡吉明.一种Hadoop中基于改进遗传算法的作业调度算法[J].计算机技术与发展,2013,(03):10-13.
　XU Xiao,HU Ji-ming.A Job Scheduling Algorithm Based on Improved Genetic Algorithm in Hadoop[J].,2013,(03):10-13.
点击复制

一种Hadoop中基于改进遗传算法的作业调度算法()
分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
期数:
2013年03期
页码:
10-13
栏目:
智能、算法、系统工程
出版日期:
1900-01-01

文章信息/Info

Title:
A Job Scheduling Algorithm Based on Improved Genetic Algorithm in Hadoop
文章编号:
1673-629X（2013）03-0010-04
作者:
徐肖; 胡吉明
河海大学 计算机与信息学院
Author(s):
XU Xiao; HU Ji-ming
关键词:
Hadoop平台; 作业调度; 遗传算法
Keywords:
Hadoop; job scheduling; genetic algorithm
文献标志码:
A
摘要:
Hadoop平台是一个分布式系统基础框架,用户可以在不了解底层细节的情况下,开发分布式程序,并且可以充分利用集群来高速运算和存储. Hadoop平台核心技术之一作业调度技术,主要职责就是控制作业执行的顺序以及计算资源的分配,这直接影响到Hadoop平台的整体性能和资源利用情况.文中基于遗传算法框架对作业调度问题进行了研究,提出了一种新的分段编码策略,在编码时将计算资源作为遗传操作的基本单元,以此为基础提出新的区域杂交算子和变异算子.实验证明,此算法是Hadoop平台下有效的作业调度算法
Abstract:
Hadoop platform is a distributed system framework,users who don’t need to know the underlying details of the case can devel-op distributed programming and take full advantage of the cluster to high-speed computing and storing. Job scheduling,as one of the core technologies in Hadoop,its main function is to control the order of job execution and the allocation of computing resources,which directly affect the overall performance and resource utilization of Hadoop. It is to study job scheduling problem based on genetic algorithm,propo-sing a new segmentation coding strategies,taking computing resources as the basic unit of the genetic operation. In addition a new regional hybrid operator and mutation operator are included. Experiments show that it is an effective job scheduling algorithm in Hadoop

相似文献/References:

[1]凌东[],谷建华[][]. 一种采用消息模型的多集群作业管理方案设计[J].计算机技术与发展,2014,24(09):63.
　LING Dong[],GU Jian-hua[][]. Design of a Multi-cluster Job Management Scheme Using Message Model[J].,2014,24(03):63.
[2]张康,喻瑛,王伟杰. 基于MapReduce框架的航班串编制算法[J].计算机技术与发展,2017,27(03):142.
　ZHANG Kang,YU Ying,WANG Wei-jie. Flight String Compilation Algorithm Based on MapReduce Frame[J].,2017,27(03):142.
[3]冯鸣夏,伍卫国,邸德海.基于负载感知和QoS的多中心作业调度算法[J].计算机技术与发展,2018,28(12):1.[doi:10．3969/j．issn．1673－629X．2018．12．001]
　FENG Mingxia,WU Weiguo,DI Dehai.A Job Scheduling Algorithm in Multi－computing Centers Based on Load－aware and QoS[J].,2018,28(03):1.[doi:10．3969/j．issn．1673－629X．2018．12．001]

更新日期/Last Update: 1900-01-01