The research and Improvement of MapReduce cluster scheduling strategy based on ant colony optimization

被引:1
|
作者
Zhang, Yaping [1 ]
Qin, Jun
Zhai, Zhao [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Comp, Nanjing 210003, Jiangsu, Peoples R China
关键词
Ant Colony Optimization; MapReduce Clusters; Schedule Strategy;
D O I
10.4028/www.scientific.net/AMM.513-517.1989
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The distributed computing framework of MapReduce has been widely used in big companies as a powerful tool for processing large scale of data. This paper will introduce the existing algorithms about MapReduce job scheduling and analyze the major two ones. It points out the defects of multi-task scheduling application on processing massive jobs and proposes a kind of multi-task cluster schedule algorithm MSBACO which is based on the ant colony optimization. The results of the experiments have proved its effectiveness and stability in heterogeneous environment.
引用
收藏
页码:1989 / 1993
页数:5
相关论文
共 50 条
  • [1] Research and Implementation of Chaos Optimization Ant Colony Algorithm Based on MapReduce
    Xie, Peng-fei
    Fu, Xue-liang
    Dong, Gai-fang
    Li, Hong-hui
    [J]. INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION ENGINEERING (CSIE 2015), 2015, : 227 - 233
  • [2] A hybrid ant colony optimization algorithm based on MapReduce
    Cai, Ming
    Zuo, Yongan
    [J]. PROCEEDINGS OF THE 2016 3RD INTERNATIONAL CONFERENCE ON MATERIALS ENGINEERING, MANUFACTURING TECHNOLOGY AND CONTROL, 2016, 67 : 136 - 140
  • [3] Research on Grid Resource Scheduling Strategy Based on Ant Colony Algorithm
    Liu, Aihong
    [J]. EIGHTH WUHAN INTERNATIONAL CONFERENCE ON E-BUSINESS, VOLS I-III, 2009, : 824 - 829
  • [4] Ant Colony Optimization based Scheduling Algorithm
    Nosheen, Fariha
    Bibi, Sadia
    Khan, Salabat
    [J]. 2013 INTERNATIONAL CONFERENCE ON OPEN SOURCE SYSTEMS AND TECHNOLOGIES (ICOSST), 2013, : 18 - 22
  • [5] Improvement of Container Scheduling for Docker using Ant Colony Optimization
    Kaewkasi, Chanwit
    Chuenmuneewong, Kornrathak
    [J]. 2017 9TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SMART TECHNOLOGY (KST), 2017, : 254 - 259
  • [6] Optimizing MapReduce Task Scheduling on Virtualized Heterogeneous Environments Using Ant Colony Optimization
    Jeyaraj, Rathinaraja
    Paul, Anand
    [J]. IEEE ACCESS, 2022, 10 : 55842 - 55855
  • [7] Research on Cloud Task Scheduling Based on Load Balancing Ant Colony Optimization
    Hu, Hai-tao
    Luo, Xiao-rong
    [J]. 2018 INTERNATIONAL CONFERENCE ON COMPUTER, COMMUNICATION AND NETWORK TECHNOLOGY (CCNT 2018), 2018, 291 : 60 - 64
  • [8] Research on flexible job shop scheduling problem based on ant colony optimization
    Yan, W.
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 125 : 19 - 20
  • [9] Research on improved strategy of ant colony optimization algorithm
    Wang Jinguo
    Wang Na
    Ma Haichun
    [J]. PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON ADVANCED DESIGN AND MANUFACTURING ENGINEERING, 2015, 39 : 2091 - 2094
  • [10] Research on improved strategy of ant colony optimization algorithm
    Wang Rui
    Wang Jinguo
    Wang Na
    [J]. PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MATERIAL, MECHANICAL AND MANUFACTURING ENGINEERING, 2015, 27 : 942 - 945