Research on Information Processing with Dynamic Adaptive Job Scheduling Algorithm Based on Hadoop Platform

被引：0
|
作者：
Jiang, Xueying [1 ]
Wang, Yao [1 ]
Meng, Yanyan [1 ]
机构：
[1] Northeastern Univ, Qinhuangdao 066004, Peoples R China
来源：
ADVANCED DEVELOPMENT OF ENGINEERING SCIENCE IV | 2014年 / 1046卷
关键词：
Job Scheduling Algorithm; Dynamic Adaptive; Ant Colony Algorithm; Hadoop;
D O I：
10.4028/www.scientific.net/AMR.1046.359
中图分类号：
T [工业技术];
学科分类号：
08 ;
摘要：
Job scheduling and resource allocation problems relate to the overall performance and resource utilization of Hadoop platform. This paper proposes a dynamic adaptive job scheduling algorithm based on Hadoop platform. This algorithm monitors the change of each computing resource nodes in real time. And through the feedback mechanism pass this information to the control node. It implements the purpose of assign the optimal resource for each of tasks.
引用
收藏
页码：359 / 362
页数：4
相关论文
共 50 条
  • [1] A Research on Routing Scheduling of Cloud Computing Based on Adaptive Ant Colony Algorithm on Hadoop Platform
    Gao, Chen Zhi
    [J]. 2012 INTERNATIONAL ACADEMIC CONFERENCE OF ART ENGINEERING AND CREATIVE INDUSTRY (IACAE 2012), 2012, : 445 - 449
  • [2] Improved Adaptive Feedback Scheduling Algorithm based on LATE in Hadoop Platform
    Guo, Jing
    Wang, Yong
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 4033 - 4038
  • [3] Research on adaptive recommendation algorithm for big data mining based on Hadoop platform
    Zhang, Jinming
    [J]. INTERNATIONAL JOURNAL OF INTERNET PROTOCOL TECHNOLOGY, 2019, 12 (04) : 213 - 220
  • [4] Adaptive Scheduling in the Cloud - SLA for Hadoop Job Scheduling
    Nayak, Deveeshree
    Martha, Venkata Swamy
    Threm, David
    Ramaswamy, Srini
    Prince, Summer
    Fahrnberger, Guenter
    [J]. 2015 SCIENCE AND INFORMATION CONFERENCE (SAI), 2015, : 832 - 837
  • [5] The Research on MMR Algorithm Based on Hadoop Platform
    Qu, Zhaoyang
    Ma, Xu-Dong
    Lou, Jian-Lou
    [J]. MULTIDISCIPLINARY SOCIAL NETWORKS RESEARCH, MISNC 2015, 2015, 540 : 292 - 302
  • [6] A Task Scheduling Algorithm for Hadoop Platform
    Chen, Jilan
    Wang, Dan
    Zhao, Wenbing
    [J]. JOURNAL OF COMPUTERS, 2013, 8 (04) : 929 - 936
  • [7] Research on Flexible Job Shop Dynamic Scheduling Based on Genetic Algorithm
    Zhou Jing
    Yu Tianbiao
    Fang Junhua
    Gong Yadong
    Wang Wanshan
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT, VOLS A-C, 2008, : 1702 - 1706
  • [8] Hadoop Job Scheduling with Dynamic Task Splitting
    Xu, YongLiang
    Cai, Wentong
    [J]. 2015 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING RESEARCH AND INNOVATION (ICCCRI), 2015, : 120 - 129
  • [9] Research and Application of DBSCAN Algorithm Based on Hadoop Platform
    Fu, Xiufen
    Wang, Yaguang
    Ge, Yanna
    Chen, Peiwen
    Teng, Shaohua
    [J]. PERVASIVE COMPUTING AND THE NETWORKED WORLD, 2014, 8351 : 73 - 87
  • [10] Hadoop Job Scheduling Based on Hybrid Ant-Genetic Algorithm
    Huang, Xiaofei
    Zhou, Hui
    Wu, Wei
    [J]. 2015 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY, 2015, : 226 - 229
12345