Research on Information Processing with Dynamic Adaptive Job Scheduling Algorithm Based on Hadoop Platform

被引：0
|
作者：
Jiang, Xueying [1 ]
Wang, Yao [1 ]
Meng, Yanyan [1 ]
机构：
[1] Northeastern Univ, Qinhuangdao 066004, Peoples R China
来源：
ADVANCED DEVELOPMENT OF ENGINEERING SCIENCE IV | 2014年 / 1046卷
关键词：
Job Scheduling Algorithm; Dynamic Adaptive; Ant Colony Algorithm; Hadoop;
D O I：
10.4028/www.scientific.net/AMR.1046.359
中图分类号：
T [工业技术];
学科分类号：
08 ;
摘要：
Job scheduling and resource allocation problems relate to the overall performance and resource utilization of Hadoop platform. This paper proposes a dynamic adaptive job scheduling algorithm based on Hadoop platform. This algorithm monitors the change of each computing resource nodes in real time. And through the feedback mechanism pass this information to the control node. It implements the purpose of assign the optimal resource for each of tasks.
引用
收藏
页码：359 / 362
页数：4
相关论文
共 50 条
  • [41] Adaptive Deadline based Dependent Job Scheduling algorithm in Cloud Computing
    Komarasamy, Dinesh
    Muthuswamy, Vijayalakshmi
    [J]. 2015 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC), 2015,
  • [42] Improvement of Apriori Algorithm Based on Hadoop Platform
    Qi, Lian-Yun
    Cui, Xiao-Yan
    Wang, Li-Jie
    Li, Yao-Kai
    Zhang, Xiao-Dong
    [J]. INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND COMMUNICATION ENGINEERING (CSCE 2015), 2015, : 195 - 200
  • [43] Research of Multi-resource Dynamic Job-Shop Scheduling based on the Hybrid Genetic Algorithm
    Zhao Peng
    Huang Ting-lei
    [J]. THIRD INTERNATIONAL CONFERENCE ON GENETIC AND EVOLUTIONARY COMPUTING, 2009, : 81 - 84
  • [44] Research on database massive data processing and mining method based on hadoop cloud platform
    Xiaoyong, Zhao
    Chunrong, Yang
    [J]. Open Automation and Control Systems Journal, 2014, 6 (01): : 1463 - 1467
  • [45] A Dynamic Job Scheduling Algorithm for Parallel System
    张建
    陆鑫达
    加力
    [J]. Journal of Shanghai Jiaotong University(Science), 2003, (01) : 10 - 14
  • [46] An Improved Chaos Immune Algorithm Based on Hadoop Framework to Solve Job-shop Scheduling Problem
    Liang, Xu
    Wang, Minyi
    Jiao, Xuan
    Huang, Ming
    [J]. 2013 3RD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), 2013, : 5 - 9
  • [47] A dynamic job scheduling algorithm for computational Grid
    Zhang, J
    Lu, XD
    [J]. GRID AND COOPERATIVE COMPUTING, PT 2, 2004, 3033 : 40 - 47
  • [48] Research on Database Massive Data Processing and Mining Method based on Hadoop Cloud Platform
    Wu, Dan
    Li, Zhuorong
    Bie, Rongfang
    Zhou, Mingquan
    [J]. 2014 International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI 2014), 2014, : 107 - 110
  • [49] Research on Building the Cloud Platform Based on Hadoop
    Han, Yongqi
    Zhang, Yun
    Guan, Weidong
    [J]. APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 : 2468 - 2471
  • [50] Research of dynamic scheduling algorithm based on stochastic model
    [J]. Xiao, Yi-Fei, 1600, Systems Engineering Society of China (34):
12345