Research on Information Processing with Dynamic Adaptive Job Scheduling Algorithm Based on Hadoop Platform

被引：0
|
作者：
Jiang, Xueying [1 ]
Wang, Yao [1 ]
Meng, Yanyan [1 ]
机构：
[1] Northeastern Univ, Qinhuangdao 066004, Peoples R China
来源：
ADVANCED DEVELOPMENT OF ENGINEERING SCIENCE IV | 2014年 / 1046卷
关键词：
Job Scheduling Algorithm; Dynamic Adaptive; Ant Colony Algorithm; Hadoop;
D O I：
10.4028/www.scientific.net/AMR.1046.359
中图分类号：
T [工业技术];
学科分类号：
08 ;
摘要：
Job scheduling and resource allocation problems relate to the overall performance and resource utilization of Hadoop platform. This paper proposes a dynamic adaptive job scheduling algorithm based on Hadoop platform. This algorithm monitors the change of each computing resource nodes in real time. And through the feedback mechanism pass this information to the control node. It implements the purpose of assign the optimal resource for each of tasks.
引用
收藏
页码：359 / 362
页数：4
相关论文
共 50 条
  • [31] Hadoop-based Dynamic Load Balance Scheduling Algorithm of Logistics Inventory
    Li, Wenjing
    Zhou, Jie
    Lin, Zhong-Ming
    Zhang, Xiang-bo
    [J]. PROCEEDINGS OF 2016 12TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2016, : 5 - 8
  • [32] Research on Hybrid-genetic Algorithm for MAS Based Job-shop Dynamic Scheduling
    Li, Qingsong
    Qu, Dan
    Du, Liming
    [J]. IEEE/SOLI'2008: PROCEEDINGS OF 2008 IEEE INTERNATIONAL CONFERENCE ON SERVICE OPERATIONS AND LOGISTICS, AND INFORMATICS, VOLS 1 AND 2, 2008, : 1742 - 1745
  • [33] Research on Hybrid-genetic Algorithm for MAS based Job-shop Dynamic Scheduling
    Li, Qingsong
    Du, Liming
    [J]. ICICTA: 2009 SECOND INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION, VOL I, PROCEEDINGS, 2009, : 404 - 407
  • [34] A dynamic aggregation-based job scheduling algorithm for grid
    Shen, Jian-Gang
    Yang, Geng
    [J]. Nanjing Youdian Xueyuan Xuebao/Journal of Nanjing Institute of Posts and Telecommunications, 2005, 25 (05): : 20 - 25
  • [35] Dynamic Scheduling of Flexible Job Shop Based on Genetic Algorithm
    Yu, Tianbiao
    Zhou, Jing
    Fang, Junhua
    Gong, Yadong
    Wang, Wanshan
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS, VOLS 1-6, 2008, : 2014 - 2019
  • [36] Dynamic balance adaptive colony algorithm solving Job-Shop scheduling
    Wang, Yan-Hong
    Wang, Wen-Xia
    Yu, Hong-Xia
    Chen, Li
    [J]. Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2013, 19 (10): : 2521 - 2527
  • [37] Research on Data Processing for Condition Monitoring of Wind Turbine Based on Hadoop Platform
    Wang, Hongjun
    Zhao, Shaowei
    Zhao, Hui
    Yue, Youjun
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), 2017, : 322 - 326
  • [38] Resource and Deadline-aware Job Scheduling in Dynamic Hadoop Clusters
    Cheng, Dazhao
    Rao, Jia
    Jiang, Changjun
    Zhou, Xiaobo
    [J]. 2015 IEEE 29TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2015, : 956 - 965
  • [39] Research on flexible job shop scheduling based on genetic algorithm
    Tang Weri-Xian
    Yuan Hai-Bo
    [J]. 2008 INTERNATIONAL WORKSHOP ON INFORMATION TECHNOLOGY AND SECURITY, 2008, : 134 - 138
  • [40] Adaptive Task Scheduling Strategy Based on Dynamic Workload Adjustment for Heterogeneous Hadoop Clusters
    Xu, Xiaolong
    Cao, Lingling
    Wang, Xinheng
    [J]. IEEE SYSTEMS JOURNAL, 2016, 10 (02): : 471 - 482
12345