Hadoop MapReduce Scheduling Paradigms

被引:0
|
作者
Johannessen, Roger [1 ]
Yazidi, Anis [1 ]
Feng, Boning [1 ]
机构
[1] Oslo & Akershus Univ, Coll Appl Sci, Dept Comp Sci, Oslo, Norway
关键词
Apache Hadoop; MapReduce; scheduling paradigms;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Apache Hadoop is one of the most prominent and early technologies for handling big data. Different scheduling algorithms within the framework of Apache Hadoop were developed in the last decade. In this paper, we attempt to provide a comprehensive overview over the different paradigms for scheduling in Apache Hadoop. The surveyed approaches fall under different categories, namely, Deadline prioritization, Resource prioritization, Job size prioritization, Hybrid approaches and recent trends for improvements upon default schedulers.
引用
收藏
页码:175 / 179
页数:5
相关论文
共 50 条
  • [1] A review on job scheduling for hadoop mapreduce
    Kalia, Khushboo
    Gupta, Neeraj
    Proceedings - 2017 International Conference on Next Generation Computing and Information Systems, ICNGCIS 2017, 2018, : 86 - 91
  • [2] TaskTracker Aware Scheduling for Hadoop MapReduce
    Manjaly, Jisha S.
    Chooralil, Varghese S.
    2013 THIRD INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING AND COMMUNICATIONS (ICACC 2013), 2013, : 278 - 281
  • [3] Scheduling for response time in Hadoop MapReduce
    Dai, Xiangming
    Bensaou, Brahim
    2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2016,
  • [4] A REVIEW ON JOB SCHEDULING FOR HADOOP MAPREDUCE
    Kalia, Khushboo
    Gupta, Neeraj
    2017 INTERNATIONAL CONFERENCE ON NEXT GENERATION COMPUTING AND INFORMATION SYSTEMS (ICNGCIS), 2017, : 75 - 79
  • [5] MapReduce scheduling algorithms in Hadoop: a systematic study
    Hedayati, Soudabeh
    Maleki, Neda
    Olsson, Tobias
    Ahlgren, Fredrik
    Seyednezhad, Mahdi
    Berahmand, Kamal
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2023, 12 (01):
  • [6] Analysis of hadoop MapReduce scheduling in heterogeneous environment
    Kalia, Khushboo
    Gupta, Neeraj
    AIN SHAMS ENGINEERING JOURNAL, 2021, 12 (01) : 1101 - 1110
  • [7] Improving the efficiency of MapReduce scheduling algorithm in Hadoop
    Thangaselvi, R.
    Ananthbabu, S.
    Jagadeesh, S.
    Aruna, R.
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON APPLIED AND THEORETICAL COMPUTING AND COMMUNICATION TECHNOLOGY (ICATCCT), 2015, : 63 - 68
  • [8] MapReduce scheduling algorithms in Hadoop: a systematic study
    Soudabeh Hedayati
    Neda Maleki
    Tobias Olsson
    Fredrik Ahlgren
    Mahdi Seyednezhad
    Kamal Berahmand
    Journal of Cloud Computing, 12
  • [9] A REVIEW OF RESEARCH ON MAPREDUCE SCHEDULING ALGORITHMS IN HADOOP
    Singh, Namrata
    Agrawal, Sanjay
    2015 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION & AUTOMATION (ICCCA), 2015, : 637 - 642
  • [10] On MapReduce Scheduling in Hadoop Yarn on Heterogeneous Clusters
    Wang, Meng
    Wu, Chase Q.
    Cao, Huiyan
    Liu, Yang
    Wang, Yonggiang
    Hou, Aiqin
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (IEEE TRUSTCOM) / 12TH IEEE INTERNATIONAL CONFERENCE ON BIG DATA SCIENCE AND ENGINEERING (IEEE BIGDATASE), 2018, : 1747 - 1754