Hadoop MapReduce Scheduling Paradigms

被引：0
|
作者：
Johannessen, Roger [1 ]
Yazidi, Anis [1 ]
Feng, Boning [1 ]
机构：
[1] Oslo & Akershus Univ, Coll Appl Sci, Dept Comp Sci, Oslo, Norway
来源：
2017 2ND IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA 2017) | 2017年
关键词：
Apache Hadoop; MapReduce; scheduling paradigms;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Apache Hadoop is one of the most prominent and early technologies for handling big data. Different scheduling algorithms within the framework of Apache Hadoop were developed in the last decade. In this paper, we attempt to provide a comprehensive overview over the different paradigms for scheduling in Apache Hadoop. The surveyed approaches fall under different categories, namely, Deadline prioritization, Resource prioritization, Job size prioritization, Hybrid approaches and recent trends for improvements upon default schedulers.
引用
收藏
页码：175 / 179
页数：5
相关论文
共 50 条
  • [21] Dynamic processing slots scheduling for I/O intensive jobs of Hadoop MapReduce
    Kurazumi, Shiori
    Tsumura, Tomoaki
    Saito, Shoichi
    Matsuo, Hiroshi
    2012 THIRD INTERNATIONAL CONFERENCE ON NETWORKING AND COMPUTING (ICNC 2012), 2012, : 288 - 292
  • [22] Hadoop MapReduce for Mobile Clouds
    George, Johnu
    Chen, Chien-An
    Stoleru, Radu
    Xie, Geoffrey G.
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2019, 7 (01) : 224 - 236
  • [23] Improving the Shuffle of Hadoop MapReduce
    Li, Jingui
    Lin, Xuelian
    Cui, Xiaolong
    Ye, Yue
    2013 IEEE FIFTH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM), VOL 1, 2013, : 266 - 273
  • [24] Hadoop MapReduce for Tactical Clouds
    George, Johnu
    Chen, Chien-An
    Stoleru, Radu
    Xie, Geoffrey G.
    Sookoor, Tamim
    Bruno, David
    2014 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD NETWORKING (CLOUDNET), 2014, : 320 - 326
  • [25] An Expressive Hadoop MapReduce Framework
    Shah, Nathar
    Messom, Christopher
    ADVANCED SCIENCE LETTERS, 2017, 23 (11) : 11197 - 11201
  • [26] Hardware acceleration of Hadoop MapReduce
    Honjo, Toshimori
    Oikawa, Kazuki
    2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,
  • [27] LaSA: A Locality-aware Scheduling Algorithm for Hadoop-MapReduce Resource Assignment
    Chen, Tseng-Yi
    Wei, Hsin-Wen
    Wei, Ming-Feng
    Chen, Ying-Jie
    Hsu, Tsan-Sheng
    Shih, Wei-Kuan
    PROCEEDINGS OF THE 2013 INTERNATIONAL CONFERENCE ON COLLABORATION TECHNOLOGIES AND SYSTEMS (CTS), 2013, : 342 - 346
  • [28] Constraint programming versus heuristic approach to MapReduce scheduling problem in Hadoop YARN for energy minimization
    Vaibhav Pandey
    Poonam Saini
    The Journal of Supercomputing, 2021, 77 : 6788 - 6816
  • [29] Constraint programming versus heuristic approach to MapReduce scheduling problem in Hadoop YARN for energy minimization
    Pandey, Vaibhav
    Saini, Poonam
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (07): : 6788 - 6816
  • [30] HOG: Distributed Hadoop MapReduce on the Grid
    He, Chen
    Weitzel, Derek
    Swanson, David
    Lu, Ying
    2012 SC COMPANION: HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SCC), 2012, : 1276 - 1283
12345