Hadoop MapReduce Scheduling Paradigms

被引：0
|
作者：
Johannessen, Roger [1 ]
Yazidi, Anis [1 ]
Feng, Boning [1 ]
机构：
[1] Oslo & Akershus Univ, Coll Appl Sci, Dept Comp Sci, Oslo, Norway
来源：
2017 2ND IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA 2017) | 2017年
关键词：
Apache Hadoop; MapReduce; scheduling paradigms;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Apache Hadoop is one of the most prominent and early technologies for handling big data. Different scheduling algorithms within the framework of Apache Hadoop were developed in the last decade. In this paper, we attempt to provide a comprehensive overview over the different paradigms for scheduling in Apache Hadoop. The surveyed approaches fall under different categories, namely, Deadline prioritization, Resource prioritization, Job size prioritization, Hybrid approaches and recent trends for improvements upon default schedulers.
引用
收藏
页码：175 / 179
页数：5
相关论文
共 50 条
  • [41] Using Hadoop MapReduce in a Multicluster Environment
    Tomasic, I.
    Rashkovska, A.
    Depolli, M.
    2013 36TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2013, : 345 - 350
  • [42] Dynamic Workload Balancing for Hadoop MapReduce
    Hou, Xiaofei
    Kumar, Ashwin T. K.
    Thomas, Johnson P.
    Varadharaj, Vijay
    2014 IEEE FOURTH INTERNATIONAL CONFERENCE ON BIG DATA AND CLOUD COMPUTING (BDCLOUD), 2014, : 56 - 62
  • [43] Assessing MapReduce for Internet Computing: A Comparison of Hadoop and BitDew-MapReduce
    Lu, Lu
    Jin, Hai
    Shi, Xuanhua
    Fedak, Gilles
    2012 ACM/IEEE 13TH INTERNATIONAL CONFERENCE ON GRID COMPUTING (GRID), 2012, : 76 - 84
  • [44] Evaluating MapReduce on Virtual Machines: The Hadoop Case
    Ibrahim, Shadi
    Jin, Hai
    Lu, Lu
    Qi, Li
    Wu, Song
    Shi, Xuanhua
    CLOUD COMPUTING, PROCEEDINGS, 2009, 5931 : 519 - +
  • [45] Analysis, Modeling, and Simulation of Hadoop YARN MapReduce
    Bressoud, Thomas C.
    Tang, Qiuyi
    2016 IEEE 22ND INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2016, : 980 - 988
  • [46] Vessel Route Anomaly Detection with Hadoop MapReduce
    Wang, Xiaoguang
    Liu, Xuan
    Liu, Bo
    de Souza, Erico N.
    Matwin, Stan
    2014 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2014,
  • [47] Efficient Big Data Processing in Hadoop MapReduce
    Dittrich, Jens
    Quiane-Ruiz, Jorge-Arnulfo
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (12): : 2014 - 2015
  • [48] MRBS: Towards Dependability Benchmarking for Hadoop MapReduce
    Sangroya, Amit
    Serrano, Damian
    Bouchenak, Sara
    EURO-PAR 2012: PARALLEL PROCESSING WORKSHOPS, 2013, 7640 : 3 - 12
  • [49] 基于Hadoop/MapReduce的KNN算法
    艾树宇
    科技传播, 2013, 5 (01) : 203 - 204+200
  • [50] Evaluation of Hadoop/Mapreduce Framework Migration Tools
    Odia, Trust
    Misra, Sanjay
    Adewumi, Adewole
    2014 ASIA-PACIFIC WORLD CONGRESS ON COMPUTER SCIENCE AND ENGINEERING (APWC ON CSE), 2014,
12345