Straggler Mitigation in Hadoop MapReduce Framework: A Review

被引:0
|
作者
Ajibade, Lukuman Saheed [1 ]
Abu Bakar, Kamalrulnizam [1 ]
Aliyu, Ahmed [2 ]
Danish, Tasneem [3 ]
机构
[1] Univ Teknol Malaysia, Sch Comp, Johor Baharu, Malaysia
[2] Bauchi State Univ, Dept Math, Gadau, Nigeria
[3] Carleton Univ Canada, Syst & Comp Engn Dept, Ottawa, ON, Canada
关键词
Big data; blacklisting execution; Hadoop; MapReduce; spark; speculative execution; straggler; SKEWED DATA; ALGORITHMS;
D O I
10.14569/IJACSA.2022.01308101
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Processing huge and complex data to obtain useful information is challenging, even though several big data processing frameworks have been proposed and further enhanced. One of the prominent big data processing frameworks is MapReduce. The main concept of MapReduce framework relies on distributed and parallel processing. However, MapReduce framework is facing serious performance degradations due to the slow execution of certain tasks type called stragglers. Failing to handle stragglers causes delay and affects the overall job execution time. Meanwhile, several straggler reduction techniques have been proposed to improve the MapReduce performance. This study provides a comprehensive and qualitative review of the different existing straggler mitigation solutions. In addition, a taxonomy of the available straggler mitigation solutions is presented. Critical research issues and future research directions are identified and discussed to guide researchers and scholars.
引用
收藏
页码:870 / 878
页数:9
相关论文
共 50 条
  • [1] A Comprehensive Review of Straggler Handling Algorithms for MapReduce Framework
    Kumar, Umesh
    Kumar, Jitendar
    INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2014, 7 (04): : 139 - 148
  • [2] Energy-Driven Straggler Mitigation in MapReduce
    Phan, Tien-Dat
    Ibrahim, Shadi
    Zhou, Amelie Chi
    Aupy, Guillaume
    Antoniu, Gabriel
    EURO-PAR 2017: PARALLEL PROCESSING, 2017, 10417 : 385 - 398
  • [3] An Expressive Hadoop MapReduce Framework
    Shah, Nathar
    Messom, Christopher
    ADVANCED SCIENCE LETTERS, 2017, 23 (11) : 11197 - 11201
  • [4] A classification framework for straggler mitigation and management in a heterogeneous Hadoop cluster: A state-of-art survey
    Bawankule, Kamalakant Laxman
    Dewang, Rupesh Kumar
    Singh, Anil Kumar
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (09) : 7621 - 7644
  • [5] Introducing SSDs to the Hadoop MapReduce Framework
    Moon, Sangwhan
    Lee, Jaehwan
    Kee, Yang-suk
    2014 IEEE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2014, : 272 - 279
  • [6] SmartGrids: MapReduce Framework using Hadoop
    Fanibhare, Vaibhav
    Dahake, Vijay
    2016 3RD INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2016, : 406 - 411
  • [7] A New Framework for Evaluating Straggler Detection Mechanisms in MapReduce
    Phan, Tein-Dat
    Pallez, Guillaume
    Ibrahim, Shadi
    Raghavan, Padma
    ACM TRANSACTIONS ON MODELING AND PERFORMANCE EVALUATION OF COMPUTING SYSTEMS, 2019, 4 (03)
  • [8] Evaluation of Hadoop/Mapreduce Framework Migration Tools
    Odia, Trust
    Misra, Sanjay
    Adewumi, Adewole
    2014 ASIA-PACIFIC WORLD CONGRESS ON COMPUTER SCIENCE AND ENGINEERING (APWC ON CSE), 2014,
  • [9] Scientific data processing framework for Hadoop MapReduce
    Department of Computer and Information, Xinxiang University, Xinxiang, China
    1600, Journal of Chemical and Pharmaceutical Research, 3/668 Malviya Nagar, Jaipur, Rajasthan, India (06):
  • [10] A Review on Data locality in Hadoop MapReduce
    Sharma, Anil
    Singh, Gurwinder
    2018 FIFTH INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (IEEE PDGC), 2018, : 723 - 728