Scheduling divisible MapReduce computations

被引：50
|
作者：
Berlinska, J. [2 ]
Drozdowski, M. [1 ]
机构：
[1] Poznan Univ Tech, Inst Comp Sci, PL-60965 Poznan, Poland
[2] Adam Mickiewicz Univ, Fac Math & Comp Sci, PL-61614 Poznan, Poland
来源：
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING | 2011年 / 71卷 / 03期
关键词：
Parallel processing; MapReduce; Scheduling; Divisible loads; Performance evaluation; DISTRIBUTED COMPUTATION; TREE NETWORKS; LOADS;
D O I：
10.1016/j.jpdc.2010.12.004
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In this paper we analyze MapReduce distributed computations as a divisible load scheduling problem. The two operations of mapping and reducing can be understood as two divisible applications with precedence constraints. A divisible load model of the computation, and two load partitioning algorithms are proposed. Performance limits of MapReduce computations are investigated. To our best knowledge this is the first time that processing applications with precedence constraints have been considered on the grounds of divisible load theory. (C) 2010 Elsevier Inc. All rights reserved.
引用
收藏
页码：450 / 459
页数：10
相关论文
共 50 条
  • [21] Decentralized subcontractor scheduling with divisible jobs
    Behzad Hezarkhani
    Wiesław Kubiak
    Journal of Scheduling, 2015, 18 : 497 - 511
  • [22] SCHEDULING PARALLEL COMPUTATIONS
    REITER, R
    JOURNAL OF THE ACM, 1968, 15 (04) : 590 - &
  • [23] Multiround algorithms for scheduling divisible loads
    Yang, Y
    van der Raadt, K
    Casanova, H
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2005, 16 (11) : 1092 - 1102
  • [24] Summingbird: A Framework for Integrating Batch and Online MapReduce Computations
    Boykin, Oscar
    Ritchie, Sam
    O'Connell, Ian
    Lin, Jimmy
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2014, 7 (13): : 1441 - 1451
  • [25] Scheduling MapReduce Jobs in HPC Clusters
    Neves, Marcelo Veiga
    Ferreto, Tiago
    De Rose, Cesar
    EURO-PAR 2012 PARALLEL PROCESSING, 2012, 7484 : 179 - 190
  • [26] A review on job scheduling for hadoop mapreduce
    Kalia, Khushboo
    Gupta, Neeraj
    Proceedings - 2017 International Conference on Next Generation Computing and Information Systems, ICNGCIS 2017, 2018, : 86 - 91
  • [27] In-Cache MapReduce: Leverage Tiling to Boost Temporal Locality-Sensitive MapReduce Computations
    Magro, Daniel
    Paulino, Herve
    2016 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2016, : 374 - 383
  • [28] Energy Efficient Scheduling of MapReduce Jobs
    Bampis, Evripidis
    Chau, Vincent
    Letsios, Dimitrios
    Lucarelli, Giorgio
    Milis, Ioannis
    Zois, Georgios
    EURO-PAR 2014 PARALLEL PROCESSING, 2014, 8632 : 198 - 209
  • [29] A Survey on MapReduce Scheduling in Cloud Computing
    Liu, Li
    Zhai, YingQi
    2015 FIFTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC), 2015, : 1710 - 1715
  • [30] MapReduce delay scheduling with deadline constraint
    Li, Hongliang
    Wei, Xiaohui
    Fu, Qingwu
    Luo, Yuan
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2014, 26 (03): : 766 - 778
12345