Online MapReduce scheduling problem of minimizing the makespan

被引:0
|
作者
Cong Chen
Yinfeng Xu
Yuqing Zhu
Chengyu Sun
机构
[1] Xi’an Jiaotong University,School of Management
[2] The State Key Lab for Manufacturing Systems Engineering,Department of Computer Science
[3] California State University,undefined
来源
关键词
Online algorithm; MapReduce scheduling; Makespan ; Big data;
D O I
暂无
中图分类号
学科分类号
摘要
MapReduce system is a popular big data processing framework, and the performance of it is closely related to the efficiency of the centralized scheduler. In practice, the centralized scheduler often has little information in advance, which means each job may be known only after being released. In this paper, hence, we consider the online MapReduce scheduling problem of minimizing the makespan, where jobs are released over time. Both preemptive and non-preemptive version of the problem are considered. In addition, we assume that reduce tasks cannot be parallelized because they are often complex and hard to be decomposed. For the non-preemptive version, we prove the lower bound is m+m(Ψ(m)-Ψ(k))k+m(Ψ(m)-Ψ(k))\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\frac{m+m(\Psi (m)-\Psi (k))}{k+m(\Psi (m)-\Psi (k))}$$\end{document}, higher than the basic online machine scheduling problem, where k is the root of the equation k=⌊m-k1+Ψ(m)-Ψ(k)+1⌋\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k=\big \lfloor {\frac{m-k}{1+\Psi (m)-\Psi (k)}+1 }\big \rfloor $$\end{document} and m is the quantity of machines. Then we devise an (2-1m)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$(2-\frac{1}{m})$$\end{document}-competitive online algorithm called MF-LPT (Map First-Longest Processing Time) based on the LPT. For the preemptive version, we present a 1-competitive algorithm for two machines.
引用
收藏
页码:590 / 608
页数:18
相关论文
共 50 条
  • [1] Online MapReduce scheduling problem of minimizing the makespan
    Chen, Cong
    Xu, Yinfeng
    Zhu, Yuqing
    Sun, Chengyu
    [J]. JOURNAL OF COMBINATORIAL OPTIMIZATION, 2017, 33 (02) : 590 - 608
  • [2] Metaheuristics for minimizing the makespan of the dynamic shop scheduling problem
    Liu, SQ
    Ong, HL
    Ng, KM
    [J]. ADVANCES IN ENGINEERING SOFTWARE, 2005, 36 (03) : 199 - 205
  • [3] MINIMIZING THE MAKESPAN OF A GROUP SCHEDULING PROBLEM - A NEW HEURISTIC
    LOGENDRAN, R
    NUDTASOMBOON, N
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 1991, 22 (03) : 217 - 230
  • [4] Minimizing makespan in a multimode multiprocessor shop scheduling problem
    Bianco, L
    Dell'Olmo, P
    Giordani, S
    Speranza, MG
    [J]. NAVAL RESEARCH LOGISTICS, 1999, 46 (08) : 893 - 911
  • [5] Minimizing the makespan in a single machine scheduling problem with a flexible maintenance
    Yang, Dar-Li
    Hung, Ching-Lien
    Hsu, Chou-Jung
    Chem, Maw-Sheng
    [J]. Journal of the Chinese Institute of Industrial Engineers, 2002, 19 (01): : 63 - 66
  • [6] Minimizing the makespan for the flow shop scheduling problem with availability constraints
    Aggoune, R
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2004, 153 (03) : 534 - 543
  • [7] Orchestrating an Ensemble of MapReduce Jobs for Minimizing Their Makespan
    Verma, Abhishek
    Cherkasova, Ludmila
    Campbell, Roy H.
    [J]. IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2013, 10 (05) : 314 - 327
  • [8] On Minimizing the Makespan Of A Set of Offline MapReduce Jobs
    He, Majun
    Guo, Wenxia
    Huang, Houwen
    He, Bo
    Wang, Jing
    Tian, Wenhong
    [J]. 2018 IEEE WORLD CONGRESS ON SERVICES (IEEE SERVICES 2018), 2018, : 1 - 2
  • [9] Heuristics for Uniform Parallel Machine Scheduling Problem with Minimizing Makespan
    Li, Kai
    Zhang, Shu-chu
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS, VOLS 1-6, 2008, : 273 - 278
  • [10] Online scheduling in Minimizing Makespan on Identical Parallel Processor with Release Date
    Nordin, Syarifah Zyurina
    Caccetta, Lou
    [J]. MATEMATIKA, 2014, 30 (01): : 71 - 84