Fair Coflow Scheduling via Controlled Slowdown

被引:0
|
作者
De Pellegrini, Francesco [1 ]
Gupta, Vaibhav Kumar [2 ]
El Azouzi, Rachid [1 ]
Gueye, Serigne [1 ]
Richier, Cedric [1 ]
Leguay, Jeremie [3 ]
机构
[1] Avignon Univ, Lab Informat Avignon LIA, F-84029 Avignon, France
[2] LNM Inst Informat Technol LNMIIT, Jaipur 302031, Rajasthan, India
[3] Huawei Technol, Paris Res Ctr, F-92100 Boulogne Billancourt, France
关键词
Resource management; Minimization; Optimal scheduling; Data transfer; Switches; Standards; Scheduling; Coflow scheduling; data transfer; fairness; primal-dual scheduler; progress; ALGORITHM;
D O I
10.1109/TPDS.2024.3446188
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress guarantees have been introduced in the literature to mitigate this fairness issue, the trade-off between fairness and efficiency of data transfer is hard to control. This paper introduces a fairness framework for coflow scheduling based on the concept of slowdown, i.e., the performance loss of a coflow compared to isolation. By controlling the slowdown it is possible to enforce a target coflow progress while minimizing the average CCT. In the proposed framework, the minimum slowdown for a batch of coflows can be determined in polynomial time. By showing the equivalence with Gaussian elimination, slowdown constraints are introduced into primal-dual iterations of the CoFair algorithm. The algorithm extends the class of the sigma-order schedulers to solve the fair coflow scheduling problem in polynomial time. It provides a 4-approximation of the average CCT w.r.t. an optimal scheduler. Extensive numerical results demonstrate that this approach can trade off average CCT for slowdown more efficiently than existing state of the art schedulers.
引用
收藏
页码:2347 / 2360
页数:14
相关论文
共 50 条
  • [41] Fair and Efficient Scheduling of Variable Rate Links via a Spectrum Server
    Yates, Roy D.
    Raman, Chandrasekharan
    Mandayam, Narayan B.
    2006 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, VOLS 1-12, 2006, : 5246 - 5251
  • [42] Delay Control for Temporally Fair Scheduling Policies via Opportunistic Mixing
    Nguyen, PhuongBang C.
    Anh Hoang Nguyen
    Rao, Bhaskar D.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (19) : 5011 - 5024
  • [43] A Case for Sampling Based Learning Techniques in Coflow Scheduling
    Jajoo, Akshay
    Hu, Y. Charlie
    Lin, Xiaojun
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2022, 30 (04) : 1494 - 1508
  • [44] Minimizing Average Coflow Completion Time with Decentralized Scheduling
    Luo, Shouxi
    Yu, Hongfang
    Zhao, Yangming
    Wu, Bin
    Wang, Sheng
    Li, Le Min
    2015 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2015, : 307 - 312
  • [45] ELITE: Near-Optimal Heuristics for Coflow Scheduling
    Arfaoui, Afaf
    Elazouzi, Rachid
    De Pellegrini, Francesco
    Richier, Cedric
    Leguay, Jeremie
    2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 665 - 674
  • [46] Coflow Scheduling with Performance Guarantees for Data Center Applications
    Hasnain, Asif
    Karl, Holger
    2020 20TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2020), 2020, : 850 - 856
  • [47] Brief Announcement: A New Improved Bound for Coflow Scheduling
    Shafiee, Mehrnoosh
    Ghaderi, Javad
    PROCEEDINGS OF THE 29TH ACM SYMPOSIUM ON PARALLELISM IN ALGORITHMS AND ARCHITECTURES (SPAA'17), 2017, : 91 - 93
  • [48] Coflow Scheduling in Data Centers: Routing and Bandwidth Allocation
    Shi, Li
    Liu, Yang
    Zhang, Junwei
    Robertazzi, Thomas
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (11) : 2661 - 2675
  • [49] A Survey of Coflow Scheduling Schemes for Data Center Networks
    Wang, Shuo
    Zhang, Jiao
    Huang, Tao
    Liu, Jiang
    Pan, Tian
    Liu, Yunjie
    IEEE COMMUNICATIONS MAGAZINE, 2018, 56 (06) : 179 - 185
  • [50] Quantitatively fair scheduling
    Bianco, Alessandro
    Faella, Marco
    Mogavero, Fabio
    Murano, Aniello
    THEORETICAL COMPUTER SCIENCE, 2012, 413 (01) : 160 - 175