Fair Coflow Scheduling via Controlled Slowdown

被引:0
|
作者
De Pellegrini, Francesco [1 ]
Gupta, Vaibhav Kumar [2 ]
El Azouzi, Rachid [1 ]
Gueye, Serigne [1 ]
Richier, Cedric [1 ]
Leguay, Jeremie [3 ]
机构
[1] Avignon Univ, Lab Informat Avignon LIA, F-84029 Avignon, France
[2] LNM Inst Informat Technol LNMIIT, Jaipur 302031, Rajasthan, India
[3] Huawei Technol, Paris Res Ctr, F-92100 Boulogne Billancourt, France
关键词
Resource management; Minimization; Optimal scheduling; Data transfer; Switches; Standards; Scheduling; Coflow scheduling; data transfer; fairness; primal-dual scheduler; progress; ALGORITHM;
D O I
10.1109/TPDS.2024.3446188
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress guarantees have been introduced in the literature to mitigate this fairness issue, the trade-off between fairness and efficiency of data transfer is hard to control. This paper introduces a fairness framework for coflow scheduling based on the concept of slowdown, i.e., the performance loss of a coflow compared to isolation. By controlling the slowdown it is possible to enforce a target coflow progress while minimizing the average CCT. In the proposed framework, the minimum slowdown for a batch of coflows can be determined in polynomial time. By showing the equivalence with Gaussian elimination, slowdown constraints are introduced into primal-dual iterations of the CoFair algorithm. The algorithm extends the class of the sigma-order schedulers to solve the fair coflow scheduling problem in polynomial time. It provides a 4-approximation of the average CCT w.r.t. an optimal scheduler. Extensive numerical results demonstrate that this approach can trade off average CCT for slowdown more efficiently than existing state of the art schedulers.
引用
收藏
页码:2347 / 2360
页数:14
相关论文
共 50 条
  • [21] Non-preemptive Coflow Scheduling and Routing
    Yu, Ruozhou
    Xue, Guoliang
    Zhang, Xiang
    Tang, Jian
    2016 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2016,
  • [22] Integrating Coflow and Circuit Scheduling for Optical Networks
    Wang, Haibo
    Yu, Xiwen
    Xu, Hongli
    Fan, Jingyuan
    Qiao, Chunming
    Huang, Liusheng
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (06) : 1346 - 1358
  • [23] Providing In-network Support to Coflow Scheduling
    Benet, Cristian Hetnandez
    Kassler, Andreas
    Antichi, Gianni
    Benson, Theophilus A.
    Pongracz, Gergely
    PROCEEDINGS OF THE 2021 IEEE 7TH INTERNATIONAL CONFERENCE ON NETWORK SOFTWARIZATION (NETSOFT 2021): ACCELERATING NETWORK SOFTWARIZATION IN THE COGNITIVE AGE, 2021, : 235 - 243
  • [24] Skipping Congestion-links for Coflow Scheduling
    Wang, Shuo
    Zhang, Jiao
    Huang, Tao
    Pan, Tian
    Liu, Jiang
    Liu, Yunjie
    Li, Jin
    Li, Feng
    2017 IEEE/ACM 25TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2017,
  • [25] FAIR SCHEDULING VIA ITERATIVE QUASI-UNIFORM SAMPLING
    Im, Sungjin
    Moseley, Benjamin
    SIAM JOURNAL ON COMPUTING, 2020, 49 (03) : 658 - 680
  • [26] Fair Scheduling via Iterative Quasi-Uniform Sampling
    Im, Sungjin
    Moseley, Benjamin
    PROCEEDINGS OF THE TWENTY-EIGHTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2017, : 2601 - 2615
  • [27] Fast and isolation guaranteed coflow scheduling via traffic forecasting in multi-tenant environment
    Li, Chenghao
    Zhang, Huyin
    Yang, Fei
    Hao, Sheng
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (19): : 26726 - 26750
  • [28] Deadline-Aware Coflow Scheduling in a DAG
    Wang, Junchao
    Zhou, Huan
    Hu, Yang
    De Laat, Cees
    Zhao, Zhiming
    2017 9TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM), 2017, : 341 - 346
  • [29] Efficient Coflow Scheduling Without Prior Knowledge
    Chowdhury, Mosharaf
    Stoica, Ion
    SIGCOMM'15: PROCEEDINGS OF THE 2015 ACM CONFERENCE ON SPECIAL INTEREST GROUP ON DATA COMMUNICATION, 2015, : 393 - 406
  • [30] Semi-Distributed Coflow Scheduling in Datacenters
    El-Azouzi, Rachid
    De Pellegrini, Francesco
    Arfaoui, Afaf
    Richier, Cedric
    Leguay, Jeremie
    Luu, Quang-Trung
    Magnouche, Youcef
    Martin, Sebastien
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (04): : 4268 - 4281