Algorithm of Mixed Traffic Scheduling Among Data Centers Based on Prediction

被引:0
|
作者
Wang R. [1 ,2 ]
Zhang Y. [1 ]
Wang W. [1 ,2 ]
Xu K. [3 ]
Cui L. [4 ]
机构
[1] School of Computer Science, National Pilot Software Engineering School, Beijing University of Posts and Telecommunications, Beijing
[2] State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing
[3] Department of Computer Science and Technology, Tsinghua University, Beijing
[4] College of Computer Science and Software Engineering, Shenzhen University, Shenzhen
基金
中国国家自然科学基金;
关键词
Data center; Exponentially weighted moving average (EWMA); Prediction algorithm; Scheduling; Traffic engineering (TE);
D O I
10.7544/issn1000-1239.2021.20201087
中图分类号
学科分类号
摘要
To handle the problem of low link utilization resulting from mixing online and offline traffic in one data center transmission network and separating them with a fix way in the same link, we propose a solution of offline traffic scheduling based on online traffic prediction. It firstly predicts online traffic needed to be guaranteed preferentially in link using an algorithm calling Sliding-k that combines EWMA and Bayesian changepoint detection algorithm. This customized algorithm can make prediction sensitive to a sudden change of network environment and reduce unnecessary re-adjustments when network environment is steady at the same time. Therefore, it can exactly meet the prediction demand under different network environments. After computing the remaining space for offline traffic according to online traffic prediction result and implementing dynamic bandwidth allocation, it uses an algorithm called SEDF that can consider both traffic deadline and size to schedule offline traffic. Experimental results reflect that Sliding-k can meet the prediction needs both when network mutation occurs and when network has no change and can simultaneously improve the accuracy of traditional EWMA algorithm. The combination of Sliding-k and SEDF can improve the utilization of data center links, so as to make full use of link resources. © 2021, Science Press. All right reserved.
引用
收藏
页码:1307 / 1317
页数:10
相关论文
共 21 条
  • [1] Kandula S, Menache I, Schwartz R, Et al., Calendaring for wide area networks, Proc of the 2014 ACM Conf on SIGCOMM, pp. 515-526, (2014)
  • [2] Hong Chiyao, Kandula S, Mahajan R, Et al., Achieving high utilization with software-driven WAN, Proc of the 2013 ACM Conf on SIGCOMM, pp. 15-26, (2013)
  • [3] Zhang Yuchao, Nie Xiaohui, Jiang Junchen, Et al., BDS+: An inter-datacenter data replication system with dynamic bandwidth separation, IEEE/ACM Transactions on Networking, PP, 99, pp. 1-17, (2021)
  • [4] Lin Xiao, Ji Shuo, Yue Shengnan, Et al., Node-constraint store-and-forward scheduling method for inter-datacenter networks, Journal of Computer Research and Development, 58, 2, pp. 319-337, (2021)
  • [5] Zhang Yuchao, Tian Ye, Wang Wendong, Et al., Federated routing scheme for large-scale cross domain network, Proc of IEEE INFOCOM 2020-IEEE Conf on Computer Communications Workshops (INFOCOM WKSHPS), pp. 1358-1359, (2020)
  • [6] Zhang Yuchao, Xu Ke, Wang Haiyang, Et al., Going fast and fair: Latency optimization for cloud-based service chains, IEEE Network, 32, 2, pp. 138-143, (2017)
  • [7] Jiang Jingjie, Ma Shiyao, Li Bo, Et al., Adia: Achieving high link utilization with coflow-aware scheduling in data center networks, IEEE Transactions on Cloud Computing, 7, 2, pp. 431-441, (2016)
  • [8] Jain S, Kumar A, Mandal S, Et al., B4: Experience with a globally-deployed software defined WAN, Proc of the 2013 ACM Conf on SIGCOMM, pp. 3-14, (2013)
  • [9] Hong Chiyao, Mandal S, Al-Fares M, Et al., B4 and after: Managing hierarchy, partitioning, and asymmetry for availability and scale in Google's software-defined WAN, Proc of the 2018 Conf of the ACM Special Interest Group on Data Communication, pp. 74-87, (2018)
  • [10] Kumar A, Jain S, Naik U, Et al., BwE: Flexible, hierarchical bandwidth allocation for WAN distributed computing, ACM SIGCOMM Computer Communication Review, 45, 4, pp. 1-14, (2015)