Forwarding efficiency aware traffic scheduling algorithm based on deep reinforcement learning

被引:0
|
作者
Sha, Zongxuan [1 ]
Huo, Ru [1 ,2 ]
Sun, Chuang [3 ]
Wang, Shuo [2 ,4 ]
Huang, Tao [2 ,4 ]
机构
[1] Information Department, Beijing University of Technology, Beijing,100124, China
[2] Purple Mountain Laboratories, Nanjing,211111, China
[3] Department of Automation, Tsinghua University, Beijing,100084, China
[4] State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing,100876, China
来源
关键词
Deep learning - Reinforcement learning - Scheduling - Scheduling algorithms - Software defined networking;
D O I
10.11959/j.issn.1000-436x.2022148
中图分类号
学科分类号
摘要
The software defined network separates the control plane from the data plane to achieve flexible traffic scheduling, which can use network resources more efficiently. However, with the increase of the number of flow entries, load rate, the number of connected hosts, and other factors, the forwarding efficiency of the SDN switch will be reduced, which will affect the end-to-end transmission delay. To solve the above problems, the forwarding efficiency aware traffic scheduling algorithm based on deep reinforcement learning was proposed. First, the switch state was integrated into the perception model, and the mapping relationship between switch state information and forwarding efficiency was established based on neural network. Then, combined with network state and traffic information, traffic scheduling policy was generated through deep reinforcement learning. Finally, the expert samples generated by the shortest path and load balance algorithms could guide the model training, which enabled the model to learn knowledge from expert samples to improve performance and accelerated the training process. The experimental results show that the proposed algorithm not only reduces the average end-to-end transmission delay by 15.31%, but also ensures the overall load balance of the network, compared with other algorithms. © 2022 Editorial Board of Journal on Communications. All rights reserved.
引用
收藏
页码:30 / 40
相关论文
共 50 条
  • [1] Delay-aware Cellular Traffic Scheduling with Deep Reinforcement Learning
    Zhang, Ticao
    Shen, Shuyi
    Mao, Shiwen
    Chang, Gee-Kung
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [2] DEEPCAS: A Deep Reinforcement Learning Algorithm for Control-Aware Scheduling
    Demirel, Burak
    Ramaswamy, Arunselvan
    Quevedo, Daniel E.
    Karl, Holger
    [J]. IEEE CONTROL SYSTEMS LETTERS, 2018, 2 (04): : 737 - 742
  • [3] Buffer-aware Wireless Scheduling based on Deep Reinforcement Learning
    Xu, Chen
    Wang, Jian
    Yu, Tianhang
    Kong, Chuili
    Huangfu, Yourui
    Li, Rong
    Ge, Yiqun
    Wang, Jun
    [J]. 2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,
  • [4] Deep Reinforcement Learning Based Multistage Profit Aware Task Scheduling Algorithm for Computing Power Network
    Huang, Xiaoyao
    Liu, Remington R.
    Lei, Bo
    Huang, Guanglun
    Zhang, Baoxian
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 3524 - 3529
  • [5] A Deep Reinforcement Learning-based Task Scheduling Algorithm for Energy Efficiency in Data Centers
    Song, Penglei
    Chi, Ce
    Ji, Kaixuan
    Liu, Zhiyong
    Zhang, Fa
    Zhang, Shikui
    Qiu, Dehui
    Wan, Xiaohua
    [J]. 30TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN 2021), 2021,
  • [6] Traffic scheduling, network slicing and virtualization based on deep reinforcement learning
    Kumar, Priyan Malarvizhi
    Basheer, Shakila
    Rawal, Bharat S.
    Afghah, Fatemeh
    Babu, Gokulnath Chandra
    Arunmozhi, Manimuthu
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2022, 100
  • [7] Automatic Network Traffic Scheduling Algorithm Based on Hierarchical Reinforcement Learning
    He, Huiling
    [J]. Informatica (Slovenia), 2024, 48 (22): : 163 - 178
  • [8] Socially-Aware Traffic Scheduling for Edge-Assisted Metaverse by Deep Reinforcement Learning
    Yu, Ao
    Yang, Hui
    Feng, Cuiyang
    Li, Yunbo
    Zhao, Yang
    Cheriet, Mohamed
    Vasilakos, Athanasios V.
    [J]. IEEE NETWORK, 2023, 37 (06): : 74 - 81
  • [9] Cellular Network Traffic Scheduling with Deep Reinforcement Learning
    Chinchali, Sandeep
    Hu, Pan
    Chu, Tianshu
    Sharma, Manu
    Bansal, Manu
    Misra, Rakesh
    Pavone, Marco
    Katti, Sachin
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 766 - 774
  • [10] Energy-aware scheduling for spark job based on deep reinforcement learning in cloud
    Hongjian Li
    Liang Lu
    Wenhu Shi
    Gangfan Tan
    Hao Luo
    [J]. Computing, 2023, 105 : 1717 - 1743