QoS Routing Optimization Based on Deep Reinforcement Learning in SDN

被引:0
|
作者
Song, Yu [1 ]
Qian, Xusheng [2 ]
Zhang, Nan [3 ]
Wang, Wei [2 ]
Xiong, Ao [1 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[2] State Grid Jiangsu Elect Power Co Ltd, Mkt Serv Ctr, Nanjing 220000, Peoples R China
[3] State Grid Co Ltd, Customer Serv Ctr, Nanjing 211161, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 79卷 / 02期
关键词
Deep reinforcement learning; SDN; route optimization; QoS; SOFTWARE-DEFINED NETWORKING;
D O I
10.32604/cmc.2024.051217
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To enhance the efficiency and expediency of issuing e-licenses within the power sector, we must confront the challenge of managing the surging demand for data traffic. Within this realm, the network imposes stringent Quality of Service (QoS) requirements, revealing the inadequacies of traditional routing allocation mechanisms in accommodating such extensive data flows. In response to the imperative of handling a substantial influx of data requests promptly and alleviating the constraints of existing technologies and network congestion, we present an architecture for QoS routing optimization with in Software Defined Network (SDN), leveraging deep reinforcement learning. This innovative approach entails the separation of SDN control and transmission functionalities, centralizing control over data forwarding while integrating deep reinforcement learning for informed routing decisions. By factoring in considerations such as delay, bandwidth, jitter rate, and packet loss rate, we design a reward function to guide the Deep Deterministic Policy Gradient (DDPG) algorithm in learning the optimal routing strategy to furnish superior QoS provision. In our empirical investigations, we juxtapose the performance of Deep Reinforcement Learning (DRL) against that of Shortest Path (SP) algorithms in terms of data packet transmission delay. The experimental simulation results show that our proposed algorithm has significant efficacy in reducing network delay and improving the overall transmission efficiency, which is superior to the traditional methods.
引用
收藏
页码:3007 / 3021
页数:15
相关论文
共 50 条
  • [41] Research of QoS Routing Algorithm in Ad Hoc Networks based on Reinforcement Learning
    Fu, Yuchen
    Liu, Quan
    [J]. ELEKTRONIKA IR ELEKTROTECHNIKA, 2013, 19 (02) : 83 - 87
  • [42] An adaptive intelligent routing algorithm based on deep reinforcement learning
    Bai, Jie
    Sun, Jingchuan
    Wang, Zhigang
    Zhao, Xunwei
    Wen, Aijun
    Zhang, Chunling
    Zhang, Jianguo
    [J]. COMPUTER COMMUNICATIONS, 2024, 216 : 195 - 208
  • [43] Routing Based On Deep Reinforcement Learning In Optical Transport Networks
    Suarez-Varela, Jose
    Mestres, Albert
    Yu, Junlin
    Kuang, Li
    Feng, Haoyu
    Barlet-Ros, Pere
    Cabellos-Aparicio, Albert
    [J]. 2019 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION (OFC), 2019,
  • [44] DQR: A Deep Reinforcement Learning-based QoS Routing Protocol in Cognitive Radio Mobile Ad Hoc Networks
    Thong Nhat Tran
    Toan-Van Nguyen
    Shim, Kyusung
    An, Beongku
    [J]. 2021 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2021,
  • [45] REDO: A Reinforcement Learning-based Dynamic Routing Algorithm Selection Method for SDN
    Al-Jawad, Ahmed
    Comsa, Ioan-Sorin
    Shah, Purav
    Gemikonakli, Orhan
    Trestian, Ramona
    [J]. 2021 IEEE CONFERENCE ON NETWORK FUNCTION VIRTUALIZATION AND SOFTWARE DEFINED NETWORKS (IEEE NFV-SDN), 2021, : 54 - 59
  • [46] A global multipath load-balanced routing algorithm based on Reinforcement Learning in SDN
    Truong Thu Huong
    Ngo Do Dang Khoa
    Nguyen Xuan Dung
    Nguyen Huu Thanh
    [J]. 2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC): ICT CONVERGENCE LEADING THE AUTONOMOUS FUTURE, 2019, : 1336 - 1341
  • [47] Reinforcement Learning-Based Service-Oriented Dynamic Multipath Routing in SDN
    Chiu, Kai-Cheng
    Liu, Chien-Chang
    Chou, Li-Der
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [48] Reinforcement learning-based SDN routing scheme empowered by causality detection and GNN
    He, Yuanhao
    Xiao, Geyang
    Zhu, Jun
    Zou, Tao
    Liang, Yuan
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2024, 18
  • [49] A Cloud QoS-driven Scheduler based on Deep Reinforcement Learning
    Minh-Ngoc Tran
    Kim, Younghan
    [J]. 12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 1823 - 1825
  • [50] Reinforcement Learning based Interconnection Routing for Adaptive Traffic Optimization
    Kao, Sheng-Chun
    Yang, Chao-Han Huck
    Chen, Pin-Yu
    Ma, Xiaoli
    Krishna, Tushar
    [J]. PROCEEDINGS OF THE 13TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON NETWORKS-ON-CHIP (NOCS'19), 2019,