DQR: Deep Q-Routing in Software Defined Networks

被引:12
|
作者
Jalil, Syed Qaisar [1 ]
Rehmani, Mubashir Husain [2 ]
Chalup, Stephan [1 ]
机构
[1] Univ Newcastle, Sch Elect Engn & Comp, Callaghan, NSW, Australia
[2] Cork Inst Technol CIT, Dept Comp Sci, Cork, Ireland
关键词
Quality-of-service Routing; Deep-Q Learning; Software defined network; REINFORCEMENT; SDN; QOS;
D O I
10.1109/ijcnn48605.2020.9206767
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we investigate the task of quality of service (QoS) routing in software defined networks (SDN). We consider delay, bandwidth, loss, and cost as QoS parameters. We propose a new deep reinforcement learning solution for greedy online QoS routing in SDN and call it Deep Q-Routing (DQR). DQR utilises a dueling deep Q-network with prioritised experience replay to compute a path for any source-destination pair request in the presence of multiple QoS metrics. In contrast to existing DRL-based routing methods, the proposed DQR method regards the task of routing as a discrete control problem and uses a reward function comprising weighted QoS parameters. Our simulation results show that DQR substantially improves end-to-end throughput compared to other existing learning based methods.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Hierarchical Deep Double Q-Routing
    Ali, Ramy E.
    Erman, Bilgehan
    Bastug, Ejder
    Cilli, Bruce
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [2] DQR: An Efficient Deep Q-Based Routing Approach in Multi-Controller Software Defined WAN (SD-WAN)
    Majdoub, Manel
    El Kamel, Ali
    Youssef, Habib
    [J]. JOURNAL OF INTERCONNECTION NETWORKS, 2020, 20 (04)
  • [3] Latency filtering for Q-routing on wireless networks
    Bitaillou, Alexis
    Parrein, Benoit
    Andrieux, Guillaume
    Couty, Killian
    [J]. IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 1314 - 1319
  • [4] Ant routing vs. Q-routing in telecommunication networks
    Pacut, Andrzej
    Gadomska, Malgorzata
    Igielski, Andrzej
    [J]. 20TH EUROPEAN CONFERENCE ON MODELLING AND SIMULATION ECMS 2006: MODELLING METHODOLOGIES AND SIMULATION: KEY TECHNOLOGIES IN ACADEMIA AND INDUSTRY, 2006, : 67 - +
  • [5] Efficacious implementation of deep Q-routing in opportunistic network
    Renu Dalal
    Manju Khari
    [J]. Soft Computing, 2023, 27 : 9459 - 9477
  • [6] Efficacious implementation of deep Q-routing in opportunistic network
    Dalal, Renu
    Khari, Manju
    [J]. SOFT COMPUTING, 2023, 27 (14) : 9459 - 9477
  • [7] Deep Q-Network and Traffic Prediction based Routing Optimization in Software Defined Networks
    Bouzidi, El Hocine
    Outtagarts, Abdelkader
    Langar, Rami
    Boutaba, Raouf
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2021, 192
  • [8] Residual Energy Maximization in Cognitive Radio Networks With Q-Routing
    Paul, Anal
    Banerjee, Avik
    Maity, Santi P.
    [J]. IEEE SYSTEMS JOURNAL, 2020, 14 (03): : 3791 - 3800
  • [9] Anycast Q-routing in Wireless Sensor Networks for Healthcare Monitoring
    Khianjoom, Siwatchaya
    Usaha, Wipawee
    [J]. 2014 11TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2014,
  • [10] Q-routing: From the Algorithm to the Routing Protocol
    Bitaillou, Alexis
    Parrein, Benoit
    Andrieux, Guillaume
    [J]. MACHINE LEARNING FOR NETWORKING (MLN 2019), 2020, 12081 : 58 - 69