Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

被引:51
|
作者
Xiao, Yang [1 ]
Liu, Jun [1 ]
Wu, Jiawei [1 ]
Ansari, Nirwan [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Intelligent Percept & Comp Res Ctr, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
关键词
Wireless networks; Routing; Optimization; Reinforcement learning; Tutorials; Supervised learning; Wireless sensor networks; Deep reinforcement learning; traffic engineering; routing optimization; congestion control; resource management; TCP CONGESTION CONTROL; SPECTRUM ASSIGNMENT; RESOURCE-MANAGEMENT; WIRELESS NETWORKS; CELLULAR NETWORK; NEURAL-NETWORKS; EDGE; MULTIPATH; FRAMEWORK; ALGORITHM;
D O I
10.1109/COMST.2021.3102580
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
After decades of unprecedented development, modern networks have evolved far beyond expectations in terms of scale and complexity. In many cases, traditional traffic engineering (TE) approaches fail to address the quality of service (QoS) requirements of modern networks. In recent years, deep reinforcement learning (DRL) has proved to be a feasible and effective solution for autonomously controlling and managing complex systems. Massive growth in the use of DRL applications in various domains is beginning to benefit the communications industry. In this paper, we firstly provide a comprehensive overview of DRL-based TE. Then, we present a detailed literature review on applications of DRL for TE including three fundamental issues: routing optimization, congestion control, and resource management. Finally, we discuss our insights into the challenges and future research perspectives of DRL-based TE.
引用
收藏
页码:2064 / 2097
页数:34
相关论文
共 50 条
  • [21] RLTE: Reinforcement learning for Traffic-Engineering
    Einhorn, Erik
    Mitschele-Thiel, Andreas
    RESILIENT NETWORKS AND SERVICES, 2008, 5127 : 120 - 133
  • [22] Transfer Learning in Deep Reinforcement Learning: A Survey
    Zhu, Zhuangdi
    Lin, Kaixiang
    Jain, Anil K.
    Zhou, Jiayu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 13344 - 13362
  • [23] ScaleDRL: A Scalable Deep Reinforcement Learning Approach for Traffic Engineering in SDN with Pinning Control
    Sun, Penghao
    Guo, Zehua
    Lan, Julong
    Li, Junfei
    Hu, Yuxiang
    Baker, Thar
    COMPUTER NETWORKS, 2021, 190
  • [24] Traffic Engineering in a Shared Inter-DC WAN via Deep Reinforcement Learning
    Guo, Yingya
    Ma, Yulong
    Luo, Huan
    Wu, Jianping
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04): : 2870 - 2881
  • [25] EPC-TE: Explicit Path Control in Traffic Engineering with Deep Reinforcement Learning
    Luan, Zeyu
    Lu, Lie
    Li, Qing
    Jiang, Yong
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [26] Exploration in deep reinforcement learning: A survey
    Ladosz, Pawel
    Weng, Lilian
    Kim, Minwoo
    Oh, Hyondong
    INFORMATION FUSION, 2022, 85 : 1 - 22
  • [27] Deep Reinforcement Learning Verification: A Survey
    Landers, Matthew
    Doryab, Afsaneh
    ACM COMPUTING SURVEYS, 2023, 55 (14S)
  • [28] Deep Reinforcement Learning A brief survey
    Arulkumaran, Kai
    Deisenroth, Marc Peter
    Brundage, Miles
    Bharath, Anil Anthony
    IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) : 26 - 38
  • [29] Framework for Control and Deep Reinforcement Learning in Traffic
    Wu, Cathy
    Parvate, Kanaad
    Kheterpal, Nishant
    Dickstein, Leah
    Mehta, Ankur
    Vinitsky, Eugene
    Bayen, Alexandre M.
    2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
  • [30] Deep Reinforcement Learning for Traffic Light Optimization
    Coskun, Mustafa
    Baggag, Abdelkader
    Chawla, Sanjay
    2018 18TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2018, : 564 - 571