Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

被引:51
|
作者
Xiao, Yang [1 ]
Liu, Jun [1 ]
Wu, Jiawei [1 ]
Ansari, Nirwan [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Intelligent Percept & Comp Res Ctr, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
关键词
Wireless networks; Routing; Optimization; Reinforcement learning; Tutorials; Supervised learning; Wireless sensor networks; Deep reinforcement learning; traffic engineering; routing optimization; congestion control; resource management; TCP CONGESTION CONTROL; SPECTRUM ASSIGNMENT; RESOURCE-MANAGEMENT; WIRELESS NETWORKS; CELLULAR NETWORK; NEURAL-NETWORKS; EDGE; MULTIPATH; FRAMEWORK; ALGORITHM;
D O I
10.1109/COMST.2021.3102580
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
After decades of unprecedented development, modern networks have evolved far beyond expectations in terms of scale and complexity. In many cases, traditional traffic engineering (TE) approaches fail to address the quality of service (QoS) requirements of modern networks. In recent years, deep reinforcement learning (DRL) has proved to be a feasible and effective solution for autonomously controlling and managing complex systems. Massive growth in the use of DRL applications in various domains is beginning to benefit the communications industry. In this paper, we firstly provide a comprehensive overview of DRL-based TE. Then, we present a detailed literature review on applications of DRL for TE including three fundamental issues: routing optimization, congestion control, and resource management. Finally, we discuss our insights into the challenges and future research perspectives of DRL-based TE.
引用
收藏
页码:2064 / 2097
页数:34
相关论文
共 50 条
  • [31] TITE: A transformer-based deep reinforcement learning approach for traffic engineering in hybrid SDN with dynamic traffic
    Lin, Bin
    Guo, Yingya
    Luo, Huan
    Ding, Mingjie
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 161 : 95 - 105
  • [32] Leveraging Domain Knowledge for Robust Deep Reinforcement Learning in Networking
    Zheng, Ying
    Chen, Haoyu
    Duan, Qingyang
    Lin, Lixiang
    Shao, Yiyang
    Wang, Wei
    Wang, Xin
    Xu, Yuedong
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
  • [33] Intuitionistic Fuzzy MADM in Wargame Leveraging With Deep Reinforcement Learning
    Sun, Yuxiang
    Li, Yuanbai
    Li, Huaxiong
    Liu, Jiubing
    Zhou, Xianzhong
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (09) : 5033 - 5045
  • [34] GreenTE.ai: Power-Aware Traffic Engineering via Deep Reinforcement Learning
    Pan, Tian
    Peng, Xiaoyu
    Shi, Qianqian
    Bian, Zizheng
    Lin, Xingchen
    Song, Enge
    Li, Fuliang
    Xu, Yang
    Huang, Tao
    2021 IEEE/ACM 29TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2021,
  • [35] Power-Aware Traffic Engineering for Data Center Networks via Deep Reinforcement Learning
    Gao, Minglan
    Pan, Tian
    Song, Enge
    Yang, Mengqi
    Huang, Tao
    Liu, Yunjie
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 6055 - 6060
  • [36] Ship Network Traffic Engineering Based on Reinforcement Learning
    Yang, Xinduoji
    Liu, Minghui
    Wang, Xinxin
    Hu, Bingyu
    Liu, Meng
    Wang, Xiaomin
    ELECTRONICS, 2024, 13 (09)
  • [37] Automated Traffic Engineering in SDWAN: Beyond Reinforcement Learning
    Liu, Libin
    Chen, Li
    Xu, Hong
    Shao, Hua
    IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2020, : 430 - 435
  • [38] Automatic Feature Engineering by Deep Reinforcement Learning
    Zhang, Jianyu
    Hao, Jianye
    Fogelman-Soulie, Francoise
    Wang, Zan
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 2312 - 2314
  • [39] Deep Reinforcement Learning for Quantum Hamiltonian Engineering
    Peng, Pai
    Huang, Xiaoyang
    Yin, Chao
    Joseph, Linta
    Ramanathan, Chandrasekhar
    Cappellaro, Paola
    PHYSICAL REVIEW APPLIED, 2022, 18 (02)
  • [40] Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey
    Frikha, Mohamed Said
    Gammar, Sonia Mettali
    Lahmadi, Abdelkader
    Andrey, Laurent
    COMPUTER COMMUNICATIONS, 2021, 178 : 98 - 113