Load Balancing for Communication Networks via Data-Efficient Deep Reinforcement Learning

被引:0
|
作者
Wu, Di [1 ]
Kang, Jikun [1 ]
Xu, Yi Tian [1 ]
Li, Hang [1 ]
Li, Jimmy [1 ]
Chen, Xi [1 ]
Rivkin, Dmitriy [1 ]
Jenkin, Michael [1 ]
Lee, Taeseop [2 ]
Park, Intaik [2 ]
Liu, Xue [1 ]
Dudek, Gregory [1 ]
机构
[1] Samsung Elect, Mississauga, ON, Canada
[2] Samsung Elect, Seoul, South Korea
关键词
load balancing; reinforcement learning; transfer learning;
D O I
10.1109/GLOBECOM46510.2021.9685294
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Within a cellular network, load balancing between different cells is of critical importance to network performance and quality of service. Most existing load balancing algorithms are manually designed and tuned rule-based methods where near-optimality is almost impossible to achieve. These rule-based methods are difficult to adapt quickly to traffic changes in real-world environments. Given the success of Reinforcement Learning (RL) algorithms in many application domains, there have been a number of efforts to tackle load balancing for communication systems using RL-based methods. To our knowledge, none of these efforts have addressed the need for data efficiency within the RL framework, which is one of the main obstacles in applying RL to wireless network load balancing. In this paper, we formulate the communication load balancing problem as a Markov Decision Process and propose a data-efficient transfer deep reinforcement learning algorithm to address it. Experimental results show that the proposed method can significantly improve the system performance over other baselines and is more robust to environmental changes.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Communication Load Balancing via Efficient Inverse Reinforcement Learning
    Konar, Abhisek
    Wu, Di
    Xu, Yi Tian
    Jang, Seowoo
    Liu, Steve
    Dudek, Gregory
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 472 - 478
  • [2] Learning to Adapt: Communication Load Balancing via Adaptive Deep Reinforcement Learning
    Wu, Di
    Xu, Yi Tian
    Li, Jimmy
    Jenkin, Michael
    Hossain, Ekram
    Jang, Seowoo
    Xin, Yan
    Zhang, Charlie
    Liu, Xue
    Dudek, Gregory
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2973 - 2978
  • [3] A Data-Efficient Training Method for Deep Reinforcement Learning
    Feng, Wenhui
    Han, Chongzhao
    Lian, Feng
    Liu, Xia
    [J]. ELECTRONICS, 2022, 11 (24)
  • [4] Data-Efficient Deep Reinforcement Learning with Symmetric Consistency
    Zhang, Xianchao
    Yang, Wentao
    Zhang, Xiaotong
    Liu, Han
    Wang, Guanglu
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2430 - 2436
  • [5] DATA-EFFICIENT DEEP REINFORCEMENT LEARNING WITH CONVOLUTION-BASED STATE ENCODER NETWORKS
    Fang, Qiang
    Xu, Xin
    Lan, Yixin
    Zhang, Yichuan
    Zeng, Yujun
    Tang, Tao
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2021, 36
  • [6] Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control
    Frauenknecht, Bernd
    Ehlgen, Tobias
    Trimpe, Sebastian
    [J]. 2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 894 - 901
  • [7] A Data-Efficient Method of Deep Reinforcement Learning for Chinese Chess
    Xu, Changming
    Ding, Hengfeng
    Zhang, Xuejian
    Wang, Cong
    Yang, Hongji
    [J]. 2022 IEEE 22ND INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY, AND SECURITY COMPANION, QRS-C, 2022, : 687 - 693
  • [8] Ensemble and Auxiliary Tasks for Data-Efficient Deep Reinforcement Learning
    Maulana, Muhammad Rizki
    Lee, Wee Sun
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, 2021, 12975 : 122 - 138
  • [9] Data-Efficient Hierarchical Reinforcement Learning
    Nachum, Ofir
    Gu, Shixiang
    Lee, Honglak
    Levine, Sergey
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [10] DeepRLB: A deep reinforcement learning-based load balancing in data center networks
    Rikhtegar, Negar
    Bushehrian, Omid
    Keshtgari, Manijeh
    [J]. INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2021, 34 (15)