Constrained Deep Reinforcement Learning for Fronthaul Compression Optimization

被引:0
|
作者
Gronland, Axel [1 ,2 ]
Russo, Alessio [1 ]
Jedra, Yassir [1 ]
Klaiqi, Bleron [2 ]
Gelabert, Xavier [2 ]
机构
[1] Royal Inst Technol KTH, Stockholm, Sweden
[2] Stockholm Res Ctr, Huawei Technol Sweden AB, Stockholm, Sweden
关键词
C-RAN; fronthaul; machine learning; reinforcement learning; performance evaluation;
D O I
10.1109/ICMLCN59089.2024.10624764
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the Centralized-Radio Access Network (C-RAN) architecture, functions can be placed in the central or distributed locations. This architecture can offer higher capacity and cost savings but also puts strict requirements on the fronthaul (FH), these constraints can be any number of constraints but in this work we consider a constraint on packet loss and latency. Adaptive FH compression schemes that adapt the compression amount to varying FH traffic are promising approaches to deal with stringent FH requirements. In this work, we design such a compression scheme using a model-free off policy deep reinforcement learning algorithm which accounts for FH latency and packet loss constraints. Furthermore, this algorithm is designed for model transparency and interpretability which is crucial for AI trustworthiness in performance critical domains. We show that our algorithm can successfully choose an appropriate compression scheme while satisfying the constraints and exhibits a roughly 70% increase in FH utilization compared to a reference scheme.
引用
收藏
页码:498 / 504
页数:7
相关论文
共 50 条
  • [31] Deep reinforcement learning assisted novelty search in Voronoi regions for constrained multi-objective optimization
    Yang, Yufei
    Zhang, Changsheng
    Liu, Yi
    Ning, Jiaxu
    Guo, Ying
    SWARM AND EVOLUTIONARY COMPUTATION, 2024, 91
  • [32] Chance-Constrained Control With Lexicographic Deep Reinforcement Learning
    Giuseppi, Alessandro
    Pietrabissa, Antonio
    IEEE CONTROL SYSTEMS LETTERS, 2020, 4 (03): : 755 - 760
  • [33] Ship Collision Avoidance Using Constrained Deep Reinforcement Learning
    Zhang, Rui
    Wang, Xiao
    Liu, Kezhong
    Wu, Xiaolie
    Lu, Tianyou
    Chao Zhaohui
    2018 5TH INTERNATIONAL CONFERENCE ON BEHAVIORAL, ECONOMIC, AND SOCIO-CULTURAL COMPUTING (BESC), 2018, : 115 - 120
  • [34] Constrained model-free reinforcement learning for process optimization
    Pan, Elton
    Petsagkourakis, Panagiotis
    Mowbray, Max
    Zhang, Dongda
    del Rio-Chanona, Ehecatl Antonio
    COMPUTERS & CHEMICAL ENGINEERING, 2021, 154
  • [35] Scan Chain Clustering and Optimization with Constrained Clustering and Reinforcement Learning
    Abdul, Naiju Karim
    Antony, George
    Rao, Rahul M.
    Skariah, Suriya T.
    MLCAD '22: PROCEEDINGS OF THE 2022 ACM/IEEE 4TH WORKSHOP ON MACHINE LEARNING FOR CAD (MLCAD), 2022, : 83 - 89
  • [36] CVaR-Constrained Policy Optimization for Safe Reinforcement Learning
    Zhang, Qiyuan
    Leng, Shu
    Ma, Xiaoteng
    Liu, Qihan
    Wang, Xueqian
    Liang, Bin
    Liu, Yu
    Yang, Jun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 830 - 841
  • [37] Gradient-Adaptive Pareto Optimization for Constrained Reinforcement Learning
    Zhou, Zixian
    Huang, Mengda
    Pan, Feiyang
    He, Jia
    Ao, Xiang
    Tu, Dandan
    He, Qing
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 11443 - 11451
  • [38] Constrained-Space Optimization and Reinforcement Learning for Complex Tasks
    Tsai, Ya-Yen
    Xiao, Bo
    Johns, Edward
    Yang, Guang-Zhong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 683 - 690
  • [39] Trajectory Optimization for Unknown Constrained Systems using Reinforcement Learning
    Ota, Kei
    Jha, Devesh K.
    Oiki, Tomoaki
    Miura, Mamoru
    Nammoto, Takashi
    Nikovski, Daniel
    Mariyama, Toshisada
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 3487 - 3494
  • [40] Deep Reinforcement Learning for Exact Combinatorial Optimization: Learning to Branch
    Zhang, Tianyu
    Banitalebi-Dehkordi, Amin
    Zhang, Yong
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3105 - 3111