Constrained Deep Reinforcement Learning for Fronthaul Compression Optimization

被引:0
|
作者
Gronland, Axel [1 ,2 ]
Russo, Alessio [1 ]
Jedra, Yassir [1 ]
Klaiqi, Bleron [2 ]
Gelabert, Xavier [2 ]
机构
[1] Royal Inst Technol KTH, Stockholm, Sweden
[2] Stockholm Res Ctr, Huawei Technol Sweden AB, Stockholm, Sweden
关键词
C-RAN; fronthaul; machine learning; reinforcement learning; performance evaluation;
D O I
10.1109/ICMLCN59089.2024.10624764
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the Centralized-Radio Access Network (C-RAN) architecture, functions can be placed in the central or distributed locations. This architecture can offer higher capacity and cost savings but also puts strict requirements on the fronthaul (FH), these constraints can be any number of constraints but in this work we consider a constraint on packet loss and latency. Adaptive FH compression schemes that adapt the compression amount to varying FH traffic are promising approaches to deal with stringent FH requirements. In this work, we design such a compression scheme using a model-free off policy deep reinforcement learning algorithm which accounts for FH latency and packet loss constraints. Furthermore, this algorithm is designed for model transparency and interpretability which is crucial for AI trustworthiness in performance critical domains. We show that our algorithm can successfully choose an appropriate compression scheme while satisfying the constraints and exhibits a roughly 70% increase in FH utilization compared to a reference scheme.
引用
收藏
页码:498 / 504
页数:7
相关论文
共 50 条
  • [1] Learning-Based Latency-Constrained Fronthaul Compression Optimization in C-RAN
    Gronland, Axel
    Klaiqi, Bleron
    Gelabert, Xavier
    2023 IEEE 28TH INTERNATIONAL WORKSHOP ON COMPUTER AIDED MODELING AND DESIGN OF COMMUNICATION LINKS AND NETWORKS, CAMAD 2023, 2023, : 134 - 139
  • [2] OptLayer - Practical Constrained Optimization for Deep Reinforcement Learning in the Real World
    Tu-Hoa Pham
    De Magistris, Giovanni
    Tachibana, Ryuki
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 6236 - 6243
  • [3] Deep Reinforcement Learning Applied to Congestion Control in Fronthaul Networks
    Nascimento, Ingrid
    Souza, Ricardo
    Lins, Silvia
    Silva, Andrey
    Klautau, Aldebaro
    2019 IEEE LATIN-AMERICAN CONFERENCE ON COMMUNICATIONS (IEEE LATINCOM), 2019,
  • [4] DECORE: Deep Compression with Reinforcement Learning
    Alwani, Manoj
    Wang, Yang
    Madhavan, Vashisht
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12339 - 12349
  • [5] Deep reinforcement learning-guided coevolutionary algorithm for constrained multiobjective optimization
    Luo, Wenguan
    Yu, Xiaobing
    Yen, Gary G.
    Wei, Yifan
    Information Sciences, 2025, 692
  • [6] On Sampling Efficiency Optimization in Constrained Reinforcement Learning
    Jia, Qing-Shan
    2024 IEEE INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, AIM 2024, 2024, : 966 - 971
  • [7] Deep reinforcement learning assisted co-evolutionary differential evolution for constrained optimization
    Hu, Zhenzhen
    Gong, Wenyin
    Pedrycz, Witold
    Li, Yanchi
    SWARM AND EVOLUTIONARY COMPUTATION, 2023, 83
  • [8] Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection
    Fei Ming
    Wenyin Gong
    Ling Wang
    Yaochu Jin
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (04) : 919 - 959
  • [9] Deep reinforcement learning-based framework for constrained any-objective optimization
    Honari H.
    Khodaygan S.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (07) : 9575 - 9591
  • [10] Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection
    Ming, Fei
    Gong, Wenyin
    Wang, Ling
    Jin, Yaochu
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (04) : 919 - 931