Intelligent O-RAN Traffic Steering for URLLC Through Deep Reinforcement Learning

被引:1
|
作者
Tamim, Ibrahim [1 ]
Aleyadeh, Sam [1 ]
Shami, Abdallah [1 ]
机构
[1] Western Univ, Elect & Comp Engn Dept, London, ON, Canada
关键词
5G; O-RAN; URLLC; NBC; Deep Learning; Reinforcement Learning;
D O I
10.1109/ICC45041.2023.10278981
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
The goal of Next-Generation Networks is to improve upon the current networking paradigm, especially in providing higher data rates, near-real-time latencies, and near-perfect quality of service. However, existing radio access network (RAN) architectures lack sufficient flexibility and intelligence to meet those demands. Open RAN (O-RAN) is a promising paradigm for building a virtualized and intelligent RAN architecture. This paper presents a Machine Learning (ML)-based Traffic Steering (TS) scheme to predict network congestion and then proactively steer O-RAN traffic to avoid it and reduce the expected queuing delay. To achieve this, we propose an optimized setup focusing on safeguarding both latency and reliability to serve URLLC applications. The proposed solution consists of a two-tiered ML strategy based on Naive Bayes Classifier and deep Qlearning. Our solution is evaluated against traditional reactive TS approaches that are offered as xApps in O-RAN and shows an average of 15.81 percent decrease in queuing delay across all deployed SFCs.
引用
收藏
页码:112 / 118
页数:7
相关论文
共 50 条
  • [21] Policy-Gradient-Based Reinforcement Learning for Computing Resources Allocation in O-RAN
    Sharara, Mahdi
    Pamuklu, Turgay
    Hoteit, Sahar
    Veque, Veronique
    Erol-Kantarci, Melike
    [J]. PROCEEDINGS OF THE 2022 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD NETWORKING (IEEE CLOUDNET 2022), 2022, : 229 - 236
  • [22] Hierarchical Meta-Reinforcement Learning for Resource-Efficient Slicing in O-RAN
    Chen, Xianfu
    Wu, Celimuge
    Zhao, Zhifeng
    Xiao, Yong
    Mao, Shiwen
    Ji, Yusheng
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2729 - 2735
  • [23] Deep Reinforcement Learning for URLLC data management on top of scheduled eMBB traffic
    Saggese, Fabio
    Pasqualini, Luca
    Moretti, Marco
    Abrardo, Andrea
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [24] Toward Modular and Flexible Open RAN Implementations in 6G Networks: Traffic Steering Use Case and O-RAN xApps
    Dryjanski, Marcin
    Kulacz, Lukasz
    Kliks, Adrian
    [J]. SENSORS, 2021, 21 (24)
  • [25] Reinforcement Learning-Based Grant-Free Mode Selection for O-RAN Systems
    Hsu, Hao-Wei
    Lin, Yen-Chen
    Huang, Chih-Wei
    Lin, Phone
    Yang, Shun-Ren
    [J]. 2023 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2023, : 1002 - 1007
  • [26] An Edge Intelligent Framework for O-RAN based IoV Networks
    Huang, Yu-Kai
    Pang, Ai-Chun
    Wu, Jen-Ming
    [J]. 2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [27] Connection Management xAPP for O-RAN RIC: A Graph Neural Network and Reinforcement Learning Approach
    Orhan, Oner
    Swamy, Vasuki Narasimha
    Tetzlaff, Thomas
    Nassar, Marcel
    Nikopour, Hosein
    Talwar, Shilpa
    [J]. 20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 936 - 941
  • [28] OpenAI dApp: An Open AI Platform for Distributed Federated Reinforcement Learning Apps in O-RAN
    Kouchaki, Mohammadreza
    Abdalla, Aly Sabri
    Marojevic, Vuk
    [J]. 2023 IEEE FUTURE NETWORKS WORLD FORUM, FNWF, 2024,
  • [29] O-RAN with Machine Learning in ns-3
    Garey, Wesley
    Ropitault, Tanguy
    Rouil, Richard
    Black, Evan
    Gao, Weichao
    [J]. PROCEEDINGS OF THE 2023 WORKSHOP ON NS-3, WNS3 2023, 2023, : 60 - 68
  • [30] Recent Advances in Machine Learning for Network Automation in the O-RAN
    Hamdan, Mutasem Q.
    Lee, Haeyoung
    Triantafyllopoulou, Dionysia
    Borralho, Ruben
    Kose, Abdulkadir
    Amiri, Esmaeil
    Mulvey, David
    Yu, Wenjuan
    Zitouni, Rafik
    Pozza, Riccardo
    Hunt, Bernie
    Bagheri, Hamidreza
    Foh, Chuan Heng
    Heliot, Fabien
    Chen, Gaojie
    Xiao, Pei
    Wang, Ning
    Tafazolli, Rahim
    [J]. SENSORS, 2023, 23 (21)