Real-Time Data Transmission Optimization on 5G Remote-Controlled Units Using Deep Reinforcement Learning

被引:0
|
作者
Smirnov, Nikita [1 ]
Tomforde, Sven [1 ]
机构
[1] Univ Kiel, Christian Albrechts Pl 4, D-24118 Kiel, Germany
关键词
deep reinforcement learning; data transmission; adaptive bitrate streaming; 5G networks; remote-controlled unit; organic computing;
D O I
10.1007/978-3-031-42785-5_19
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increasing demand for real-time data transmission for the remote-controlled units and the complexity of 5G networks pose significant challenges to achieving optimal performance in device-based scenarios, when the 5G network cannot be controlled by its users. This paper proposes a model-free Deep Reinforcement Learning approach for this task. The model learns an optimal policy for maximizing the data transmission rate while minimizing the latency and packet loss. Such an approach aims to investigate the applicability of the environment-agnostic agents driven purely by the transmission statistics of the acknowledged packets. The evaluation is done with the help of a 5G simulation based on the OMNeT++ network simulator and the obtained results are compared to a classic throughput-based adaptive bitrate streaming approach. Multiple questions and challenges that arose on the way to the final model and evaluation procedure are highlighted in detail. The resulting findings demonstrate the effectiveness of Deep Reinforcement Learning for optimizing real-time data transmission in 5G networks in an online manner.
引用
下载
收藏
页码:281 / 295
页数:15
相关论文
共 50 条
  • [1] Real-Time Resource Slicing for 5G RAN via Deep Reinforcement Learning
    Xi, Ranran
    Chen, Xin
    Chen, Ying
    Li, Zhuo
    2019 IEEE 25TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2019, : 625 - 632
  • [2] Real-time optimization using reinforcement learning
    Powell, By Kody M.
    Machalek, Derek
    Quah, Titus
    COMPUTERS & CHEMICAL ENGINEERING, 2020, 143 (143)
  • [3] On cross-layer optimization for real-time remote communication in 5G and beyond
    Dimitrovski, Toni
    Alexiou, Evangelos
    D'Acunto, Lucia
    Bergman, Tim
    Hindriks, Rick
    Turkovic, Belma
    PROCEEDINGS OF THE 27TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS, ICIN, 2024, : 37 - 41
  • [4] Real-time rate control of WebRTC video streams in 5G networks: Improving quality of experience with Deep Reinforcement Learning
    Smirnov, Nikita
    Tomforde, Sven
    JOURNAL OF SYSTEMS ARCHITECTURE, 2024, 148
  • [5] Deep Reinforcement Learning-Based Dynamic Scheduling for Real-Time Applications in LTE and RAN Slicing for eMBB in 5G
    Eddine Benmadani, Houssem
    Azni, Mohamed
    Essa Alharbi, Turki
    Alzaidi, Mohammed S.
    Tounsi, Mohamed
    IEEE Access, 2025, 13 : 33555 - 33570
  • [6] Deep Reinforcement Learning for Real-Time Optimization of Pumps in Water Distribution Systems
    Hajgato, Gergely
    Paal, Gyorgy
    Gyires-Toth, Balint
    JOURNAL OF WATER RESOURCES PLANNING AND MANAGEMENT, 2020, 146 (11)
  • [7] ENERO: Efficient real-time WAN routing optimization with Deep Reinforcement Learning
    Almasan, Paul
    Xiao, Shihan
    Cheng, Xiangle
    Shi, Xiang
    Barlet-Ros, Pere
    Cabellos-Aparicio, Albert
    COMPUTER NETWORKS, 2022, 214
  • [8] Towards Real-Time Routing Optimization with Deep Reinforcement Learning: Open Challenges
    Almasan, Paul
    Suarez-Varela, Jose
    Wu, Bo
    Xiao, Shihan
    Barlet-Ros, Pere
    Cabellos-Aparicio, Albert
    2021 IEEE 22ND INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE SWITCHING AND ROUTING (IEEE HPSR), 2021,
  • [9] ENERO: Efficient real-time WAN routing optimization with Deep Reinforcement Learning
    Almasan, Paul
    Xiao, Shihan
    Cheng, Xiangle
    Shi, Xiang
    Barlet-Ros, Pere
    Cabellos-Aparicio, Albert
    Computer Networks, 2022, 214
  • [10] Real-time security margin control using deep reinforcement learning
    Hagmar, Hannes
    Eriksson, Robert
    Tuan, Le Anh
    ENERGY AND AI, 2023, 13