Real-Time Data Transmission Optimization on 5G Remote-Controlled Units Using Deep Reinforcement Learning

被引:0
|
作者
Smirnov, Nikita [1 ]
Tomforde, Sven [1 ]
机构
[1] Univ Kiel, Christian Albrechts Pl 4, D-24118 Kiel, Germany
关键词
deep reinforcement learning; data transmission; adaptive bitrate streaming; 5G networks; remote-controlled unit; organic computing;
D O I
10.1007/978-3-031-42785-5_19
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increasing demand for real-time data transmission for the remote-controlled units and the complexity of 5G networks pose significant challenges to achieving optimal performance in device-based scenarios, when the 5G network cannot be controlled by its users. This paper proposes a model-free Deep Reinforcement Learning approach for this task. The model learns an optimal policy for maximizing the data transmission rate while minimizing the latency and packet loss. Such an approach aims to investigate the applicability of the environment-agnostic agents driven purely by the transmission statistics of the acknowledged packets. The evaluation is done with the help of a 5G simulation based on the OMNeT++ network simulator and the obtained results are compared to a classic throughput-based adaptive bitrate streaming approach. Multiple questions and challenges that arose on the way to the final model and evaluation procedure are highlighted in detail. The resulting findings demonstrate the effectiveness of Deep Reinforcement Learning for optimizing real-time data transmission in 5G networks in an online manner.
引用
收藏
页码:281 / 295
页数:15
相关论文
共 50 条
  • [31] Real-time and concurrent optimization of scheduling and reconfiguration for dynamic reconfigurable flow shop using deep reinforcement learning
    Yang, Shengluo
    Wang, Junyi
    Xin, Liming
    Xu, Zhigang
    CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY, 2023, 40 : 243 - 252
  • [32] A remote-controlled portable workstation for highly sensitive and real-time chemiluminescent detection of cadmium
    Zeng, Shiyu
    Zhu, Haoyu
    Sohan, A. S. M. Muhtasim Fuad
    Liu, Jun
    Wan, Xinhua
    Lin, Xiaodong
    Yin, Binfeng
    FOOD CHEMISTRY, 2024, 452
  • [33] ADPA Optimization for Real-Time Energy Management Using Deep Learning
    Wan, Zhengdong
    Huang, Yan
    Wu, Liangzheng
    Liu, Chengwei
    Energies, 17 (19):
  • [34] Learning to Calibrate Battery Models in Real-Time with Deep Reinforcement Learning
    Unagar, Ajaykumar
    Tian, Yuan
    Chao, Manuel Arias
    Fink, Olga
    ENERGIES, 2021, 14 (05)
  • [35] On using Deep Reinforcement Learning to balance Power Consumption and Latency in 5G NR
    Boutiba, Karim
    Ksentini, Adlen
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 6218 - 6223
  • [36] Proactive real-time interference avoidance in a 5G millimeter-wave over fiber mobile fronthaul using SARSA reinforcement learning
    Zhou, Qi
    Chen, You-Wei
    Shen, Shuyi
    Kong, Yiming
    Xu, Mu
    Zhang, Junwen
    Chang, Gee-Kung
    OPTICS LETTERS, 2019, 44 (17) : 4347 - 4350
  • [37] Developing Real-Time Scheduling Policy by Deep Reinforcement Learning
    Bo, Zitong
    Qiao, Ying
    Leng, Chang
    Wang, Hongan
    Guo, Chaoping
    Zhang, Shaohui
    2021 IEEE 27TH REAL-TIME AND EMBEDDED TECHNOLOGY AND APPLICATIONS SYMPOSIUM (RTAS 2021), 2021, : 131 - 142
  • [38] Deep Reinforcement Learning for Sponsored Search Real-time Bidding
    Zhao, Jun
    Qiu, Guang
    Guan, Ziyu
    Zhao, Wei
    He, Xiaofei
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1021 - 1030
  • [39] Real-time deep reinforcement learning based vehicle navigation
    Koh, Songsang
    Zhou, Bo
    Fang, Hui
    Yang, Po
    Yang, Zaili
    Yang, Qiang
    Guan, Lin
    Ji, Zhigang
    APPLIED SOFT COMPUTING, 2020, 96
  • [40] Partially Explainable Big Data Driven Deep Reinforcement Learning for Green 5G UAV
    Guo, Weisi
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,