DDPG-based Wireless Resource Allocation for Time-Constrained Applications

被引:0
|
作者
Hu, Hang [1 ]
Hernandez, Marco [2 ,6 ]
Kim, Yang G. [3 ]
Ahmed, Kazi J. [4 ]
Tsukamoto, Kazuya [5 ]
Lee, Myung J. [1 ]
机构
[1] CUNY City Coll, Dept Elect Engn, New York, NY 10031 USA
[2] Univ Oulu, Ctr Wireless Commun, Oulu 90014, Finland
[3] NYCCT, Dept Comp Engn Technol, Brooklyn, NY 11201 USA
[4] NYIT, Dept Elect & Comp Engn Technol, New York, NY 10023 USA
[5] Kyushu Inst Technol KIT, Dept Comp Sci & Elect, Fukuoka 8048550, Japan
[6] Yokosuka Res Pk Int Alliance Inst, Yokosuka, Kanagawa 2390847, Japan
关键词
5G and beyond; Resource allocation; Deep reinforcement learning; Deep deterministic policy gradient (DDPG); Time-constrained traffic; LATENCY; NETWORKS;
D O I
10.1109/WCNC57260.2024.10570841
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a novel model-free resource allocation framework for the downlink of 5G cellular networks to guarantee stringent QoS requirements in wireless applications. A Deep deterministic policy gradient (DDPG) agent with a modified Genetic Algorithm (GA) based resource allocation framework is proposed to balance the tradeoffs between reliability, latency, and data rate. Any feasible point in the rate-latency-reliability domain can be achieved with this approach. Compared to state-of-the-art approaches DDPG-Dual and DDPG-PSO, the proposed model achieves higher reliability and scalability in joint optimization with QoS constraints. Specifically, the proposed model guarantees the expected reliability with 25% and 42.86% improvement respectively over the compared models. In terms of conventional effective bandwidth approach, the proposed model achieves 30.82% improvement of energy efficiency under the same QoS constraints. Moreover, the proposed model offers a practical solution, namely, three times faster convergence and only 6.7% of the scheduling time compared to the ground truth Dual decomposition optimization.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] A Retrieval Algorithm for Time-constrained Heterogeneous Data Items in Wireless Networks
    Zhang, Yangming
    He, Ping
    Qi, Huaying
    Wang, Shiyi
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2023, 24 (03): : 611 - 620
  • [32] New data aggregation approach for time-constrained wireless sensor networks
    Abid, Besem
    Tien Trung Nguyen
    Seba, Hamida
    [J]. JOURNAL OF SUPERCOMPUTING, 2015, 71 (05): : 1678 - 1693
  • [33] Novel fast color reduction algorithm for time-constrained applications
    Kanjanawanishkul, K
    Uyyanonvara, B
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2005, 16 (03) : 311 - 332
  • [34] Time-constrained qualitative model-based diagnosis
    Steele, AD
    Leitch, R
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 1997, 10 (05) : 417 - 427
  • [35] Towards time-constrained task allocation in semi-opportunistic mobile crowdsensing
    Wei, Wentao
    Chen, Honglong
    Liu, Xiang
    Ma, Guoqi
    Liu, Yuping
    Liu, Xiaolong
    [J]. AD HOC NETWORKS, 2023, 150
  • [36] Resource Allocation in Load-Constrained Multihop Wireless Networks
    Fang, Xi
    Yang, Dejun
    Xue, Guoliang
    [J]. 2012 PROCEEDINGS IEEE INFOCOM, 2012, : 280 - 288
  • [37] Learning Constrained Resource Allocation Policies in Wireless Control Systems
    Lima, Vinicius
    Eisen, Mark
    Ribeiro, Alejandro
    [J]. 2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 2615 - 2621
  • [38] A DDPG-based solution for optimal consensus of continuous-time linear multi-agent systems
    LI Ye
    LIU ZhongXin
    LAN Ge
    SADER Malika
    CHEN ZengQiang
    [J]. Science China Technological Sciences, 2023, (08) : 2441 - 2453
  • [39] Coordinating Time-Constrained Multi-Agent Resource Sharing with Fault Detection
    Lin, Shieu-Hong
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT (IEEM), 2011, : 1000 - 1004
  • [40] A DDPG-based solution for optimal consensus of continuous-time linear multi-agent systems
    Ye Li
    ZhongXin Liu
    Ge Lan
    Malika Sader
    ZengQiang Chen
    [J]. Science China Technological Sciences, 2023, 66 : 2441 - 2453