DDPG-based Wireless Resource Allocation for Time-Constrained Applications

被引:0
|
作者
Hu, Hang [1 ]
Hernandez, Marco [2 ,6 ]
Kim, Yang G. [3 ]
Ahmed, Kazi J. [4 ]
Tsukamoto, Kazuya [5 ]
Lee, Myung J. [1 ]
机构
[1] CUNY City Coll, Dept Elect Engn, New York, NY 10031 USA
[2] Univ Oulu, Ctr Wireless Commun, Oulu 90014, Finland
[3] NYCCT, Dept Comp Engn Technol, Brooklyn, NY 11201 USA
[4] NYIT, Dept Elect & Comp Engn Technol, New York, NY 10023 USA
[5] Kyushu Inst Technol KIT, Dept Comp Sci & Elect, Fukuoka 8048550, Japan
[6] Yokosuka Res Pk Int Alliance Inst, Yokosuka, Kanagawa 2390847, Japan
关键词
5G and beyond; Resource allocation; Deep reinforcement learning; Deep deterministic policy gradient (DDPG); Time-constrained traffic; LATENCY; NETWORKS;
D O I
10.1109/WCNC57260.2024.10570841
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a novel model-free resource allocation framework for the downlink of 5G cellular networks to guarantee stringent QoS requirements in wireless applications. A Deep deterministic policy gradient (DDPG) agent with a modified Genetic Algorithm (GA) based resource allocation framework is proposed to balance the tradeoffs between reliability, latency, and data rate. Any feasible point in the rate-latency-reliability domain can be achieved with this approach. Compared to state-of-the-art approaches DDPG-Dual and DDPG-PSO, the proposed model achieves higher reliability and scalability in joint optimization with QoS constraints. Specifically, the proposed model guarantees the expected reliability with 25% and 42.86% improvement respectively over the compared models. In terms of conventional effective bandwidth approach, the proposed model achieves 30.82% improvement of energy efficiency under the same QoS constraints. Moreover, the proposed model offers a practical solution, namely, three times faster convergence and only 6.7% of the scheduling time compared to the ground truth Dual decomposition optimization.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Distributed DDPG-Based Resource Allocation for Age of Information Minimization in Mobile Wireless-Powered Internet of Things
    Zheng, Kechen
    Luo, Rongwei
    Liu, Xiaoying
    Qiu, Jiefan
    Liu, Jia
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 29102 - 29115
  • [2] TIME-CONSTRAINED RESOURCE LEVELING
    SEIBERT, JE
    EVANS, GW
    [J]. JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT-ASCE, 1991, 117 (03): : 503 - 520
  • [3] Deadline allocation in a time-constrained workflow
    Son, JH
    Kim, JH
    Kim, MH
    [J]. INTERNATIONAL JOURNAL OF COOPERATIVE INFORMATION SYSTEMS, 2001, 10 (04) : 509 - 530
  • [4] DDPG-based Resource Management for MEC/UAV-Assisted Vehicular Networks
    Peng, Haixia
    Shen, Xuemin Sherman
    [J]. 2020 IEEE 92ND VEHICULAR TECHNOLOGY CONFERENCE (VTC2020-FALL), 2020,
  • [5] DDPG-Based Radio Resource Management for User Interactive Mobile Edge Networks
    Chen, Po-Chen
    Chen, Yen-Chen
    Huang, Wei-Hsiang
    Huang, Chih-Wei
    Tirkkonen, Olav
    [J]. 2020 2ND 6G WIRELESS SUMMIT (6G SUMMIT), 2020,
  • [6] EC-DDPG: DDPG-based Task Offloading Framework of Internet of Vehicle for Mission Critical Applications
    Sun, Hongbo
    Ma, Derui
    She, Hao
    Guo, Yongan
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 984 - 989
  • [7] DDPG-Based Joint Resource Management for Latency Minimization in NOMA-MEC Networks
    Wang, Jiayin
    Wang, Yafeng
    Cheng, Peng
    Yu, Kan
    Xiang, Wei
    [J]. IEEE COMMUNICATIONS LETTERS, 2023, 27 (07) : 1814 - 1818
  • [8] A heuristic resource scheduling scheme in time-constrained networks
    Kim, Yang G.
    Wang, Yu
    Park, ByoungSeob
    Choi, Hyo Hyun
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2016, 54 : 1 - 15
  • [9] Computation Offloading with Resource Allocation Based on DDPG in MEC
    Moon, Sungwon
    Lim, Yujin
    [J]. JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2024, 20 (02): : 226 - 238
  • [10] Security-and Time-Constrained OPF Applications
    Fang, Duo
    Gunda, Jagadeesh
    Djokic, Sasa Z.
    Vaccaro, Alfredo
    [J]. 2017 IEEE MANCHESTER POWERTECH, 2017,