Resource Allocation in Uplink NOMA Systems: A Hybrid-Decision-Based Multi-Agent Deep Reinforcement Learning Approach

被引:0
|
作者
Xie, Xianzhong [1 ]
Li, Min [2 ]
Shi, Zhaoyuan [2 ]
Yang, Helin [3 ]
Huang, Qian [2 ]
Xiong, Zehui [4 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun, Informat Engn Dept, Chongqing 400065, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
[3] Xiamen Univ, Sch Informat, Dept Informat & Commun Engn, Xiamen 361005, Peoples R China
[4] Singapore Univ Technol & Design, Pillar Informat Syst Technol & Design, Singapore 487372, Singapore
基金
中国国家自然科学基金;
关键词
Non-orthogonal multiple access (NOMA); actor-critic (AC); multi-agent; power control; channel selection; user dynamic access; NONORTHOGONAL MULTIPLE-ACCESS; POWER ALLOCATION; JOINT POWER; NETWORKS; ASSIGNMENT; SUBCHANNEL;
D O I
10.1109/TVT.2023.3289567
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This correspondence investigates a joint power control, channel selection, and user dynamic access scheme to maximize the sum rate of non-orthogonal multiple access (NOMA) systems. The highly dynamic and uncertain environment hinders the collection of accurate instantaneous channel state information (CSI) at the base station for centralized resource management. Therefore, we propose a hybrid-decision-based multi-agent actor-critic (HD-MAAC) approach to optimize the sum rate of the system. The proposed scheme improves the standard actor-critic (AC) algorithm to obtain both discrete and continuous actions. Simulation results verify that the proposed scheme achieves higher sum rate than that of existing popular schemes under different settings.
引用
收藏
页码:16760 / 16765
页数:6
相关论文
共 50 条
  • [41] Federated Multi-Agent Deep Reinforcement Learning Approach for Resource Allocation in Platoon-Based NR-V2X
    Liu, Yiming
    Wang, Qiang
    Chen, Jiaao
    Zhang, Wenqi
    Sun, Chen
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [42] A multi-agent deep reinforcement learning approach for optimal resource management in serverless computing
    Singh, Ashutosh Kumar
    Kumar, Satender
    Jain, Sarika
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2025, 28 (02):
  • [43] Joint Task and Computing Resource Allocation in Distributed Edge Computing Systems via Multi-Agent Deep Reinforcement Learning
    Chen, Yan
    Sun, Yanjing
    Yu, Hao
    Taleb, Tarik
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (04): : 3479 - 3494
  • [44] SeqDQN: Multi-Agent Deep Reinforcement Learning for Uplink URLLC with Strict Deadlines
    Robaglia, Benoit Marie
    Coupechoux, Marceau
    Tsilimantos, Dimitrios
    Destounis, Apostolos
    2023 JOINT EUROPEAN CONFERENCE ON NETWORKS AND COMMUNICATIONS & 6G SUMMIT, EUCNC/6G SUMMIT, 2023, : 623 - 628
  • [45] Multi-Task Deep Reinforcement Learning for Terahertz NOMA Resource Allocation With Hybrid Discrete and Continuous Actions
    Hu, Zhifeng
    Han, Chong
    Deng, Yansha
    Wang, Xudong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (08) : 11647 - 11663
  • [46] Deep Reinforcement Learning for Resource Allocation in Multi-Band and Hybrid OMA-NOMA Wireless Networks
    Chaieb, Cirine
    Abdelkefi, Fatma
    Ajib, Wessam
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (01) : 187 - 198
  • [47] A Reliable Reinforcement Learning for Resource Allocation in Uplink NOMA-URLLC Networks
    Ahsan, Waleed
    Yi, Wenqiang
    Liu, Yuanwei
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (08) : 5989 - 6002
  • [48] A HYBRID APPROACH FOR MULTI-AGENT LEARNING SYSTEMS
    Kuo, Jong Yih
    Huang, Fu Chu
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2011, 17 (03): : 385 - 399
  • [49] A Multi-Agent Learning Approach to Online Distributed Resource Allocation
    Zhang, Chongjie
    Lesser, Victor
    Shenoy, Prashant
    21ST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-09), PROCEEDINGS, 2009, : 361 - 366
  • [50] Multi-agent Deep Reinforcement Learning for Task Allocation in Dynamic Environment
    Ben Noureddine, Dhouha
    Gharbi, Atef
    Ben Ahmed, Samir
    ICSOFT: PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON SOFTWARE TECHNOLOGIES, 2017, : 17 - 26