Resource Allocation in Uplink NOMA Systems: A Hybrid-Decision-Based Multi-Agent Deep Reinforcement Learning Approach

被引:0
|
作者
Xie, Xianzhong [1 ]
Li, Min [2 ]
Shi, Zhaoyuan [2 ]
Yang, Helin [3 ]
Huang, Qian [2 ]
Xiong, Zehui [4 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun, Informat Engn Dept, Chongqing 400065, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
[3] Xiamen Univ, Sch Informat, Dept Informat & Commun Engn, Xiamen 361005, Peoples R China
[4] Singapore Univ Technol & Design, Pillar Informat Syst Technol & Design, Singapore 487372, Singapore
基金
中国国家自然科学基金;
关键词
Non-orthogonal multiple access (NOMA); actor-critic (AC); multi-agent; power control; channel selection; user dynamic access; NONORTHOGONAL MULTIPLE-ACCESS; POWER ALLOCATION; JOINT POWER; NETWORKS; ASSIGNMENT; SUBCHANNEL;
D O I
10.1109/TVT.2023.3289567
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This correspondence investigates a joint power control, channel selection, and user dynamic access scheme to maximize the sum rate of non-orthogonal multiple access (NOMA) systems. The highly dynamic and uncertain environment hinders the collection of accurate instantaneous channel state information (CSI) at the base station for centralized resource management. Therefore, we propose a hybrid-decision-based multi-agent actor-critic (HD-MAAC) approach to optimize the sum rate of the system. The proposed scheme improves the standard actor-critic (AC) algorithm to obtain both discrete and continuous actions. Simulation results verify that the proposed scheme achieves higher sum rate than that of existing popular schemes under different settings.
引用
收藏
页码:16760 / 16765
页数:6
相关论文
共 50 条
  • [31] Distributed reinforcement learning in multi-agent decision systems
    Giráldez, JI
    Borrajo, D
    PROGRESS IN ARTIFICIAL INTELLIGENCE-IBERAMIA 98, 1998, 1484 : 148 - 159
  • [32] Hybrid Multi-agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems
    Enders, Tobias
    Harrison, James
    Pavone, Marco
    Schiffer, Maximilian
    LEARNING FOR DYNAMICS AND CONTROL CONFERENCE, VOL 211, 2023, 211
  • [33] Federated Multi-Agent Deep Reinforcement Learning for Resource Allocation of Vehicle-to-Vehicle Communications
    Li, Xiang
    Lu, Lingyun
    Ni, Wei
    Jamalipour, Abbas
    Zhang, Dalin
    Du, Haifeng
    IEEE Transactions on Vehicular Technology, 2022, 71 (08): : 8810 - 8824
  • [34] Federated Multi-Agent Deep Reinforcement Learning for Resource Allocation of Vehicle-to-Vehicle Communications
    Li, Xiang
    Lu, Lingyun
    Ni, Wei
    Jamalipour, Abbas
    Zhang, Dalin
    Du, Haifeng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (08) : 8810 - 8824
  • [35] Multi-Agent Deep Reinforcement Learning for Walker Systems
    Park, Inhee
    Moh, Teng-Sheng
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 490 - 495
  • [36] Multi-Agent Reinforcement Learning for Slicing Resource Allocation in Vehicular Networks
    Cui, Yaping
    Shi, Hongji
    Wang, Ruyan
    He, Peng
    Wu, Dapeng
    Huang, Xinyun
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 2005 - 2016
  • [37] Multi-Agent Reinforcement Learning for Efficient Resource Allocation in Internet of Vehicles
    Wang, Jun-Han
    He, He
    Cha, Jaesang
    Jeong, Incheol
    Ahn, Chang-Jun
    ELECTRONICS, 2025, 14 (01):
  • [38] Multi-agent reinforcement learning for intelligent resource allocation in IIoT networks
    Rosenberger, Julia
    Urlaub, Michael
    Schramm, Dieter
    2021 IEEE GLOBAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INTERNET OF THINGS (GCAIOT), 2021, : 118 - 119
  • [39] A Multi-Agent Reinforcement Learning Approach for Stock Portfolio Allocation
    Koratamaddi, Prahlad
    Wadhwani, Karan
    Gupta, Mridul
    Sanjeevi, Sriram G.
    CODS-COMAD 2021: PROCEEDINGS OF THE 3RD ACM INDIA JOINT INTERNATIONAL CONFERENCE ON DATA SCIENCE & MANAGEMENT OF DATA (8TH ACM IKDD CODS & 26TH COMAD), 2021, : 410 - 410
  • [40] Joint Secure Offloading and Resource Allocation for Vehicular Edge Computing Network: A Multi-Agent Deep Reinforcement Learning Approach
    Ju, Ying
    Chen, Yuchao
    Cao, Zhiwei
    Liu, Lei
    Pei, Qingqi
    Xiao, Ming
    Ota, Kaoru
    Dong, Mianxiong
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (05) : 5555 - 5569