Spectrum Management with Congestion Avoidance for V2X Based on Multi-Agent Reinforcement Learning

被引:0
|
作者
Althamary, Ibrahim [1 ]
Lin, Jun-Yong [1 ]
Huang, Chih-Wei [1 ]
机构
[1] Natl Cent Univ, Dept Commun Engn, Taoyuan, Taiwan
关键词
Multi-agent reinforcement learning (MARL); vehicle-to-everything (V2X); 5G; resource allocation; spectrum management; CSI;
D O I
10.1109/GCWkshps50303.2020.9367564
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multi-agent reinforcement learning (MARL) for vehicular communication management is an emerging topic attracting considerable research attention. In this paper, to enhance the system throughput and spectrum efficiency, the vehicular agents can select different transmission modes, power, and sub-channels to maximize the overall system throughput in a decentralized manner. We propose a novel MARL resource allocation algorithm capable of congestion avoidance for vehicular networks with a multi-agent extension of advantage actorcritic (A2C). The cooperative action and congestion avoidance are achieved by global rewards and a unique dump channel, respectively. Moreover, comparison with landmark schemes is conducted on the realistic setup. The result shows that the agent achieves favorable performance with the proposed scheme to the environment.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Decentralized Multi-Agent DQN-Based Resource Allocation for Heterogeneous Traffic in V2X Communications
    Lee, Insung
    Kim, Duk Kyung
    [J]. IEEE ACCESS, 2024, 12 : 3070 - 3084
  • [42] Decentralized Multi-Agent DQN-Based Resource Allocation for Heterogeneous Traffic in V2X Communications
    Inha University, Department of Information and Communication Engineering, Incheon
    22212, Korea, Republic of
    [J]. IEEE Access, 2024, (3070-3084) : 3070 - 3084
  • [43] MAPS: Multi-agent Reinforcement Learning-based Portfolio Management System
    Lee, Jinho
    Kim, Raehyun
    Yi, Seok-Won
    Kang, Jaewoo
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 4520 - 4526
  • [44] Decentralized multi-agent based energy management of microgrid using reinforcement learning
    Samadi, Esmat
    Badri, Ali
    Ebrahimpour, Reza
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2020, 122
  • [45] An Auction-based Approach to Spectrum Allocation using Multi-agent Reinforcement Learning
    Abji, Nadeem
    Leon-Garcia, Alberto
    [J]. 2010 IEEE 21ST INTERNATIONAL SYMPOSIUM ON PERSONAL INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2010, : 2233 - 2238
  • [46] Multi-agent cooperative learning research based on reinforcement learning
    Liu, Fei
    Zeng, Guangzhou
    [J]. 2006 10TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, PROCEEDINGS, VOLS 1 AND 2, 2006, : 1408 - 1413
  • [47] Multi-agent reinforcement learning based on local communication
    Zhang, Wenxu
    Ma, Lei
    Li, Xiaonan
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 6): : 15357 - 15366
  • [48] Multi-agent Cooperative Search based on Reinforcement Learning
    Sun, Yinjiang
    Zhang, Rui
    Liang, Wenbao
    Xu, Cheng
    [J]. PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 891 - 896
  • [49] Function approximation based multi-agent reinforcement learning
    Abul, O
    Polat, F
    Alhajj, R
    [J]. 12TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2000, : 36 - 39
  • [50] Multi-agent reinforcement learning based on local communication
    Wenxu Zhang
    Lei Ma
    Xiaonan Li
    [J]. Cluster Computing, 2019, 22 : 15357 - 15366