Spectrum Management with Congestion Avoidance for V2X Based on Multi-Agent Reinforcement Learning

被引:0
|
作者
Althamary, Ibrahim [1 ]
Lin, Jun-Yong [1 ]
Huang, Chih-Wei [1 ]
机构
[1] Natl Cent Univ, Dept Commun Engn, Taoyuan, Taiwan
关键词
Multi-agent reinforcement learning (MARL); vehicle-to-everything (V2X); 5G; resource allocation; spectrum management; CSI;
D O I
10.1109/GCWkshps50303.2020.9367564
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multi-agent reinforcement learning (MARL) for vehicular communication management is an emerging topic attracting considerable research attention. In this paper, to enhance the system throughput and spectrum efficiency, the vehicular agents can select different transmission modes, power, and sub-channels to maximize the overall system throughput in a decentralized manner. We propose a novel MARL resource allocation algorithm capable of congestion avoidance for vehicular networks with a multi-agent extension of advantage actorcritic (A2C). The cooperative action and congestion avoidance are achieved by global rewards and a unique dump channel, respectively. Moreover, comparison with landmark schemes is conducted on the realistic setup. The result shows that the agent achieves favorable performance with the proposed scheme to the environment.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Multi-Agent Deep Reinforcement Learning for Spectrum Management in V2X with Social Roles
    Chen, Po-Yen
    Zheng, Yu-Heng
    Althamary, Ibrahim
    Chern, Jann-Long
    Huang, Chih-Wei
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2293 - 2298
  • [2] Multi-Agent Reinforcement Learning- Based Resource Management for V2X Communication
    Zhao, Nan
    Wang, Jiaye
    Jin, Bo
    Wang, Ru
    Wu, Minghu
    Liu, Yu
    Zheng, Lufeng
    [J]. INTERNATIONAL JOURNAL OF MOBILE COMPUTING AND MULTIMEDIA COMMUNICATIONS, 2023, 14 (01)
  • [3] Resource Allocation in V2X Communications Based on Multi-Agent Reinforcement Learning with Attention Mechanism
    Ding, Yuanfeng
    Huang, Yan
    Tang, Li
    Qin, Xizhong
    Jia, Zhenhong
    [J]. MATHEMATICS, 2022, 10 (19)
  • [4] Deep Reinforcement Learning based Congestion Control for V2X Communication
    Roshdi, Moustafa
    Bhadauria, Shubhangi
    Hassan, Khaled
    Fischer, Georg
    [J]. 2021 IEEE 32ND ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2021,
  • [5] QoS based Multi-Agent vs. Single-Agent Deep Reinforcement Learning for V2X Resource Allocation
    Bhadauria, Shubhangi
    Ravichandran, Lavanya
    Roth-Mandutz, Elke
    Fischer, Georg
    [J]. 2021 IEEE SYMPOSIUM ON FUTURE TELECOMMUNICATION TECHNOLOGIES (SOFTT), 2021, : 39 - 45
  • [6] Cooperative Spectrum Sensing Approach in C-V2X based on Multi-Agent Reinforcement Learning
    Li, Pengfei
    Huang, Xin-Lin
    [J]. 2023 17TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS, CONTEL, 2023,
  • [7] Backdoor Attacks on Multi-Agent Reinforcement Learning-based Spectrum Management
    Zhang, Hongyi
    Liu, Mingqian
    Chen, Yunfei
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 3361 - 3365
  • [8] An Intelligent Congestion Control Strategy in Heterogeneous V2X Based on Deep Reinforcement Learning
    Wang, Hui
    Li, Haoyu
    Zhao, Yuan
    [J]. SYMMETRY-BASEL, 2022, 14 (05):
  • [9] Analysing Congestion Problems in Multi-agent Reinforcement Learning
    Radulescu, Roxana
    Vrancx, Peter
    Nowe, Ann
    [J]. AAMAS'17: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2017, : 1705 - 1707
  • [10] Multi-agent reinforcement learning for long-term network resource allocation through auction: A V2X application
    Tan, Jing
    Khalili, Ramin
    Karl, Holger
    Hecker, Artur
    [J]. COMPUTER COMMUNICATIONS, 2022, 194 : 333 - 347