Mobility Aware Channel Allocation for 5G Vehicular Networks using Multi-Agent Reinforcement Learning

被引:6
|
作者
Kumar, Anitha Saravana [1 ]
Zhao, Lian [1 ]
Fernando, Xavier [1 ]
机构
[1] Ryerson Univ, Dept Elect Comp & Biomed Engn, Toronto, ON, Canada
关键词
Vehicular Networks; Multi-Agent Reinforcement Learning; Teammate Learning; Channel allocation; RESOURCE-ALLOCATION;
D O I
10.1109/ICC42927.2021.9500625
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Reinforcement learning is a machine learning technique that focuses on exploring an uncharted territory exploiting of current knowledge. This paper proposes a Mobility Aware Channel Allocation (MACA) algorithm for SG Vehicular Networks using a combination of Multi-Agent Reinforcement Learning (MARL) and Semi-Markov Decision Process (SMDP). In this work, we use multiple autonomous agents operating in a common environment to address the sequential decision-making problem to optimize the long-term rewards. In MACA, first we predict the mobility of vehicles using Teammate-Learning model as it allows the vehicles to cooperate and collaborate with each other without prior coordination. Secondly, during SMDP resource allocation phase, MARL inputs are applied to the Action Selection model for each vehicle based on their priorities. This is done at Road-Side Units (RSUs). Through numerical results and evaluations, we verify that the proposed method demonstrates efficient channel allocation and high packet delivery ratio as compared in the scenario of vehicles with multiple (high, medium, and low) priorities to existing conventional SMDP and Greedy algorithms.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Vehicle Speed Aware Computing Task Offloading and Resource Allocation Based on Multi-Agent Reinforcement Learning in a Vehicular Edge Computing Network
    Huang, Xinyu
    He, Lijun
    Zhang, Wanyue
    2020 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING (EDGE 2020), 2020, : 1 - 8
  • [42] Mobility-aware load Balancing for Reliable Self-Organization Networks: Multi-agent Deep Reinforcement Learning
    Mohajer, Amin
    Bavaghar, Maryam
    Farrokhi, Hamid
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2020, 202
  • [43] A Multi-Agent Deep Reinforcement Learning Approach for Computation Offloading in 5G Mobile Edge Computing
    Gan, Zhaoyu
    Lin, Rongheng
    Zou, Hua
    2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 645 - 654
  • [44] Multi-Agent Deep Reinforcement Learning for Slicing and Admission Control in 5G C-RAN
    Sulaiman, Muhammad
    Moayyedi, Arash
    Salahuddin, Mohammad A.
    Boutaba, Raouf
    Saleh, Aladdin
    PROCEEDINGS OF THE IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM 2022, 2022,
  • [45] Value Decomposition based Multi-Task Multi-Agent Deep Reinforcement Learning in Vehicular Networks
    Xu, Shilin
    Guo, Caili
    Hu, Rose Qingyang
    Qian, Yi
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [46] Mobility-Aware Resource Allocation for mmWave IAB Networks via Multi-Agent RL
    Zhang, Bibo
    Filippini, Ilario
    2021 IEEE 18TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2021), 2021, : 17 - 26
  • [47] Federated Multi-Agent Deep Reinforcement Learning for Dynamic and Flexible 3D Operation of 5G Multi-MAP Networks
    Catte, Esteban
    Sana, Mohamed
    Maman, Mickael
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [48] Multi-Agent Context Learning Strategy for Interference-Aware Beam Allocation in mmWave Vehicular Communications
    Kose, Abdulkadir
    Lee, Haeyoung
    Foh, Chuan Heng
    Shojafar, Mohammad
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (07) : 7477 - 7493
  • [49] Vehicular Multi-slice Optimization in 5G: Dynamic Preference Policy using Reinforcement Learning
    Zhang, Chaofeng
    Dong, Mianxiong
    Ota, Kaoru
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [50] Multi-Agent Reinforcement Learning for Resource Allocation in Io T Networks with Edge Computing
    Xiaolan Liu
    Jiadong Yu
    Zhiyong Feng
    Yue Gao
    中国通信, 2020, 17 (09) : 220 - 236