Mobility Aware Channel Allocation for 5G Vehicular Networks using Multi-Agent Reinforcement Learning

被引:6
|
作者
Kumar, Anitha Saravana [1 ]
Zhao, Lian [1 ]
Fernando, Xavier [1 ]
机构
[1] Ryerson Univ, Dept Elect Comp & Biomed Engn, Toronto, ON, Canada
关键词
Vehicular Networks; Multi-Agent Reinforcement Learning; Teammate Learning; Channel allocation; RESOURCE-ALLOCATION;
D O I
10.1109/ICC42927.2021.9500625
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Reinforcement learning is a machine learning technique that focuses on exploring an uncharted territory exploiting of current knowledge. This paper proposes a Mobility Aware Channel Allocation (MACA) algorithm for SG Vehicular Networks using a combination of Multi-Agent Reinforcement Learning (MARL) and Semi-Markov Decision Process (SMDP). In this work, we use multiple autonomous agents operating in a common environment to address the sequential decision-making problem to optimize the long-term rewards. In MACA, first we predict the mobility of vehicles using Teammate-Learning model as it allows the vehicles to cooperate and collaborate with each other without prior coordination. Secondly, during SMDP resource allocation phase, MARL inputs are applied to the Action Selection model for each vehicle based on their priorities. This is done at Road-Side Units (RSUs). Through numerical results and evaluations, we verify that the proposed method demonstrates efficient channel allocation and high packet delivery ratio as compared in the scenario of vehicles with multiple (high, medium, and low) priorities to existing conventional SMDP and Greedy algorithms.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Multi-Agent Reinforcement Learning-Based Resource Allocation for UAV Networks
    Cui, Jingjing
    Liu, Yuanwei
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (02) : 729 - 743
  • [32] Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
    Nasir, Yasar Sinan
    Guo, Dongning
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (10) : 2239 - 2250
  • [33] Multi-Agent Reinforcement Learning for Resource Allocation in IoT Networks with Edge Computing
    Liu, Xiaolan
    Yu, Jiadong
    Feng, Zhiyong
    Gao, Yue
    CHINA COMMUNICATIONS, 2020, 17 (09) : 220 - 236
  • [34] Multi-Agent Deep Reinforcement Learning for Urban Traffic Light Control in Vehicular Networks
    Wu, Tong
    Zhou, Pan
    Liu, Kai
    Yuan, Yali
    Wang, Xiumin
    Huang, Huawei
    Wu, Dapeng Oliver
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (08) : 8243 - 8256
  • [35] Group and Socially Aware Multi-Agent Reinforcement Learning
    Vallecha, Manav
    Kala, Rahul
    2022 30TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2022, : 73 - 78
  • [36] Intent-aware Multi-agent Reinforcement Learning
    Qi, Siyuan
    Zhu, Song-Chun
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 7533 - 7540
  • [37] Reinforcement Learning for Energy Optimization with 5G Communications in Vehicular Social Networks
    Park, Hyebin
    Lim, Yujin
    SENSORS, 2020, 20 (08)
  • [38] Availability-Aware Channel Allocation for Multi-Cell Cognitive Radio 5G Networks
    Halloush, Rami D.
    Salaimeh, Rana
    Al-Dalqamoni, Roa'a
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (04) : 3931 - 3947
  • [39] Dynamic and efficient resource allocation for 5G end-to-end network slicing: A multi-agent deep reinforcement learning approach
    Asim Ejaz, Muhammad
    Wu, Guowei
    Iqbal, Tahir
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2024, 37 (17)
  • [40] Distributed reinforcement learning in multi-agent networks
    Kar, Soummya
    Moura, Jose M. F.
    Poor, H. Vincent
    2013 IEEE 5TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2013), 2013, : 296 - +