A Q-learning based adaptive congestion control for V2V communication in VANET

被引:4
|
作者
Liu, Xiaofeng [1 ]
Amour, Ben St. [1 ]
Jaekel, Arunita [1 ]
机构
[1] Univ Windsor, Sch Comp Sci, Windsor, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Congestion control; VANET; Reinforcement learning; NETWORKS;
D O I
10.1109/IWCMC55113.2022.9824995
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Vehicular ad hoc networks (VANETs) require timely delivery of periodic basic safety messages (BSMs) containing critical vehicle status information, as well as event-driven notifications to ensure road safety and improve traffic flow. The limited channel capacity of the wireless medium and high message rates needed for adequate situational awareness create a dilemma between the conflicting goals of congestion control and awareness control algorithms. To ensure reliable delivery, vehicles need to interact with a complex and dynamic environment to determine the appropriate message rate and power for their transmissions at any given time. In this paper, we propose an innovative framework where vehicles use reinforcement learning (RL) to intelligently select their transmission parameters based on the current channel conditions. Our simulation results indicate that RL methods can provide a flexible solution for adaptive congestion control by designing the appropriate reward function.
引用
收藏
页码:847 / 852
页数:6
相关论文
共 50 条
  • [1] V2V Routing in VANET Based on Heuristic Q-Learning
    Yang, X. Y.
    Zhang, W. L.
    Lu, H. M.
    Zhao, L.
    [J]. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2020, 15 (05) : 1 - 17
  • [2] A Reinforcement Learning-Based Congestion Control Approach for V2V Communication in VANET
    Liu, Xiaofeng
    St Amour, Ben
    Jaekel, Arunita
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [3] A Hybrid Routing Algorithm for V2V Communication in VANETs Based on Blocked Q-Learning
    Bi, Xiang
    Huang, Huang
    Zhang, Benhong
    Wei, Xing
    [J]. IEICE TRANSACTIONS ON COMMUNICATIONS, 2023, E106B (01) : 1 - 17
  • [4] Joint Congestion Control Strategy During V2V Communication Among Authentic Vehicles in VANET
    Sulata Mitra
    Atanu Mondal
    [J]. Wireless Personal Communications, 2014, 79 : 43 - 67
  • [5] Joint Congestion Control Strategy During V2V Communication Among Authentic Vehicles in VANET
    Mitra, Sulata
    Mondal, Atanu
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2014, 79 (01) : 43 - 67
  • [6] Q-learning for Waiting Time Control in CDN/V2V Live streaming
    Ma, Zhejiayu
    Roubia, Soufiane
    Giroire, Frederic
    Urvoy-Keller, Guillaume
    [J]. 2023 IFIP NETWORKING CONFERENCE, IFIP NETWORKING, 2023,
  • [7] Coexistence of decentralized congestion control algorithms for V2V communication
    Math, Chetan Belagal
    Li, Hong
    Abanto-Leon, Luis F.
    de Groot, Sonia Heemstra
    Niemegeers, Ignas
    [J]. 2018 IEEE 87TH VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2018,
  • [8] Data Rate Based Congestion Control in V2V Communication for Traffic Safety Applications
    Math, Chetan Belagal
    Ozgur, Ahmet
    de Groot, Sonia Heemstra
    Li, Hong
    [J]. 2015 IEEE SYMPOSIUM ON COMMUNICATIONS AND VEHICULAR TECHNOLOGY IN THE BENELUX (SCVT), 2015,
  • [9] Congestion Control in V2V Safety Communication: Problem, Analysis, Approaches
    Liu, Xiaofeng
    Jaekel, Arunita
    [J]. ELECTRONICS, 2019, 8 (05):
  • [10] V2V Routing in VANET Based on Fuzzy Logic and Reinforcement Learning
    Zhang, W. L.
    Yang, X. Y.
    Song, Q. X.
    Zhao, L.
    [J]. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2021, 16 (01) : 1 - 19