A Collaborative Control Scheme for Smart Vehicles Based on Multi-Agent Deep Reinforcement Learning

被引:1
|
作者
Shi, Liyan [1 ]
Chen, Hairui [2 ]
机构
[1] Open Univ Henan, Sch Informat Engn & Artificial Intelligence, Zhengzhou 450046, Peoples R China
[2] Zhongyuan Univ Technol, Zhongyuan Petersburg Aviat Coll, Zhengzhou 450007, Peoples R China
关键词
Reinforcement learning; Control systems; Adaptation models; Roads; Optimization; Vehicle dynamics; Heuristic algorithms; Intelligent transportation systems; Collaborative control; smart vehicles; deep reinforcement learning; intelligent transportation systems; EDGE; SECURITY; INTERNET;
D O I
10.1109/ACCESS.2023.3312021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of artificial intelligence and autonomous driving technology, the vehicle-road cooperative control system combined with artificial intelligence technology can provide more effective and adaptive traffic control solutions for intelligent transportation systems. Existing research works are confronted with two kinds of challenges. For one thing, traditional recurrent neural networks-based methods cannot model the long-time dependent information in traffic flow sequences. For another, the large sample correlation makes it difficult to optimize the trained strategies. In this paper, we propose a Multi-agent Deep Reinforcement Learning (MADRL)-based intelligent vehicle cooperative control method to deal remedy current gaps. To this end, a closed-loop control system of self-driving vehicles and signal controllers is used as the research object to achieve dynamic scheduling of traffic flow by MADRL. After designing relevant experimental validation, the feasibility of the method is verified in terms of both scheme comparison and operational effect analysis, which is a good aid to traffic signal timing. The simulation results show that the proposal can be well utilized to realize collaborative control of smart vehicles, and there is some performance improvement compared with several typical methods.
引用
收藏
页码:96221 / 96234
页数:14
相关论文
共 50 条
  • [41] A traffic light control method based on multi-agent deep reinforcement learning algorithm
    Liu, Dongjiang
    Li, Leixiao
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [42] Avoiding collaborative paradox in multi-agent reinforcement learning
    Kim, Hyunseok
    Kim, Seonghyun
    Lee, Donghun
    Jang, Ingook
    ETRI JOURNAL, 2021, 43 (06) : 1004 - 1012
  • [43] PowerNet: Multi-Agent Deep Reinforcement Learning for Scalable Powergrid Control
    Chen, Dong
    Chen, Kaian
    Li, Zhaojian
    Chu, Tianshu
    Yao, Rui
    Qiu, Feng
    Lin, Kaixiang
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (02) : 1007 - 1017
  • [44] Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings
    Yu, Liang
    Sun, Yi
    Xu, Zhanbo
    Shen, Chao
    Yue, Dong
    Jiang, Tao
    Guan, Xiaohong
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (01) : 407 - 419
  • [45] Deep Reinforcement Learning for Multi-Agent Power Control in Heterogeneous Networks
    Zhang, Lin
    Liang, Ying-Chang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) : 2551 - 2564
  • [46] Decentralized Multi-agent Formation Control via Deep Reinforcement Learning
    Gutpa, Aniket
    Nallanthighal, Raghava
    ICAART: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 1, 2021, : 289 - 295
  • [47] Multi-agent behavioral control system using deep reinforcement learning
    Ngoc Duy Nguyen
    Thanh Nguyen
    Nahavandi, Saeid
    NEUROCOMPUTING, 2019, 359 : 58 - 68
  • [48] Load Frequency Control: A Deep Multi-Agent Reinforcement Learning Approach
    Rozada, Sergio
    Apostolopoulou, Dimitra
    Alonso, Eduardo
    2020 IEEE POWER & ENERGY SOCIETY GENERAL MEETING (PESGM), 2020,
  • [49] MAGNet: Multi-agent Graph Network for Deep Multi-agent Reinforcement Learning
    Malysheva, Aleksandra
    Kudenko, Daniel
    Shpilman, Aleksei
    2019 XVI INTERNATIONAL SYMPOSIUM PROBLEMS OF REDUNDANCY IN INFORMATION AND CONTROL SYSTEMS (REDUNDANCY), 2019, : 171 - 176
  • [50] Negotiation agent based on Deep reinforcement learning for multi-agent cooperative distributed predictive control.
    Aponte-Rengifo, O.
    Francisco, M.
    Vega, P.
    IFAC PAPERSONLINE, 2023, 56 (02): : 1496 - 1501