Multi-Agent Deep Reinforcement Learning for Large-scale Platoon Coordination with Partial Information at Hubs

被引:0
|
作者
Wei, Dixiao [1 ,2 ]
Yi, Peng [1 ,2 ]
Lei, Jinlong [1 ,2 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金;
关键词
STRING STABILITY; SPACING POLICY;
D O I
10.1109/CDC49753.2023.10383216
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers the hub-based platoon coordination problem in a large-scale transportation network, to promote cooperation among trucks and optimize the overall efficiency of the transportation network. We design a distributed communication model for transportation networks and transform the problem into a Dec-POMDP (Decentralized-Partial Observable Markov Decision Process). We then propose an A-QMIX deep reinforcement learning algorithm to solve the problem, which adopts centralized training and distributed execution and hence provides a reliable model for trucks to make quick decisions using only partial information. Finally, we carry out experiments with 100 trucks in the transportation network of the Yangtze River Delta region in China to demonstrate the effectiveness of the proposed algorithm.
引用
收藏
页码:6242 / 6248
页数:7
相关论文
共 50 条
  • [1] Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control
    Chu, Tianshu
    Wang, Jie
    Codeca, Lara
    Li, Zhaojian
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (03) : 1086 - 1095
  • [2] Efficient Large-Scale Fleet Management via Multi-Agent Deep Reinforcement Learning
    Lin, Kaixiang
    Zhao, Renyu
    Xu, Zhe
    Zhou, Jiayu
    [J]. KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1774 - 1783
  • [3] Multi-Agent Mix Hierarchical Deep Reinforcement Learning for Large-Scale Fleet Management
    Huang, Xiaohui
    Ling, Jiahao
    Yang, Xiaofei
    Zhang, Xiong
    Yang, Kaiming
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (12) : 14294 - 14305
  • [4] Coordination in Adversarial Multi-Agent with Deep Reinforcement Learning under Partial Observability
    Diallo, Elhadji Amadou Oury
    Sugawara, Toshiharu
    [J]. 2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 198 - 205
  • [5] Dynamic Dispatching for Large-Scale Heterogeneous Fleet via Multi-agent Deep Reinforcement Learning
    Zhang, Chi
    Odonkor, Philip
    Zheng, Shuai
    Khorasgani, Hamed
    Serita, Susumu
    Gupta, Chetan
    Wang, Haiyan
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 1436 - 1441
  • [6] Concentration Network for Reinforcement Learning of Large-Scale Multi-Agent Systems
    Fu, Qingxu
    Qiu, Tenghai
    Yi, Jianqiang
    Pu, Zhiqiang
    Wu, Shiguang
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 9341 - 9349
  • [7] Large-Scale Multi-Agent Deep FBSDEs
    Chen, Tianrong
    Wang, Ziyi
    Exarchos, Ioannis
    Theodorou, Evangelos A.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [8] Addressing deadlock in large-scale, complex rail networks via multi-agent deep reinforcement learning
    Bretas, A. M. C.
    Mendes, A.
    Chalup, S.
    Jackson, M.
    Clement, R.
    Sanhueza, C.
    [J]. EXPERT SYSTEMS, 2023,
  • [9] Evolution of a Complex Predator-Prey Ecosystem on Large-scale Multi-Agent Deep Reinforcement Learning
    Yamada, Jun
    Shawe-Taylor, John
    Fountas, Zafeirios
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [10] Distributed Task Offloading for Large-Scale VEC Systems: A Multi-agent Deep Reinforcement Learning Method
    Lu, Yanfei
    Han, Dengyu
    Wang, Xiaoxuan
    Gao, Qinghe
    [J]. 2022 14TH INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN 2022), 2022, : 161 - 165