DDRL: A Decentralized Deep Reinforcement Learning Method for Vehicle Repositioning

被引:3
|
作者
Xi, Jinhao [1 ,2 ]
Zhu, Fenghua [2 ]
Chen, Yuanyuan [2 ]
Lv, Yisheng [2 ]
Tan, Chang [3 ]
Wang, Feiyue [2 ]
机构
[1] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[2] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[3] iFLYTEK CO LTD, Hefei 230088, Peoples R China
关键词
decentralized deep reinforcement learning; vehicle repositioning; deep Q network; Online Ride-hailing System;
D O I
10.1109/ITSC48978.2021.9564925
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Online Ride-hailing System improves the efficiency of vehicle utilization and the urban transportation. However, the imbalance between supply and demand is still a problem. To solve this problem and improve resource utilization efficiency, a Decentralized Deep Reinforcement Learning Method (DDRL) for vehicle repositioning is proposed. In DDRL, each vehicle is modeled as an independent agent and dispatched according to its own state to rebalance its local supply and demand. Thus, the global rebalance problem is divided into many small local rebalance problems. First, a new reward evaluation method is proposed and the long-term global reward in traditional reinforcement learning is transformed into many short-term local rewards. Second, a unified algorithm is designed by learning all the decentralized agents' sample data. Finally, the weight matrix of the state is introduced to magnify the differences between the states of adjacent vehicles. Experiments are carried out and the effectiveness of DDRL is verified.
引用
收藏
页码:3984 / 3989
页数:6
相关论文
共 50 条
  • [1] Deep Reinforcement Learning With Graph Representation for Vehicle Repositioning
    Yu, Zishun
    Hu, Mengqi
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) : 13094 - 13107
  • [2] Deep Reinforcement Learning for Multi-Driver Vehicle Dispatching and Repositioning Problem
    Holler, John
    Vuorio, Risto
    Qin, Zhiwei
    Tang, Xiaocheng
    Jiao, Yan
    Jin, Tiancheng
    Singh, Satinder
    Wang, Chenxi
    Ye, Jieping
    [J]. 2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1090 - 1095
  • [3] Real-world ride-hailing vehicle repositioning using deep reinforcement learning
    Jiao, Yan
    Tang, Xiaocheng
    Qin, Zhiwei
    Li, Shuaiji
    Zhang, Fan
    Zhu, Hongtu
    Ye, Jieping
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 130
  • [4] Real-world ride-hailing vehicle repositioning using deep reinforcement learning
    Jiao, Yan
    Tang, Xiaocheng
    Qin, Zhiwei
    Li, Shuaiji
    Zhang, Fan
    Zhu, Hongtu
    Ye, Jieping
    [J]. Transportation Research Part C: Emerging Technologies, 2021, 130
  • [5] A Method of Deep Reinforcement Learning for Simulation of Autonomous Vehicle Control
    Anh Huynh
    Ba-Tung Nguyen
    Hoai-Thu Nguyen
    Sang Vu
    Hien Nguyen
    [J]. ENASE: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON EVALUATION OF NOVEL APPROACHES TO SOFTWARE ENGINEERING, 2021, : 372 - 379
  • [6] Deep Decentralized Reinforcement Learning for Cooperative Control
    Koepf, Florian
    Tesfazgi, Samuel
    Flad, Michael
    Hohmann, Soeren
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 1555 - 1562
  • [7] Autonomous Surface Vehicle Control Method Using Deep Reinforcement Learning
    Zhang, Shang
    Yang, Rui
    Chen, Zhen
    Li, Ming
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1664 - 1668
  • [8] A sharing deep reinforcement learning method for efficient vehicle platooning control
    Lu, Sikai
    Cai, Yingfeng
    Chen, Long
    Wang, Hai
    Sun, Xiaoqiang
    Jia, Yunyi
    [J]. IET INTELLIGENT TRANSPORT SYSTEMS, 2022, 16 (12) : 1697 - 1709
  • [9] Deep Reinforcement Learning for Ride-sharing Dispatching and Repositioning
    Qin, Zhiwei
    Tang, Xiaocheng
    Jiao, Yan
    Zhang, Fan
    Wang, Chenxi
    Li, Qun
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 6566 - 6568
  • [10] Auxiliary Network Enhanced Hierarchical Graph Reinforcement Learning for Vehicle Repositioning
    Xi, Jinhao
    Zhu, Fenghua
    Ye, Peijun
    Lv, Yisheng
    Xiong, Gang
    Wang, Fei-Yue
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (09) : 11563 - 11575