Adaptive Speed Control of Electric Vehicles Based on Multi-Agent Fuzzy Q-Learning

被引:12
|
作者
Gheisarnejad, Meysam [1 ]
Mirzavand, Ghazal [2 ]
Ardeshiri, Reza Rouhi [3 ]
Andresen, Bjorn [1 ]
Khooban, Mohammad Hassan [1 ]
机构
[1] Aarhus Univ, Dept Elect & Comp Engn, DK-8200 Aarhus, Denmark
[2] Shiraz Univ Technol, Shiraz 7155713876, Iran
[3] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
关键词
Q-learning; Force; Unified modeling language; Vehicle dynamics; Roads; Resistance; DC motors; Fuzzy Q-learning; ultra-local model (ULM); electric vehicle (EV); multi-age system; ENERGY MANAGEMENT; SYSTEM; TRACKING; STRATEGY; CHOICE; DRIVE;
D O I
10.1109/TETCI.2022.3181159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electric vehicles (EVs) are expected to account for a significant percentage of the vehicle market in the coming years. The speed regulator is the inseparable part of EVs to solve challenges such as managing battery energy or adapting to road conditions. Since the operation of the EV system is time-variant due to parametric variations and road situations, the regulation of such systems is a complex task that cannot be effectively accomplished by the conventional deterministic control methodologies. To address the control challenges corresponding to the EV, the ultra-local model (ULM) with extended state observer (ESO) is developed for the speed tracking problem of the system. The Fuzzy Q-learning multi-age system (MAS) is also adopted to adaptively regulate the gains of the ULM controller in an online manner. The robustness of the established controller has been assessed by experimental data based on the new European driving cycle (NEDC) and altering some critical parameters of the EV test system. Moreover, the real-time verifications for the tracking problem of NEDC are also conducted by hardware-In-the Loop (HiL) simulation in the EV system.
引用
收藏
页码:102 / 110
页数:9
相关论文
共 50 条
  • [31] Regularized Softmax Deep Multi-Agent Q-Learning
    Pan, Ling
    Rashid, Tabish
    Peng, Bei
    Huang, Longbo
    Whiteson, Shimon
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [32] Multi-Agent Q-Learning for Drone Base Stations
    Janji, Salim
    Kliks, Adrian
    2023 19TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS, WIMOB, 2023, : 261 - 266
  • [33] Large-Scale Traffic Signal Control Based on Multi-Agent Q-Learning and Pressure
    Qi, Liang
    Sun, Yuanzhen
    Luan, Wenjing
    IEEE ACCESS, 2024, 12 (1092-1101) : 1092 - 1101
  • [34] Neighbor Q-learning based consensus control for discrete-time multi-agent systems
    Zhu, Xiaoxia
    Yuan, Xin
    Dong, Lu
    Wang, Yuanda
    Sun, Changyin
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2023, 44 (03): : 1475 - 1490
  • [35] A multi-agent based scheduling algorithm for adaptive electric vehicles charging
    Xydas, Erotokritos
    Marmaras, Charalampos
    Cipcigan, Liana M.
    APPLIED ENERGY, 2016, 177 : 354 - 365
  • [36] Multi-agent Q-Learning control of spacecraft formation flying reconfiguration trajectories
    Kankashvar, Mohammadrasoul
    Bolandi, Hossein
    Mozayani, Nasser
    ADVANCES IN SPACE RESEARCH, 2023, 71 (03) : 1627 - 1643
  • [37] Q-Learning based Protection Scheme for Microgrid using Multi-Agent System
    Satuyeva, Botazhan
    Sultankulov, Bekbol
    Nunna, H. S. V. S. Kumar
    Kalakova, Aidana
    Doolla, Suryanarayana
    2019 2ND INTERNATIONAL CONFERENCE ON SMART ENERGY SYSTEMS AND TECHNOLOGIES (SEST 2019), 2019,
  • [38] Consensus of discrete-time multi-agent system based on Q-learning
    Zhu Z.-B.
    Wang F.-Y.
    Yin Y.-H.
    Liu Z.-X.
    Chen Z.-Q.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2021, 38 (07): : 997 - 1005
  • [39] Multi-Agent Cooperation Q-Learning Algorithm Based on Constrained Markov Game
    Ge, Yangyang
    Zhu, Fei
    Huang, Wei
    Zhao, Peiyao
    Liu, Quan
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2020, 17 (02) : 647 - 664
  • [40] Sparse Cooperative Multi-agent Q-learning Based on Vector Potential Field
    Liu, Liang
    Li, Longshu
    PROCEEDINGS OF THE 2009 WRI GLOBAL CONGRESS ON INTELLIGENT SYSTEMS, VOL I, 2009, : 99 - 103