Deep Reinforcement Learning Based Active Pantograph Control Strategy in High-Speed Railway

被引:18
|
作者
Wang, Hui [1 ]
Han, Zhiwei [1 ]
Liu, Zhigang [2 ]
Wu, Yanbo [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Elect Engn, Chengdu 610031, Peoples R China
[2] Tongji Univ, Inst Rail Transit, Shanghai 201804, Peoples R China
关键词
Wires; Rail transportation; Force; Fluctuations; Finite element analysis; Mathematical models; Reinforcement learning; Active pantograph; contact force; deep reinforcement learning; high-speed railways; CONTACT FORCE CONTROL; CATENARY SYSTEMS;
D O I
10.1109/TVT.2022.3205452
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The pantograph-catenary system (PCS) is the essential power supply system in the high-speed railway, but its coupling performance is influenced significantly by the rapidly increasing train speed. The actively controlled pantograph is one of the promising technologies to suppress the fluctuation of the pantograph-catenary contact force (PCCF). In this paper, we propose a novel pantograph control strategy based on deep reinforcement learning (DRL) to overcome the complex time-varying characteristic of PCS, which distorts the system identification of the classical control methods. First, a non-linear pantograph-catenary system model is established based on the finite element and multi-body dynamics theory as the simulation environment in DRL. Then, the state space, action space, and reward in DRL are redesigned to train the agent, which is suitable for PCS. Finally, the effectiveness and robustness of our proposed method are verified under various working conditions and parameter disturbances. The experiment results show that our control strategy can reduce the PCCF fluctuation up to 40% and reject parametric perturbation while achieving state-of-the-art performance on the benchmarks.
引用
收藏
页码:227 / 238
页数:12
相关论文
共 50 条
  • [21] A New Active Control Strategy for Pantograph in High-Speed Electrified Railways Based on Multi-Objective Robust Control
    Zhang, Jing
    Zhang, Hantao
    Song, Baolin
    Xie, Songlin
    Liu, Zhigang
    [J]. IEEE ACCESS, 2019, 7 : 173719 - 173730
  • [22] Elastic Tracking Operation Method for High-Speed Railway Using Deep Reinforcement Learning
    Zhang, Liqing
    Hou, Leong U.
    Zhou, Mingliang
    Yang, Feiyu
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 3384 - 3391
  • [23] Potential Game Based Task Offloading in the High-Speed Railway With Reinforcement Learning
    Wu, Wei
    Song, Haifeng
    Wang, Hongwei
    Dong, Hairong
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) : 12671 - 12685
  • [24] Control Strategy of Speed Servo Systems Based on Deep Reinforcement Learning
    Chen, Pengzhan
    He, Zhiqiang
    Chen, Chuanxi
    Xu, Jiahong
    [J]. ALGORITHMS, 2018, 11 (05):
  • [25] Deep reinforcement learning-based fountain coding for concurrent multipath transfer in high-speed railway networks
    Yu, Chengxiao
    Quan, Wei
    Liu, Kang
    Liu, Mingyuan
    Xu, Ziheng
    Zhang, Hongke
    [J]. PEER-TO-PEER NETWORKING AND APPLICATIONS, 2022, 15 (06) : 2744 - 2756
  • [26] Deep reinforcement learning-based fountain coding for concurrent multipath transfer in high-speed railway networks
    Chengxiao Yu
    Wei Quan
    Kang Liu
    Mingyuan Liu
    Ziheng Xu
    Hongke Zhang
    [J]. Peer-to-Peer Networking and Applications, 2022, 15 : 2744 - 2756
  • [27] Optimal Control of Pantograph for High-Speed Railway Considering Actuator Time Delay
    Xie S.
    Zhang J.
    Song B.
    Liu Z.
    Gao S.
    [J]. Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2022, 37 (02): : 505 - 514
  • [28] Semi-active control for high-speed pantograph based on the optimal LQR regulator
    Yang G.
    Li F.
    [J]. Tiedao Xuebao/Journal of the China Railway Society, 2011, 33 (11): : 34 - 40
  • [29] Optimization of high-speed fixed-wing UAV penetration strategy based on deep reinforcement learning
    Zhuang, Xing
    Li, Dongguang
    Wang, Yue
    Liu, Xinyu
    Li, Hanyu
    [J]. AEROSPACE SCIENCE AND TECHNOLOGY, 2024, 148
  • [30] Deep Reinforcement Learning for Interference Suppression in RIS-Aided High-Speed Railway Networks
    Xu, Jianpeng
    Ai, Bo
    Quek, Tony Q. S.
    Liuc, Yupei
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 337 - 342