Deep Reinforcement Learning Based Active Pantograph Control Strategy in High-Speed Railway

被引:18
|
作者
Wang, Hui [1 ]
Han, Zhiwei [1 ]
Liu, Zhigang [2 ]
Wu, Yanbo [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Elect Engn, Chengdu 610031, Peoples R China
[2] Tongji Univ, Inst Rail Transit, Shanghai 201804, Peoples R China
关键词
Wires; Rail transportation; Force; Fluctuations; Finite element analysis; Mathematical models; Reinforcement learning; Active pantograph; contact force; deep reinforcement learning; high-speed railways; CONTACT FORCE CONTROL; CATENARY SYSTEMS;
D O I
10.1109/TVT.2022.3205452
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The pantograph-catenary system (PCS) is the essential power supply system in the high-speed railway, but its coupling performance is influenced significantly by the rapidly increasing train speed. The actively controlled pantograph is one of the promising technologies to suppress the fluctuation of the pantograph-catenary contact force (PCCF). In this paper, we propose a novel pantograph control strategy based on deep reinforcement learning (DRL) to overcome the complex time-varying characteristic of PCS, which distorts the system identification of the classical control methods. First, a non-linear pantograph-catenary system model is established based on the finite element and multi-body dynamics theory as the simulation environment in DRL. Then, the state space, action space, and reward in DRL are redesigned to train the agent, which is suitable for PCS. Finally, the effectiveness and robustness of our proposed method are verified under various working conditions and parameter disturbances. The experiment results show that our control strategy can reduce the PCCF fluctuation up to 40% and reject parametric perturbation while achieving state-of-the-art performance on the benchmarks.
引用
收藏
页码:227 / 238
页数:12
相关论文
共 50 条
  • [1] Rapid Adaptation for Active Pantograph Control in High-Speed Railway via Deep Meta Reinforcement Learning
    Wang, Hui
    Liu, Zhigang
    Han, Zhiwei
    Wu, Yanbo
    Liu, Derong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (05) : 2811 - 2823
  • [2] Optimization of resource allocation strategy for high-speed railway based on deep reinforcement learning
    Gao, Xu
    Zhao, Junhui
    Zhang, Qingmiao
    Han, Haitao
    [J]. PHYSICAL COMMUNICATION, 2024, 66
  • [3] Offline Meta-Reinforcement Learning for Active Pantograph Control in High-Speed Railways
    Wang, Hui
    Liu, Zhigang
    Hu, Guiyang
    Wang, Xufan
    Han, Zhiwei
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (08) : 10669 - 10679
  • [4] A Reinforcement Learning-Based Pantograph Control Strategy for Improving Current Collection Quality in High-Speed Railways
    Wang, Hui
    Han, Zhiwei
    Liu, Wenqiang
    Wu, Yanbo
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 5915 - 5928
  • [5] Active control of a high-speed pantograph
    OConnor, DN
    Eppinger, SD
    Seering, WP
    Wormley, DN
    [J]. JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 1997, 119 (01): : 1 - 4
  • [6] Model-Based Data-Efficient Reinforcement Learning for Active Pantograph Control in High-Speed Railways
    Wang, Hui
    Liu, Zhigang
    Wang, Xufan
    Meng, Xiangyu
    Wu, Yanbo
    Han, Zhiwei
    [J]. IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (02): : 2701 - 2712
  • [7] An Improved Deep Deterministic Policy Gradient Pantograph Active Control Strategy for High-Speed Railways
    Wang, Ying
    Wang, Yuting
    Chen, Xiaoqiang
    Wang, Yixuan
    Chang, Zhanning
    [J]. ELECTRONICS, 2024, 13 (17)
  • [8] Active control of fuzzy for high-speed pantograph
    Yang Gang
    Dai ZHongmei
    Li Fu
    Luo ZHengzhi
    [J]. NEW TRENDS IN MECHANICAL ENGINEERING AND MATERIALS, 2013, 251 : 158 - +
  • [9] Active pantograph in high-speed railway: Review, challenges, and applications
    Liu, Zhigang
    Wang, Hui
    Chen, Hongtian
    Wang, Xufan
    Song, Yang
    Han, Zhiwei
    [J]. CONTROL ENGINEERING PRACTICE, 2023, 141
  • [10] Intelligent Beam Management Based on Deep Reinforcement Learning in High-Speed Railway Scenarios
    Qiao, Yuanyuan
    Niu, Yong
    Zhang, Xiangfei
    Chen, Sheng
    Zhong, Zhangdui
    Wang, Ning
    Ai, Bo
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (03) : 3917 - 3931