Imitation and Transfer Q-Learning-Based Parameter Identification for Composite Load Modeling

被引:19
|
作者
Xie, Jian [1 ]
Ma, Zixiao [1 ]
Dehghanpour, Kaveh [1 ]
Wang, Zhaoyu [1 ]
Wang, Yishen [2 ]
Diao, Ruisheng [2 ]
Shi, Di [2 ]
机构
[1] Iowa State Univ, Dept Elect & Comp Engn, Ames, IA 50011 USA
[2] GEIRI North Amer, Dept AI & Syst Analyt, San Jose, CA 95134 USA
关键词
Load modeling; Task analysis; Integrated circuit modeling; Mathematical model; Optimization; Reactive power; parameter identification; transfer learning; reinforcement learning; imitation learning;
D O I
10.1109/TSG.2020.3025509
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Fast and accurate load parameter identification has a large impact on power systems operation and stability analysis. This article proposes a novel Imitation and Transfer Q-learning (ITQ)-based method to identify parameters of composite constant impedance-current-power (ZIP) and induction motor (IM) load models. Firstly, an imitation learning process is introduced to improve the exploitation and exploration processes. Then, a transfer learning method is employed to overcome the challenge of time-consuming optimization when dealing with new identification tasks. An associative memory is designed to realize dimension reduction, knowledge learning and transfer between different identification tasks. Agents can exploit the optimal knowledge from source tasks to accelerate the search rate in new tasks and improve solution accuracy. A greedy action selection rule is adopted for agents to balance the global and local search. The performance of the proposed ITQ approach has been validated on a 68-bus test system. Simulation results in multi-test cases verify that the proposed method is robust and can estimate load parameters accurately. Comparisons with other methods show that the proposed method has superior convergence rate and stability.
引用
收藏
页码:1674 / 1684
页数:11
相关论文
共 50 条
  • [1] Fast Parameter Identification and Modeling of Electric Load Based on Simplified Composite Load Model
    Yu, Songtai
    Zhang, Shuqing
    Han, Yingduo
    Lu, Chao
    Yu, Zhihong
    Zhang, Xinran
    [J]. 2015 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, 2015,
  • [2] Q-Learning-based parameter control in differential evolution for structural optimization
    Huynh, Thanh N.
    Do, Dieu T. T.
    Lee, Jaehong
    [J]. APPLIED SOFT COMPUTING, 2021, 107
  • [3] Dynamic Q-Learning-Based Optimized Load Balancing Technique in Cloud
    Muthusamy, Arvindhan
    Dhanaraj, Rajesh Kumar
    [J]. Mobile Information Systems, 2023, 2023
  • [4] SVM-Based Parameter Identification for Composite ZIP and Electronic Load Modeling
    Wang, Chong
    Wang, Zhaoyu
    Wang, Jianhui
    Zhao, Dongbo
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2019, 34 (01) : 182 - 193
  • [5] Cross-Categorical Transfer Learning based Composite Load Protection Modeling
    Chakraborty, Indrasis
    Kundu, Soumya
    Liu, Yuan
    Etingov, Pavel
    [J]. E-ENERGY'19: PROCEEDINGS OF THE 10TH ACM INTERNATIONAL CONFERENCE ON FUTURE ENERGY SYSTEMS, 2019, : 500 - 507
  • [6] Robust Time-Varying Parameter Identification for Composite Load Modeling
    Wang, Chong
    Wang, Zhaoyu
    Wang, Jianhui
    Zhao, Dongbo
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (01) : 967 - 979
  • [7] An Improved Q-Learning-Based Scheduling Strategy with Load Balancing for Infrastructure-Based Cloud Services
    Ziyath, S. Peer Mohamed
    Subramaniyan, Senthilkumar
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2022, 47 (08) : 9547 - 9555
  • [8] An Improved Q-Learning-Based Scheduling Strategy with Load Balancing for Infrastructure-Based Cloud Services
    S. Peer Mohamed Ziyath
    Senthilkumar Subramaniyan
    [J]. Arabian Journal for Science and Engineering, 2022, 47 : 9547 - 9555
  • [9] A Q-learning-based network content caching method
    Chen, Haijun
    Tan, Guanzheng
    [J]. EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2018,
  • [10] A Q-learning-based network content caching method
    Haijun Chen
    Guanzheng Tan
    [J]. EURASIP Journal on Wireless Communications and Networking, 2018