A novel dynamic integration approach for multiple load forecasts based on Q-learning algorithm

被引:7
|
作者
Ma, Minhua [1 ]
Jin, Bingjie [1 ,2 ]
Luo, Shuxin [1 ,2 ]
Guo, Shaoqing [3 ]
Huang, Hongwei [3 ]
机构
[1] CSG, Guangdong Power Grid Corp, Grid Planning & Res Ctr, Guangzhou, Guangdong, Peoples R China
[2] Guangdong Power Grid Dev Res Inst Co Ltd, Guangzhou, Guangdong, Peoples R China
[3] Beijing QU Creat Technol Co Ltd, Beijing, Peoples R China
关键词
action space; environmental status; multiple load forecasts integration; Q-learning algorithm; reinforcement learning; return function; NEURAL-NETWORKS; MODEL;
D O I
10.1002/2050-7038.12146
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A higher accurate load forecasts can significantly reduce the potential cost for power system operation and power market decision. There have been extensive load forecasting methods proposed by now. Ensemble learning is an effective way to integrate various forecasts and further improve the forecasting accuracy. Traditional ensemble learning algorithms static. However, how to select a suitable forecasting method from a large number of load forecasting methods under the complex and varying environment conditions is still challenging. In this context, this paper proposes a dynamic integration approach for multiple load forecasts based on reinforcement learning. Compared with the traditional integration methods, this method adopts Q-learning algorithm to realize the adaptive selection of the forecasting methods and dynamic weight calculation for different and varying environment. The basic principles and implementation processes of Q-learning algorithm is firstly introduced. Then, the implementation methodology of dynamic integration approach of multiple load forecasts is proposed. On this basis, the environment state, action space and return function are designed according to the requirements of Q-learning algorithm. Finally, a case study based on the real-world data in Guangzhou shows that the average forecasting accuracy could be improved by almost 3% by adopting the dynamic integration approach with the traditional ones.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] A Multiagent Dynamic Assessment Approach for Water Quality Based on Improved Q-Learning Algorithm
    Ni, Jianjun
    Ren, Li
    Liu, Minghua
    Zhu, Daqi
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013
  • [2] A novel contour extraction approach based on Q-learning
    Liang, Jun-Bin
    Xu, Jian-Min
    [J]. PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2006, : 3807 - +
  • [3] Dynamic feature selection algorithm based on Q-learning mechanism
    Ruohao Xu
    Mengmeng Li
    Zhongliang Yang
    Lifang Yang
    Kangjia Qiao
    Zhigang Shang
    [J]. Applied Intelligence, 2021, 51 : 7233 - 7244
  • [4] Dynamic feature selection algorithm based on Q-learning mechanism
    Xu, Ruohao
    Li, Mengmeng
    Yang, Zhongliang
    Yang, Lifang
    Qiao, Kangjia
    Shang, Zhigang
    [J]. APPLIED INTELLIGENCE, 2021, 51 (10) : 7233 - 7244
  • [5] A Dynamic Planning Algorithm based on Q-Learning Routing in SDON
    Shang, Jingkun
    Li, Hui
    Man, Xiangkun
    Wu, Fang
    Zhao, Jia Wei
    Ma, Xiaomei
    [J]. 2020 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE (ACP) AND INTERNATIONAL CONFERENCE ON INFORMATION PHOTONICS AND OPTICAL COMMUNICATIONS (IPOC), 2020,
  • [6] Dynamic Pricing Scheme for IaaS Cloud Platform Based on Load Balancing: A Q-learning Approach
    Ren, Jiali
    Pang, Lijuan
    Cheng, Yan
    [J]. PROCEEDINGS OF 2017 8TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2017), 2017, : 806 - 810
  • [7] Q-Learning Based Dynamic Channel Assignment Algorithm in Cognitive Radio
    Wang, Huahua
    Wei, Yang
    Long, Yin
    [J]. ELECTRONIC INFORMATION AND ELECTRICAL ENGINEERING, 2012, 19 : 127 - 131
  • [8] A Q-learning approach based on human reasoning for navigation in a dynamic environment
    Yuan, Rupeng
    Zhang, Fuhai
    Wang, Yu
    Fu, Yili
    Wang, Shuguo
    [J]. ROBOTICA, 2019, 37 (03) : 445 - 468
  • [9] Backward Q-learning: The combination of Sarsa algorithm and Q-learning
    Wang, Yin-Hao
    Li, Tzuu-Hseng S.
    Lin, Chih-Jui
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2013, 26 (09) : 2184 - 2193
  • [10] A novel Q-learning algorithm based on improved whale optimization algorithm for path planning
    Li, Ying
    Wang, Hanyu
    Fan, Jiahao
    Geng, Yanyu
    [J]. PLOS ONE, 2022, 17 (12):