Data-Driven Techniques for Short-Term Electricity Price Forecasting through Novel Deep Learning Approaches with Attention Mechanisms

被引:1
|
作者
Laitsos, Vasileios [1 ]
Vontzos, Georgios [1 ]
Bargiotas, Dimitrios [1 ]
Daskalopulu, Aspassia [1 ]
Tsoukalas, Lefteri H. [2 ]
机构
[1] Univ Thessaly, Dept Elect & Comp Engn, Volos 38334, Greece
[2] Purdue Univ, Ctr Intelligent Energy Syst CiENS, Sch Nucl Engn, W Lafayette, IN 47906 USA
关键词
load forecasting; long short-term memory; perceptron; convolutional neural networks (CNN); Multi-Head Attention; transformer; hybrid CNN-gated recurrent units with attention; evaluation metrics; power sector; data analysis;
D O I
10.3390/en17071625
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The electricity market is constantly evolving, being driven by factors such as market liberalization, the increasing use of renewable energy sources (RESs), and various economic and political influences. These dynamics make it challenging to predict wholesale electricity prices. Accurate short-term forecasting is crucial to maintaining system balance and addressing anomalies such as negative prices and deviations from predictions. This paper investigates short-term electricity price forecasting using historical time series data and employs advanced deep learning algorithms. First, four deep learning models are implemented and proposed, which are a convolutional neural network (CNN) with an integrated attention mechanism, a hybrid CNN followed by a gated recurrent unit model (CNN-GRU) with an attention mechanism, and two ensemble learning models, which are a soft voting ensemble and a stacking ensemble model. Also, the optimized version of a transformer model, the Multi-Head Attention model, is introduced. Finally, the perceptron model is used as a benchmark for comparison. Our results show excellent prediction accuracy, particularly in the hybrid CNN-GRU model with attention, thereby achieving a mean absolute percentage error (MAPE) of 6.333%. The soft voting ensemble model and the Multi-Head Attention model also performed well, with MAPEs of 6.125% and 6.889%, respectively. These findings are significant, as previous studies have not shown high performance with transformer models and attention mechanisms. The presented results offer promising insights for future research in this field.
引用
收藏
页数:27
相关论文
共 50 条
  • [1] Short-Term Electric Load Forecasting Based on Data-Driven Deep Learning Techniques
    Massaoudi, Mohamed
    Refaat, Shady S.
    Chihi, Ines
    Trabelsi, Mohamed
    Abu-Rub, Haitham
    Oueslati, Fakhreddine S.
    [J]. IECON 2020: THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2020, : 2565 - 2570
  • [2] Optimized Data-Driven Models for Short-Term Electricity Price Forecasting Based on Signal Decomposition and Clustering Techniques
    Arvanitidis, Athanasios Ioannis
    Bargiotas, Dimitrios
    Kontogiannis, Dimitrios
    Fevgas, Athanasios
    Alamaniotis, Miltiadis
    [J]. ENERGIES, 2022, 15 (21)
  • [3] Data-driven short-term natural gas demand forecasting with machine learning techniques
    Sharma, Vinayak
    Cali, Umit
    Sardana, Bhav
    Kuzlu, Murat
    Banga, Dishant
    Pipattanasomporn, Manisa
    [J]. JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2021, 206
  • [4] Data-driven short-term natural gas demand forecasting with machine learning techniques
    Sharma, Vinayak
    Cali, Ümit
    Sardana, Bhav
    Kuzlu, Murat
    Banga, Dishant
    Pipattanasomporn, Manisa
    [J]. Journal of Petroleum Science and Engineering, 2021, 206
  • [5] Short-Term Electricity Price Forecasting
    Arabali, A.
    Chalko, E.
    Etezadi-Amoli, M.
    Fadali, M. S.
    [J]. 2013 IEEE POWER AND ENERGY SOCIETY GENERAL MEETING (PES), 2013,
  • [6] A Review of Short-term Electricity Price Forecasting Techniques in Deregulated Electricity Markets
    Hu, Linlin
    Taylor, Gareth
    Wan, Hai-Bin
    Irving, Malcolm
    [J]. UPEC: 2009 44TH INTERNATIONAL UNIVERSITIES POWER ENGINEERING CONFERENCE, 2009, : 145 - 149
  • [7] Short-term electricity price forecasting based on Attention-GRU
    Xie Q.
    Dong L.
    She X.
    [J]. Dianli Xitong Baohu yu Kongzhi/Power System Protection and Control, 2020, 48 (23): : 154 - 160
  • [8] A novel hybrid deep neural network model for short-term electricity price forecasting
    Huang, Chiou-Jye
    Shen, Yamin
    Chen, Yung-Hsiang
    Chen, Hsin-Chuan
    [J]. INTERNATIONAL JOURNAL OF ENERGY RESEARCH, 2021, 45 (02) : 2511 - 2532
  • [9] Ultra-short term wholesale electricity price forecasting through deep learning
    Alvarez, Ana
    Luo, Wei
    Fryer, Simon
    [J]. 2021 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES - ASIA (ISGT ASIA), 2021,
  • [10] Data-driven modeling for long-term electricity price forecasting
    Gabrielli, Paolo
    Wuthrich, Moritz
    Blume, Steffen
    Sansavini, Giovanni
    [J]. ENERGY, 2022, 244