Detection of Outliers in Time Series Power Data Based on Prediction Errors

被引:3
|
作者
Li, Changzhi [1 ]
Liu, Dandan [1 ]
Wang, Mao [1 ]
Wang, Hanlin [1 ]
Xu, Shuai [1 ]
机构
[1] Shanghai Univ Elect Power, Coll Elect & Informat Engn, 185 Hucheng Ring Rd, Shanghai 201306, Peoples R China
关键词
neural network; forecast error; outlier detection; electricity consumption data;
D O I
10.3390/en16020582
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The primary focus of smart grid power analysis is on power load forecasting and data anomaly detection. Efficient and accurate power load prediction and data anomaly detection enable energy companies to develop reasonable production and scheduling plans and reduce waste. Since traditional anomaly detection algorithms are typically for symmetrically distributed time series data, the distribution of energy consumption data features uncertainty. To this end, a time series outlier detection approach based on prediction errors is proposed in this paper, which starts by using an attention mechanism-based convolutional neural network (CNN)-gated recursive unit (GRU) method to obtain the residual between the measured value and its predicted value, and the residual data generally conform to a symmetric distribution. Subsequently, for these residual data, a random forest classification algorithm based on grid search optimization is used to identify outliers in the power consumption data. The model proposed in this paper is applied to both classical and real energy consumption datasets, and the performance is evaluated using different metrics. As shown in the results, the average accuracy of the model is improved by 25.2% and the average precision is improved by 17.2%, with an average recall improvement of 16.4% and an average F1 score improvement of 26.8% compared to the mainstream algorithms.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] DETECTION OF OUTLIERS IN BIVARIATE TIME-SERIES DATA
    KHATTREE, R
    NAIK, DN
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1987, 16 (12) : 3701 - 3714
  • [2] OUTLIERS IN TIME SERIES DATA
    Deneshkumar, V.
    Kannan, K. Senthamarai
    INTERNATIONAL JOURNAL OF AGRICULTURAL AND STATISTICAL SCIENCES, 2011, 7 (02): : 685 - 691
  • [3] Wavelet-based detection of outliers in time series
    Bilen, C
    Huzurbazar, S
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2002, 11 (02) : 311 - 327
  • [4] Detection of additive outliers in time series data using wavelets
    Huzurbazar, S
    Bilen, C
    MINING AND MODELING MASSIVE DATA SETS IN SCIENCE, ENGINEERING, AND BUSINESS WITH A SUBTHEME IN ENVIRONMENTAL STATISTICS, 1997, 29 (01): : 132 - 137
  • [5] Detection of outliers in functional time series
    Rana, P.
    Aneiros, G.
    Vilar, J. M.
    ENVIRONMETRICS, 2015, 26 (03) : 178 - 191
  • [6] OUTLIERS DETECTION IN TIME-SERIES
    LEE, AH
    HUI, YV
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 1993, 45 (1-2) : 77 - 95
  • [7] Wavelet-based detection of outliers in financial time series
    Grane, Aurea
    Veiga, Helena
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (11) : 2580 - 2593
  • [8] Identification and Correction of Outliers in Wind Farm Time Series Power Data
    Ye, Xi
    Lu, Zongxiang
    Qiao, Ying
    Min, Yong
    O'Malley, Mark
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2016, 31 (06) : 4197 - 4205
  • [9] Wavelet Based Detection of Outliers in Volatility Time Series Models
    Rashedi, Khudhayr A.
    Ismail, Mohd Tahir
    Serroukh, Abdeslam
    Al Wadi, S.
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 72 (02): : 3835 - 3847
  • [10] An Outliers Detection Method of Time Series Data for Soft Sensor Modeling
    Tian, Hui-Xin
    Liu, Xing-Jun
    Han, Mei
    PROCEEDINGS OF THE 28TH CHINESE CONTROL AND DECISION CONFERENCE (2016 CCDC), 2016, : 3918 - 3922