Data Cleaning Method Based on Time Series Similarity Measurement for Large Scale Smart Grid Load Data

被引:7
|
作者
Lei, Yu [1 ]
Lin, RongHeng [1 ]
Zou, Hua [1 ]
Zhou, Shiqi [1 ]
Zhang, Yong [2 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] State Grid Shanghai Municipal Elect Power Co, Shanghai, Peoples R China
基金
北京市自然科学基金;
关键词
smart grid; load data; time series; similarity measurement; data cleaning;
D O I
10.1109/ES.2017.8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
On account of the strong time series feature of smart grid load data, this paper presents a data cleaning method based on similarity measurement of time series, which detects the abnormal data of load data and fills the vacancy value. In this paper, an up-and-coming symbolic method symbolic aggregate approximation(SAX) is applied to the similarity study of 96-point load data. The Euclidean distance algorithm is used to measure the similarity of time series, and the load data are cleaned according to the fitted curves obtained by adjusting similar sequences weighted by similarity. The experimental results show that the method has adequate accuracy and low computational complexity.
引用
收藏
页码:7 / 12
页数:6
相关论文
共 50 条
  • [1] A Credibility Measurement Method of Smart Grid Data
    Cheng, Xiaorong
    Li, Tianqi
    PROCEEDINGS OF 2016 IEEE ADVANCED INFORMATION MANAGEMENT, COMMUNICATES, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IMCEC 2016), 2016, : 1231 - 1235
  • [2] Classification for consumption data in smart grid based on forecasting time series
    Tornai, Kalman
    Kovacs, Lorant
    Olah, Andras
    Drenyovszki, Rajmund
    Pinter, Istvan
    Tisza, David
    Levendovszky, Janos
    ELECTRIC POWER SYSTEMS RESEARCH, 2016, 141 : 191 - 201
  • [3] Robust Scale-Invariant Normalization and Similarity Measurement for Time Series Data
    Chonbodeechalermroong, Ariyawat
    Ratanamahatana, Chotirat Ann
    MODERN APPROACHES FOR INTELLIGENT INFORMATION AND DATABASE SYSTEMS, 2018, 769 : 149 - 160
  • [4] An Algorithm Based on Time Series Similarity Measurement for Missing Data Filling
    Li Hui-min
    Wang Pu
    Fang Li-ying
    Liu Jing-wei
    PROCEEDINGS OF THE 2012 24TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2012, : 3933 - 3935
  • [5] Research on Data Cleaning and Fusion in Distribution Power Grid Based on Time Series Technology
    Zhu Y.
    Liang W.
    Wang Y.
    Dianwang Jishu/Power System Technology, 2021, 45 (07): : 2839 - 2846
  • [6] Querying time series data based on similarity
    Rafiei, D
    Mendelzon, AO
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2000, 12 (05) : 675 - 693
  • [7] Smart Grid Time Series Big Data Processing System
    Wang, Yuan
    Yuan, Jun
    Chen, Xiuming
    Bao, Jianguo
    2015 IEEE ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2015, : 393 - 400
  • [8] Time-Series Clustering for Data Analysis in Smart Grid
    Maurya, Akanksha
    Akyurek, Alper Sinan
    Aksanli, Baris
    Rosing, Tajana Simunic
    2016 IEEE INTERNATIONAL CONFERENCE ON SMART GRID COMMUNICATIONS (SMARTGRIDCOMM), 2016,
  • [9] Time series clustering for AMI data in household smart grid
    Lee, Jin-Young
    Kim, Sahm
    KOREAN JOURNAL OF APPLIED STATISTICS, 2020, 33 (06) : 791 - 804
  • [10] Real-time false data detection in smart grid based on fuzzy time series
    Khantach A.E.
    Hamlich M.
    Belbounaguia N.
    Instrumentation Mesure Metrologie, 2019, 18 (05): : 445 - 450