Data Cleaning Method Based on Time Series Similarity Measurement for Large Scale Smart Grid Load Data

被引:7
|
作者
Lei, Yu [1 ]
Lin, RongHeng [1 ]
Zou, Hua [1 ]
Zhou, Shiqi [1 ]
Zhang, Yong [2 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] State Grid Shanghai Municipal Elect Power Co, Shanghai, Peoples R China
基金
北京市自然科学基金;
关键词
smart grid; load data; time series; similarity measurement; data cleaning;
D O I
10.1109/ES.2017.8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
On account of the strong time series feature of smart grid load data, this paper presents a data cleaning method based on similarity measurement of time series, which detects the abnormal data of load data and fills the vacancy value. In this paper, an up-and-coming symbolic method symbolic aggregate approximation(SAX) is applied to the similarity study of 96-point load data. The Euclidean distance algorithm is used to measure the similarity of time series, and the load data are cleaned according to the fitted curves obtained by adjusting similar sequences weighted by similarity. The experimental results show that the method has adequate accuracy and low computational complexity.
引用
收藏
页码:7 / 12
页数:6
相关论文
共 50 条
  • [21] Big data cleaning model of smart grid based on Tensor Tucker decomposition
    Yin, Jun
    Zhang, Jianye
    Li, Degao
    Wang, Tianjun
    Jing, Kang
    2020 INTERNATIONAL CONFERENCE ON BIG DATA & ARTIFICIAL INTELLIGENCE & SOFTWARE ENGINEERING (ICBASE 2020), 2020, : 166 - 169
  • [22] Time Series Data Cleaning Based on Dynamic Speed Constraints
    Ding, Guohui
    Li, Chenyang
    Wei, Ru
    Sun, Shasha
    Liu, Zhaoyu
    Fan, Chunlong
    WEB INFORMATION SYSTEMS ENGINEERING, WISE 2020, PT II, 2020, 12343 : 475 - 487
  • [23] Routing Algorithm of Smart Grid Data Collection based on Data Balance Measurement Model
    Jia, Xiaochun
    Chen, Xingyu
    Shao, Sujie
    Qi, Feng
    2014 16TH ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2014,
  • [24] Real-Time Congestion Management of Power Transmission Grid Based on Measurement Data Cleaning Technology
    Gao, Zhengnan
    Liu, Meijie
    Hu, Shubo
    Jin, Tian
    Lu, Xueli
    Sun, Hui
    2023 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA, I&CPS ASIA, 2023, : 2250 - 2255
  • [25] Real-time Detection of False Data Injection Attacks Based on Load Forecasting in Smart Grid
    Deng, Yueyu
    Zhu, Kun
    Wang, Ran
    Wan, Yong
    2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CONTROL, AND COMPUTING TECHNOLOGIES FOR SMART GRIDS (SMARTGRIDCOMM), 2019,
  • [26] Privacy-Preserving Publication of Time-Series Data in Smart Grid
    Lako, Franklin Leukam
    Lajoie-Mazenc, Paul
    Laurent, Maryline
    SECURITY AND COMMUNICATION NETWORKS, 2021, 2021 (2021)
  • [27] Models for Distributed, Large Scale Data Cleaning
    Maccio, Vincent J.
    Chiang, Fei
    Down, Douglas G.
    TRENDS AND APPLICATIONS IN KNOWLEDGE DISCOVERY AND DATA MINING, 2014, 8643 : 369 - 380
  • [28] A causal discovery method for time series data based on mutual information measurement
    Li, De-Zhi
    Lu, Yun-Jun
    Wu, Jian-Ping
    Li, Qiang
    Kongzhi yu Juece/Control and Decision, 2024, 39 (09): : 3151 - 3159
  • [29] A novel method for similarity search over electric time series data
    Li, QD
    Chi, ZX
    Wang, ZC
    2003 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-5, PROCEEDINGS, 2003, : 2315 - 2318
  • [30] Similarity measures for time series data classification using grid representation and matrix distance
    Yanqing Ye
    Jiang Jiang
    Bingfeng Ge
    Yajie Dou
    Kewei Yang
    Knowledge and Information Systems, 2019, 60 : 1105 - 1134