Research on online cleaning and repair methods of large-scale distribution network load data

被引：0
|
作者：
China Electric Power Research Institute, Haidian District, Beijing [1 ]
100192, China
机构：
来源：
Dianwang Jishu | / 11卷 / 3134-3140期
关键词：
Repair - Time series analysis - Collaborative filtering;
D O I：
10.13335/j.1000-3673.pst.2015.11.018
中图分类号：
学科分类号：
摘要：
In order to improve data availability in field of distribution network planning and intelligence analysis with reduced data cache cost, effectively analyze large-scale, mixed and inaccurately monitored or collected load data online, and to ensure consistent deviation detection and accurate repair for time series data in each cycle, an online data cleaning and repair method for large-scale distribution network load data is proposed based on analysis of different types of abnormal load causes and distribution features, including abnormal load steam identification method on density and data repair method on collaborative filtering recommendation algorithm. To break through bottlenecks in online data analysis performance for distribution network load, parallel solution on Hadoop platform is given. Verified with actual distribution network operation data, result shows that the proposed algorithm and frame could get effective data preprocessing and yield favorable significance in practice and research. ©, 2015, Power System Technology Press. All right reserved.
引用
收藏
相关论文
共 50 条
  • [31] Kernel methods for large-scale genomic data analysis
    Wang, Xuefeng
    Xing, Eric P.
    Schaid, Daniel J.
    BRIEFINGS IN BIOINFORMATICS, 2015, 16 (02) : 183 - 192
  • [32] Big-Data Analysis and Visualization as Research Methods for a Large-Scale Undergraduate Research Program at a Research University
    Killion, Patrick J.
    Page, Ian B.
    Yu, Victoria
    SPUR-SCHOLARSHIP AND PRACTICE OF UNDERGRADUATE RESEARCH, 2019, 2 (04): : 14 - 22
  • [33] An adaptive approach for online monitoring of large-scale data streams
    Cao, Shuchen
    Zhang, Ruizhi
    IISE TRANSACTIONS, 2025, 57 (02) : 119 - 130
  • [34] Online Dictionary Learning from Large-Scale Binary Data
    Shen, Yanning
    Giannakis, Georgios B.
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 1808 - 1812
  • [35] Distributed Large-Scale Data Collection in Online Social Networks
    Efstathiades, Hariton
    Antoniades, Demetris
    Pallis, George
    Dikaiakos, Marios D.
    2016 IEEE 2ND INTERNATIONAL CONFERENCE ON COLLABORATION AND INTERNET COMPUTING (IEEE CIC), 2016, : 373 - 380
  • [36] Lightweight Label Propagation for Large-Scale Network Data
    Liang, De-Ming
    Li, Yu-Feng
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 3421 - 3427
  • [37] Large-Scale Realistic Network Data Generation on a Budget
    Ricks, Brian
    Tague, Patrick
    Thuraisingham, Bhavani
    2018 IEEE INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION (IRI), 2018, : 23 - 30
  • [38] NetSearch: Googling Large-scale Network Management Data
    Qiu, Tongqing
    Ge, Zihui
    Pei, Dan
    Wang, Jia
    Xu, Jun
    2014 IFIP NETWORKING CONFERENCE, 2014,
  • [39] Lightweight Label Propagation for Large-Scale Network Data
    Li, Yu-Feng
    Liang, De-Ming
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (05) : 2071 - 2082
  • [40] Particle network EnKF for large-scale data assimilation
    Li, Xinjia
    Lu, Wenlian
    FRONTIERS IN PHYSICS, 2022, 10
12345