Data-driven Missing Data Imputation for Wind Farms Using Context Encoder

被引:14
|
作者
Liao, Wenlong [1 ]
Bak-Jensen, Birgitte [1 ]
Pillai, Jayakrishnan Radhakrishna [1 ]
Yang, Dechang [2 ]
Wang, Yusen [3 ]
机构
[1] Aalborg Univ, Dept Energy Technol, Aalborg, Denmark
[2] China Agr Univ, Coll Informat & Elect Engn, Beijing, Peoples R China
[3] KTH Royal Inst Technol, Sch Elect Engn & Comp Sci, Stockholm, Sweden
关键词
Data-driven; missing data imputation; wind farm; deep learning; context encoder; NETWORK; MODEL;
D O I
10.35833/MPCE.2020.000894
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
High-quality datasets are of paramount importance for the operation and planning of wind farms. However, the datasets collected by the supervisory control and data acquisition (SCADA) system may contain missing data due to various factors such as sensor failure and communication congestion. In this paper, a data-driven approach is proposed to fill the missing data of wind farms based on a context encoder (CE), which consists of an encoder, a decoder, and a discriminator. Through deep convolutional neural networks, the proposed method is able to automatically explore the complex nonlinear characteristics of the datasets that are difficult to be modeled explicitly. The proposed method can not only fully use the surrounding context information by the reconstructed loss, but also make filling data look real by the adversarial loss. In addition, the correlation among multiple missing attributes is taken into account by adjusting the format of input data. The simulation results show that CE performs better than traditional methods for the attributes of wind farms with hallmark characteristics such as large peaks, large valleys, and fast ramps. Moreover, the CE shows stronger generalization ability than traditional methods such as auto-encoder, K-means, k-nearest neighbor, back propagation neural network, cubic interpolation, and conditional generative adversarial network for different missing data scales.
引用
收藏
页码:964 / 976
页数:13
相关论文
共 50 条
  • [31] Multiple imputation of rainfall missing data in the Iberian Mediterranean context
    Javier Miro, Juan
    Caselles, Vicente
    Jose Estrela, Maria
    [J]. ATMOSPHERIC RESEARCH, 2017, 197 : 313 - 330
  • [32] Data-driven modelling of turbine wake interactions and flow resistance in large wind farms
    Kirby, Andrew
    Briol, Francois-Xavier
    Dunstan, Thomas D.
    Nishino, Takafumi
    [J]. WIND ENERGY, 2023, 26 (09) : 968 - 984
  • [33] Real-time data-driven missing data imputation for short-term sensor data of marine systems. A comparative study
    Velasco-Gallego, Christian
    Lazakis, Iraklis
    [J]. OCEAN ENGINEERING, 2020, 218
  • [34] Data-Driven Modelling of Wind Turbines
    van der Veen, Gijs
    van Wingerden, Jan-Willem
    Verhaegen, Michel
    [J]. 2011 AMERICAN CONTROL CONFERENCE, 2011, : 72 - 77
  • [35] A General Equivalent Modeling Method for DFIG Wind Farms Based on Data-Driven Modeling
    Zhu, Qianlong
    Tao, Jun
    Deng, Tianbai
    Zhu, Mingxing
    [J]. ENERGIES, 2022, 15 (19)
  • [36] Data-Driven Model Predictive Control Method for Wind Farms to Provide Frequency Support
    Guo, Zizhen
    Wu, Wenchuan
    [J]. IEEE TRANSACTIONS ON ENERGY CONVERSION, 2022, 37 (02) : 1304 - 1313
  • [37] Wind power prediction with missing data using Gaussian process regression and multiple imputation
    Liu, Tianhong
    Wei, Haikun
    Zhang, Kanjian
    [J]. APPLIED SOFT COMPUTING, 2018, 71 : 905 - 916
  • [38] Comparison of Interpolation, Statistical, and Data-Driven Methods for Imputation of Missing Values in a Distributed Soil Moisture Dataset
    Kornelsen, Kurt
    Coulibaly, Paulin
    [J]. JOURNAL OF HYDROLOGIC ENGINEERING, 2014, 19 (01) : 26 - 43
  • [39] Content in context: a data-driven approach
    Vernau, J
    [J]. DATA MINING II, 2000, 2 : 213 - 217
  • [40] Using Multiple Imputation to Account for the Uncertainty Due to Missing Data in the Context of Factor Retention
    Xia, Yan
    Havan, Selim
    [J]. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2024, 84 (03) : 577 - 593