Denoising Masked Autoencoder-Based Missing Imputation within Constrained Environments for Electric Load Data

被引:0
|
作者
Jeong, Jaeik [1 ]
Ku, Tai-Yeon [1 ]
Park, Wan-Ki [1 ]
机构
[1] Elect & Telecommun Res Inst, Energy ICT Res Sect, Daejeon 34129, South Korea
关键词
denoising autoencoder; masked autoencoder; missing imputation; electric load data;
D O I
10.3390/en16247933
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
With recent advancements in data technologies, particularly machine learning, research focusing on the enhancement of energy efficiency in residential, commercial, and industrial settings through the collection of load data, such as heat, electricity, and gas, has gained significant attention. Nevertheless, issues arising from hardware- or network-related problems can result in missing data, necessitating the development of management techniques to mitigate these challenges. Traditional methods for missing imputation face difficulties when operating in constrained environments characterized by short data collection periods and frequent consecutive missing. In this paper, we introduce the denoising masked autoencoder (DMAE) model as a solution to improve the handling of missing data, even in such restrictive settings. The proposed DMAE model capitalizes on the advantages of the denoising autoencoder (DAE), enabling effective learning of the missing imputation process, even with relatively small datasets, and the masked autoencoder (MAE), allowing for learning in environments with a high missing ratio. By integrating these strengths, the DMAE model achieves an enhanced performance in terms of missing imputation. The simulation results demonstrate that the proposed DMAE model outperforms the DAE or MAE significantly in a constrained environment where the duration of the training data is short, less than a year, and missing values occur frequently with durations ranging from 3 h to 12 h.
引用
收藏
页数:18
相关论文
共 27 条
  • [1] Denoising Autoencoder-Based Missing Value Imputation for Smart Meters
    Ryu, Seunghyoung
    Kim, Minsoo
    Kim, Hongseok
    [J]. IEEE ACCESS, 2020, 8 : 40656 - 40666
  • [2] Masked Autoencoder Transformer for Missing Data Imputation of PISA
    Freire, Guilherme Mendonca
    Curi, Mariana
    [J]. ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2024, PT I, 2024, 2150 : 364 - 372
  • [3] Imputation of missing measurements in PV production data within constrained environments
    de-Paz-Centeno, Ivan
    Garcia-Ordas, Maria Teresa
    Garcia-Olalla, Oscar
    Alaiz-Moreton, Hector
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 217
  • [4] A Two-Stage Deep Autoencoder-Based Missing Data Imputation Method for Wind Farm SCADA Data
    Liu, Xin
    Zhang, Zijun
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (09) : 10933 - 10945
  • [5] Multiscale-attention masked autoencoder for missing data imputation of wind turbines
    Fan, Yuwei
    Feng, Chenlong
    Wu, Rui
    Liu, Chao
    Jiang, Dongxiang
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 299
  • [6] Multivariate Time Series Missing Data Imputation Using Recurrent Denoising Autoencoder
    Zhang, Jianye
    Yin, Peng
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 760 - 764
  • [7] Missing data imputation using an iterative denoising autoencoder (IDAE) for dissolved gas analysis
    Seo, Boseong
    Shin, Jaekyung
    Kim, Taejin
    Youn, Byeng D.
    [J]. ELECTRIC POWER SYSTEMS RESEARCH, 2022, 212
  • [8] Establishing strong imputation performance of a denoising autoencoder in a wide range of missing data problems
    Abiri, Najmeh
    Linse, Bjorn
    Eden, Patrik
    Ohlsson, Mattias
    [J]. NEUROCOMPUTING, 2019, 365 : 137 - 146
  • [9] MISSING DATA IMPUTATION FOR HEALTH CARE BIG DATA USING DENOISING AUTOENCODER WITH GENERATIVE ADVERSARIAL NETWORK
    Zhang, Yinbing
    [J]. SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (05): : 3850 - 3857
  • [10] Autoencoder-based multi-task learning for imputation and classification of incomplete data
    Lai, Xiaochen
    Wu, Xia
    Zhang, Liyong
    [J]. Applied Soft Computing, 2021, 98