Variational Autoencoders for Missing Data Imputation with Application to a Simulated Milling Circuit

被引:63
|
作者
McCoy, John T. [1 ]
Kroon, Steve [2 ]
Auret, Lidia [1 ]
机构
[1] Stellenbosch Univ, Dept Proc Engn, Private Bag X1, ZA-7602 Matieland, South Africa
[2] Stellenbosch Univ, Div Comp Sci, Private Bag X1, ZA-7602 Matieland, South Africa
来源
IFAC PAPERSONLINE | 2018年 / 51卷 / 21期
关键词
Missing Data Imputation; Machine Learning; Variational Autoencoder; FAULT-DIAGNOSIS; MODEL;
D O I
10.1016/j.ifacol.2018.09.406
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Missing data values and differing sampling rates, particularly for important parameters such as particle size and stream composition, are a common problem in minerals processing plants. Missing data imputation is used to avoid information loss (due to downsampling or discarding incomplete records). A recent deep -learning technique, variational autoencoders (VAEs), has been used for missing data imputation in image data, and was compared here to imputation by mean replacement and by principal component analysis (PCA) imputation. The techniques were compared using a synthetic, nonlinear dataset, and a simulated milling circuit dataset, which included process disturbances, measurement noise, and feedback control. Each dataset was corrupted with missing values in 20% of records (lightly corrupted) and in 90% of records (heavily corrupted). For both lightly and heavily corrupted datasets, the root mean squared error of prediction for VAE imputation was lower than the traditional methods. Possibilities for the extension of missing data imputation to inferential sensing are discussed. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.
引用
收藏
页码:141 / 146
页数:6
相关论文
共 50 条
  • [1] Leveraging Variational Autoencoders for Multiple Data Imputation
    Roskams-Hieter, Breeshey
    Wells, Jude
    Wade, Sara
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT I, 2023, 14169 : 491 - 506
  • [2] MIDIA: exploring denoising autoencoders for missing data imputation
    Qian Ma
    Wang-Chien Lee
    Tao-Yang Fu
    Yu Gu
    Ge Yu
    [J]. Data Mining and Knowledge Discovery, 2020, 34 : 1859 - 1897
  • [3] MIDIA: exploring denoising autoencoders for missing data imputation
    Ma, Qian
    Lee, Wang-Chien
    Fu, Tao-Yang
    Gu, Yu
    Yu, Ge
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (06) : 1859 - 1897
  • [4] Posterior Consistency for Missing Data in Variational Autoencoders
    Sudak, Timur
    Tschiatschek, Sebastian
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT II, 2023, 14170 : 508 - 524
  • [5] Quantum Circuit for Imputation of Missing Data
    Sanavio, Claudio
    Tibaldi, Simone
    Tignone, Edoardo
    Ercolessi, Elisa
    [J]. IEEE Transactions on Quantum Engineering, 2024, 5
  • [6] Missing value imputation in food composition data with denoising autoencoders
    Gjorshoska, Ivana
    Eftimov, Tome
    Trajanov, Dimitar
    [J]. JOURNAL OF FOOD COMPOSITION AND ANALYSIS, 2022, 112
  • [7] Physiological Waveform Imputation of Missing Data using Convolutional Autoencoders
    Miller, Daniel
    Ward, Andrew
    Bambos, Nicholas
    Scheinker, David
    Shin, Andrew
    [J]. 2018 IEEE 20TH INTERNATIONAL CONFERENCE ON E-HEALTH NETWORKING, APPLICATIONS AND SERVICES (HEALTHCOM), 2018,
  • [8] Missing Data Imputation via Denoising Autoencoders: The Untold Story
    Costa, Adriana Fonseca
    Santos, Miriam Seoane
    Soares, Jastin Pompeu
    Abreu, Pedro Henriques
    [J]. ADVANCES IN INTELLIGENT DATA ANALYSIS XVII, IDA 2018, 2018, 11191 : 87 - 98
  • [9] Imputation of Missing Traffic Flow Data Using Denoising Autoencoders
    Jiang, Boyuan
    Siddiqi, Muhammad Danial
    Asadi, Reza
    Regan, Amelia
    [J]. 12TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 4TH INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2021, 184 : 84 - 91
  • [10] Reviewing Autoencoders for Missing Data Imputation: Technical Trends, Applications and Outcomes
    Pereira, Ricardo Cardoso
    Santos, Miriam Seoane
    Rodrigues, Pedro Pereira
    Abreu, Pedro Henriques
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2020, 69 : 1255 - 1285