Variational Autoencoders for Missing Data Imputation with Application to a Simulated Milling Circuit

被引:62
|
作者
McCoy, John T. [1 ]
Kroon, Steve [2 ]
Auret, Lidia [1 ]
机构
[1] Stellenbosch Univ, Dept Proc Engn, Private Bag X1, ZA-7602 Matieland, South Africa
[2] Stellenbosch Univ, Div Comp Sci, Private Bag X1, ZA-7602 Matieland, South Africa
来源
IFAC PAPERSONLINE | 2018年 / 51卷 / 21期
关键词
Missing Data Imputation; Machine Learning; Variational Autoencoder; FAULT-DIAGNOSIS; MODEL;
D O I
10.1016/j.ifacol.2018.09.406
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Missing data values and differing sampling rates, particularly for important parameters such as particle size and stream composition, are a common problem in minerals processing plants. Missing data imputation is used to avoid information loss (due to downsampling or discarding incomplete records). A recent deep -learning technique, variational autoencoders (VAEs), has been used for missing data imputation in image data, and was compared here to imputation by mean replacement and by principal component analysis (PCA) imputation. The techniques were compared using a synthetic, nonlinear dataset, and a simulated milling circuit dataset, which included process disturbances, measurement noise, and feedback control. Each dataset was corrupted with missing values in 20% of records (lightly corrupted) and in 90% of records (heavily corrupted). For both lightly and heavily corrupted datasets, the root mean squared error of prediction for VAE imputation was lower than the traditional methods. Possibilities for the extension of missing data imputation to inferential sensing are discussed. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.
引用
收藏
页码:141 / 146
页数:6
相关论文
共 50 条
  • [21] Missing-Data Imputation With Position-Encoding Denoising Autoencoders for Industrial Processes
    Ou, Chen
    Zhu, Hongqiu
    Shardt, Yuri A. W.
    Ye, Lingjian
    Yuan, Xiaofeng
    Wang, Yalin
    Yang, Chunhua
    Gui, Weihua
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [22] Non-linear missing data imputation for healthcare data via index-aware autoencoders
    Sadaf Kabir
    Leily Farrokhvar
    [J]. Health Care Management Science, 2022, 25 : 484 - 497
  • [23] Non-linear missing data imputation for healthcare data via index-aware autoencoders
    Kabir, Sadaf
    Farrokhvar, Leily
    [J]. HEALTH CARE MANAGEMENT SCIENCE, 2022, 25 (03) : 484 - 497
  • [24] Learning conditional variational autoencoders with missing covariates
    Ramchandran, Siddharth
    Tikhonov, Gleb
    Lonnroth, Otto
    Tiikkainen, Pekka
    Lahdesmaki, Harri
    [J]. PATTERN RECOGNITION, 2024, 147
  • [25] Missing data imputation and sensor self-validation towards a sustainable operation of wastewater treatment plants via deep variational residual autoencoders
    Ba-Alawi, Abdulrahman H.
    Loy-Benitez, Jorge
    Kim, SangYun
    Yoo, ChangKyoo
    [J]. CHEMOSPHERE, 2022, 288
  • [26] Application of Multiple Imputation Method for Missing Data Estimation
    Ser, Gazel
    [J]. GAZI UNIVERSITY JOURNAL OF SCIENCE, 2012, 25 (04): : 869 - 873
  • [27] Conservative Policy Construction Using Variational Autoencoders for Logged Data With Missing Values
    Abroshan, Mahed
    Yip, Kai Hou
    Tekin, Cem
    van der Schaar, Mihaela
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) : 6368 - 6378
  • [28] Application and Comparison of Imputation Methods for Missing Degradation Data
    Fan, Ye
    Sun, Fuqiang
    Jiang, Tongmin
    [J]. ENGINEERING ASSET MANAGEMENT - SYSTEMS, PROFESSIONAL PRACTICES AND CERTIFICATION, 2015, : 1607 - 1614
  • [29] IMPUTATION OF MISSING DATA
    Lunt, M.
    [J]. ANNALS OF THE RHEUMATIC DISEASES, 2014, 73 : 49 - 49
  • [30] Unsupervised Imputation of Non-Ignorably Missing Data Using Importance-Weighted Autoencoders
    Lim, David K.
    Rashid, Naim U.
    Oliva, Junier B.
    Ibrahim, Joseph G.
    [J]. STATISTICS IN BIOPHARMACEUTICAL RESEARCH, 2024,