Reconstruction of incomplete wildfire data using deep generative models

被引:3
|
作者
Ivek, Tomislav [1 ]
Vlah, Domagoj [2 ]
机构
[1] Inst fiziku, Bijenicka 46, HR-10000 Zagreb, Croatia
[2] Univ Zagreb, Fac Elect Engn & Comp, Dept Appl Math, Unska 3, HR-10000 Zagreb, Croatia
关键词
Data reconstruction; Variational autoencoder; Convolutional neural network; Deep learning; Ensemble; Extreme Value Analysis Conference challenge; Wildfires;
D O I
10.1007/s10687-022-00459-1
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We present our submission to the Extreme Value Analysis 2021 Data Challenge in which teams were asked to accurately predict distributions of wildfire frequency and size within spatio-temporal regions of missing data. For this competition, we developed a variant of the powerful variational autoencoder models, which we call Conditional Missing data Importance-Weighted Autoencoder (CMIWAE). Our deep latent variable generative model requires little to no feature engineering and does not necessarily rely on the specifics of scoring in the Data Challenge. It is fully trained on incomplete data, with the single objective to maximize log-likelihood of the observed wildfire information. We mitigate the effects of the relatively low number of training samples by stochastic sampling from a variational latent variable distribution, as well as by ensembling a set of CMIWAE models trained and validated on different splits of the provided data.
引用
下载
收藏
页码:251 / 271
页数:21
相关论文
共 50 条
  • [1] Reconstruction of incomplete wildfire data using deep generative models
    Tomislav Ivek
    Domagoj Vlah
    Extremes, 2023, 26 : 251 - 271
  • [2] Training Deep Generative Models in Highly Incomplete Data Scenarios with Prior Regularization
    Bernal, Edgar A.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2631 - 2641
  • [3] Reconstruction of structured models using incomplete measured data
    Yu, Yan
    Dong, Bo
    Yu, Bo
    STRUCTURAL ENGINEERING AND MECHANICS, 2017, 62 (03) : 303 - 310
  • [4] MIWAE: Deep Generative Modelling and Imputation of Incomplete Data Sets
    Mattei, Pierre-Alexandre
    Frellsen, Jes
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [5] Approximate Query Processing for Data Exploration using Deep Generative Models
    Thirumuruganathan, Saravanan
    Hasan, Shohedul
    Koudas, Nick
    Das, Gautam
    2020 IEEE 36TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2020), 2020, : 1309 - 1320
  • [6] Deep Generative Models for Synthetic Data: A Survey
    Eigenschink, Peter
    Reutterer, Thomas
    Vamosi, Stefan
    Vamosi, Ralf
    Sun, Chang
    Kalcher, Klaudius
    IEEE ACCESS, 2023, 11 : 47304 - 47320
  • [7] Implications of data topology for deep generative models
    Jin, Yinzhu
    Mcdaniel, Rory
    Tatro, N. Joseph
    Catanzaro, Michael J.
    Smith, Abraham D.
    Bendich, Paul
    Dwyer, Matthew B.
    Fletcher, P. Thomas
    FRONTIERS IN COMPUTER SCIENCE, 2024, 6
  • [8] Noise-robust latent vector reconstruction in ptychography using deep generative models
    Seifert, Jacob
    Shao, Yifeng
    Mosk, Llard P.
    OPTICS EXPRESS, 2024, 32 (01) : 1020 - 1033
  • [9] IDHashGAN: Deep Hashing With Generative Adversarial Nets for Incomplete Data Retrieval
    Xu, Liming
    Zeng, Xianhua
    Li, Weisheng
    Bai, Ling
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 534 - 545
  • [10] Oversampling Highly Imbalanced Indoor Positioning Data using Deep Generative Models
    Alhomayani, Fahad
    Mahoor, Mohammad H.
    2021 IEEE SENSORS, 2021,