Reconstruction of incomplete wildfire data using deep generative models

被引:3
|
作者
Ivek, Tomislav [1 ]
Vlah, Domagoj [2 ]
机构
[1] Inst fiziku, Bijenicka 46, HR-10000 Zagreb, Croatia
[2] Univ Zagreb, Fac Elect Engn & Comp, Dept Appl Math, Unska 3, HR-10000 Zagreb, Croatia
关键词
Data reconstruction; Variational autoencoder; Convolutional neural network; Deep learning; Ensemble; Extreme Value Analysis Conference challenge; Wildfires;
D O I
10.1007/s10687-022-00459-1
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We present our submission to the Extreme Value Analysis 2021 Data Challenge in which teams were asked to accurately predict distributions of wildfire frequency and size within spatio-temporal regions of missing data. For this competition, we developed a variant of the powerful variational autoencoder models, which we call Conditional Missing data Importance-Weighted Autoencoder (CMIWAE). Our deep latent variable generative model requires little to no feature engineering and does not necessarily rely on the specifics of scoring in the Data Challenge. It is fully trained on incomplete data, with the single objective to maximize log-likelihood of the observed wildfire information. We mitigate the effects of the relatively low number of training samples by stochastic sampling from a variational latent variable distribution, as well as by ensembling a set of CMIWAE models trained and validated on different splits of the provided data.
引用
下载
收藏
页码:251 / 271
页数:21
相关论文
共 50 条
  • [31] Adversarial Attacks Against Deep Generative Models on Data: A Survey
    Sun, Hui
    Zhu, Tianqing
    Zhang, Zhiqiu
    Jin, Dawei
    Xiong, Ping
    Zhou, Wanlei
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 3367 - 3388
  • [32] Oversampling Tabular Data with Deep Generative Models: Is it worth the effort?
    Camino, Ramiro D.
    State, Radu
    Hammerschmidt, Christian A.
    NEURIPS WORKSHOPS, 2020, 2020, 137 : 148 - 157
  • [33] A Review of Deep Learning CT Reconstruction From Incomplete Projection Data
    Wang, Tao
    Xia, Wenjun
    Lu, Jingfeng
    Zhang, Yi
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2024, 8 (02) : 138 - 152
  • [34] Diversity in Deep Generative Models and Generative AI
    Turinici, Gabriel
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2023, PT II, 2024, 14506 : 84 - 93
  • [35] Invisible Threats in the Data: A Study on Data Poisoning Attacks in Deep Generative Models
    Yang, Ziying
    Zhang, Jie
    Wang, Wei
    Li, Huan
    Applied Sciences (Switzerland), 2024, 14 (19):
  • [36] Integrating spatial and single-cell transcriptomics data using deep generative models with SpatialScope
    Wan, Xiaomeng
    Xiao, Jiashun
    Tam, Sindy Sing Ting
    Cai, Mingxuan
    Sugimura, Ryohichi
    Wang, Yang
    Wan, Xiang
    Lin, Zhixiang
    Wu, Angela Ruohao
    Yang, Can
    NATURE COMMUNICATIONS, 2023, 14 (01)
  • [37] Distributed Raman Spectrum Data Augmentation System Using Federated Learning with Deep Generative Models
    Kim, Yaeran
    Lee, Woonghee
    SENSORS, 2022, 22 (24)
  • [38] Integrating spatial and single-cell transcriptomics data using deep generative models with SpatialScope
    Xiaomeng Wan
    Jiashun Xiao
    Sindy Sing Ting Tam
    Mingxuan Cai
    Ryohichi Sugimura
    Yang Wang
    Xiang Wan
    Zhixiang Lin
    Angela Ruohao Wu
    Can Yang
    Nature Communications, 14
  • [39] Soil property recovery from incomplete in-situ geotechnical test data using a hybrid deep generative framework
    Chen, Weihang
    Ding, Jianwen
    Wang, Tengfei
    Connolly, David P.
    Wan, Xing
    ENGINEERING GEOLOGY, 2023, 326
  • [40] Wide Aperture Imaging Sonar Reconstruction using Generative Models
    Westman, Eric
    Kaess, Michael
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 8067 - 8074