Post-Disaster Building Damage Detection from Earth Observation Imagery Using Unsupervised and Transferable Anomaly Detecting Generative Adversarial Networks

被引:35
|
作者
Tilon, Sofia [1 ]
Nex, Francesco [1 ]
Kerle, Norman [1 ]
Vosselman, George [1 ]
机构
[1] Univ Twente, Fac Geoinformat Sci & Earth Observat ITC, NL-7514 AE Enschede, Netherlands
关键词
deep learning; Generative Adversarial Networks; post-disaster; building damage assessment; anomaly detection; Unmanned Aerial Vehicles (UAV); satellite; xBD;
D O I
10.3390/rs12244193
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
We present an unsupervised deep learning approach for post-disaster building damage detection that can transfer to different typologies of damage or geographical locations. Previous advances in this direction were limited by insufficient qualitative training data. We propose to use a state-of-the-art Anomaly Detecting Generative Adversarial Network (ADGAN) because it only requires pre-event imagery of buildings in their undamaged state. This approach aids the post-disaster response phase because the model can be developed in the pre-event phase and rapidly deployed in the post-event phase. We used the xBD dataset, containing pre- and post- event satellite imagery of several disaster-types, and a custom made Unmanned Aerial Vehicle (UAV) dataset, containing post-earthquake imagery. Results showed that models trained on UAV-imagery were capable of detecting earthquake-induced damage. The best performing model for European locations obtained a recall, precision and F1-score of 0.59, 0.97 and 0.74, respectively. Models trained on satellite imagery were capable of detecting damage on the condition that the training dataset was void of vegetation and shadows. In this manner, the best performing model for (wild)fire events yielded a recall, precision and F1-score of 0.78, 0.99 and 0.87, respectively. Compared to other supervised and/or multi-epoch approaches, our results are encouraging. Moreover, in addition to image classifications, we show how contextual information can be used to create detailed damage maps without the need of a dedicated multi-task deep learning framework. Finally, we formulate practical guidelines to apply this single-epoch and unsupervised method to real-world applications.
引用
收藏
页码:1 / 27
页数:27
相关论文
共 16 条
  • [1] Unsupervised anomaly detection for underwater gliders using generative adversarial networks
    Wu, Peng
    Harris, Catherine A.
    Salavasidis, Georgios
    Lorenzo-Lopez, Alvaro
    Kamarudzaman, Izzat
    Phillips, Alexander B.
    Thomas, Giles
    Anderlini, Enrico
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 104
  • [2] Unsupervised anomaly detection for underwater gliders using generative adversarial networks
    Wu, Peng
    Harris, Catherine A.
    Salavasidis, Georgios
    Lorenzo-Lopez, Alvaro
    Kamarudzaman, Izzat
    Phillips, Alexander B.
    Thomas, Giles
    Anderlini, Enrico
    [J]. Engineering Applications of Artificial Intelligence, 2021, 104
  • [3] Unsupervised domain adaptation with self-attention for post-disaster building damage detection
    Li, Yundong
    Lin, Chen
    Li, Hongguang
    Hu, Wei
    Dong, Han
    Liu, Yi
    [J]. NEUROCOMPUTING, 2020, 415 : 27 - 39
  • [4] Unsupervised anomaly detection using generative adversarial networks in 1H-MRS of the brain
    Jang, Joon
    Lee, Hyeong Hun
    Park, Ji-Ae
    Kim, Hyeonjin
    [J]. Journal of Magnetic Resonance, 2021, 325
  • [5] Unsupervised anomaly detection using generative adversarial networks in 1H-MRS of the brain
    Jang, Joon
    Lee, Hyeong Hun
    Park, Ji-Ae
    Kim, Hyeonjin
    [J]. JOURNAL OF MAGNETIC RESONANCE, 2021, 325
  • [6] On the Deployment of Post-Disaster Building Damage Assessment Tools using Satellite Imagery: A Deep Learning Approach
    Gholami, Shahrzad
    Robinson, Caleb
    Ortiz, Anthony
    Yang, Siyu
    Margutti, Jacopo
    Birge, Cameron
    Dodhia, Rahul
    Ferres, Juan Lavista
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW, 2022, : 1029 - 1036
  • [7] Post-disaster building damage detection using multi-source variational domain adaptation
    Li, Yundong
    Yan, Yunlong
    Wang, Xiang
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2024, 46 (01) : 389 - 404
  • [8] Automated method for detection and quantification of building damage and debris using post-disaster LiDAR data
    Labiak, Richard C.
    van Aardt, Jan A. N.
    Bespalov, Dmitry
    Eychner, Darryl
    Wirch, Erin
    Bischof, Hans-Peter
    [J]. LASER RADAR TECHNOLOGY AND APPLICATIONS XVI, 2011, 8037
  • [9] Real-time anomaly detection for ‘Remote’ bus stop surveillance using unsupervised conditional generative adversarial networks
    Beihao Xi
    Qingkui Chen
    [J]. Neural Computing and Applications, 2024, 36 (25) : 15799 - 15813
  • [10] TSI-GAN: Unsupervised Time Series Anomaly Detection Using Convolutional Cycle-Consistent Generative Adversarial Networks
    Saravanan, Shyam Sundar
    Luo, Tie
    Ngo, Mao Van
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT I, 2023, 13935 : 39 - 54