Detection of earthquake-damaged buildings via UAV high-resolution remote sensing images

被引：0
|
作者：
Wang H. [1 ,2 ]
Zhou C. [1 ,2 ]
Chen X. [3 ]
Yang Y. [1 ,2 ,4 ]
机构：
[1] Information Science and Technology, Yunnan Normal University, Kunming
[2] Laboratory of Pattern Recognition and Artificial Intelligence, Yunnan Normal University, Kunming
[3] Yunnan Province Center of Relief Material Reserve, Kunming
[4] Physics and Electron Information, Yunnan Normal University, Kunming
来源：
National Remote Sensing Bulletin | 2024年 / 28卷 / 04期
基金：
中国国家自然科学基金;
关键词：
change detection; deep learning; earthquake disaster; high-resolution remote sensing images; object detection;
D O I：
10.11834/jrs.20221569
中图分类号：
学科分类号：
摘要：
Natural disasters occur frequently in Yunnan, China and cause enormous losses of life and property. An object detection technology based on the deep learning of remote sensing images can be used to rapidly locate damaged buildings caused by natural disasters and subsequently aid with disaster relief. However, several challenges affect the detection of damaged buildings, such as the lack of data on earthquake-damaged buildings and the weakness of the features of objects to be detected. Thus, a UAV remote-sensing image-based largescale high-resolution earthquake-damaged building database (UEDB) was constructed. A total of 4,598 remote sensing images were collected in the disaster area of Yangbi Yi Autonomous County in Dali Bai Autonomous Prefecture, Yunnan Province, China. The dataset includes 76,012 building instances, with each instance labeled in three formats: an object location box label, an object segmentation label, and an object boundary label. Then, a novel earthquake-damaged buildings real-time detection model (EDBRDM) was constructed. This model includes three modules: object feature alignment (OFAM), feature difference calculation (FDCM), and object boundary constraint-based position box detection. The processing procedure of this model is as follows. Firstly, the OFAM correct the misalignment issues in images taken before and after a disaster, ensuring precise alignment of object features. This crucial step forms the foundation for subsequent feature analysis and difference calculation. Secondly, the FDCM is employed to compute the differences in features, highlighting the damage characteristics of buildings. By comparing the image features before and after the disaster, we can more clearly identify the damage of buildings, providing strong support for subsequent identification and analysis of damaged buildings. Lastly, the OBCPB introduces shallow boundary features into deep features, providing boundary constraints for the prediction of damaged building locations and categories. This step helps enhance detection accuracy, ensuring that we can accurately identify and locate damaged buildings. Through the collaborative effort of these three steps, we can achieve precise detection of damaged buildings. To validate the crucial role of the proposed modules, we delve into the internal operating principles of the model through the lens of feature visualization. Firstly, by comparing the feature changes after OFAM processing, we can clearly observe the significant improvements in the alignment of features across pre- and post-disaster images, demonstrating the effectiveness of OFAM in correcting image offsets. Secondly, by observing the enhancement of damaged building features by FDCM, we find that it effectively highlights the damaged areas of buildings, providing strong support for subsequent identification and analysis of damaged buildings. Finally, through the observation of the boundary constraint effect of OBCPB, we can see how it helps to improve the localization accuracy of the model, ensuring that damaged building objects can be accurately identified. It is noteworthy that our proposed model, EDBRDM, has achieved a remarkable accuracy of 86% on the UEDB test dataset, fully demonstrating its excellent performance. Furthermore, the application of EDBRDM to actual scenes in different locations has also yielded satisfactory results, further validating its effectiveness and reliability in practical applications. © 2024 Science Press. All rights reserved.
引用
收藏
页码：911 / 925
页数：14
相关论文
共 25 条
  • [1] Aamir M, Pu Y F, Rahman Z, Tahir M, Naeem H, Dai Q., A framework for automatic building detection from low-contrast satellite images, Symmetry, 11, 1, (2019)
  • [2] Devaguptapu C, Akolekar N, Sharma M M, Balasubramanian V N., Borrow from anywhere: pseudo multi-modal object detection in thermal imagery, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1029-1038, (2019)
  • [3] Dong Y S, Wang R, He J., Real-time network intrusion detection system based on deep learning, 2019 IEEE 10th International Conference on Software Engineering and Service Science (ICSESS), pp. 1-4, (2019)
  • [4] Fujita S, Hatayama M., Estimation method for roof-damaged buildings from aero-photo images during earthquakes using deep learning, Information Systems Frontiers, 25, 1, pp. 351-363, (2023)
  • [5] Gonzalez-Drigo R, Cabrera E, Luzi G, Pujades L G, Vargas-Alzate Y F, Avila-Haro J., Assessment of post-earthquake damaged building with interferometric real aperture radar, Remote Sensing, 11, 23, (2019)
  • [6] Gupta R, Hosfelt R, Sajeev S, Patel N, Goodman B, Doshi J, Heim E, Choset H, Gaston M., xBD: a dataset for assessing building damage from satellite imagery, (2019)
  • [7] Ji S P, Wei S Q, Lu M., Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set, IEEE Transactions on Geoscience and Remote Sensing, 57, 1, pp. 574-586, (2019)
  • [8] Kampffmeyer M, Salberg A B, Jenssen R., Semantic segmentation of small objects and modeling of uncertainty in urban remote sensing images using deep convolutional neural networks, Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 680-688, (2016)
  • [9] Kuznetsova A, Maleva T, Soloviev V., Detecting apples in orchards using YOLOv3 and YOLOv5 in general and close-up images, 17th International Symposium on Neural Networks, pp. 233-243, (2020)
  • [10] Li Q, Wang W, Wang J F, Zhang J F, Geng D., Exploring the relationship between InSAR coseismic deformation and earthquake-damaged buildings, Remote Sensing of Environment, 262, (2021)
123