Comparative Study of Real-Time Semantic Segmentation Networks in Aerial Images During Flooding Events

被引:13
|
作者
Safavi, Farshad [1 ]
Rahnemoonfar, Maryam [2 ,3 ]
机构
[1] Univ Maryland Baltimore Cty, Comp Sci & Elect Engn, Baltimore, MD 21250 USA
[2] Lehigh Univ, Dept Comp Sci & Engn, Bethlehem, PA 18015 USA
[3] Lehigh Univ, Dept Civil & Environm Engn, Bethlehem, PA 18015 USA
关键词
Deep learning; Semantics; postdisaster assessment; real-time semantic segmentation; unmanned ariel vehicle (UAV) aerial imagery; DEEP; FRAMEWORK;
D O I
10.1109/JSTARS.2022.3219724
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Real-time semantic segmentation of aerial imagery is essential for unmanned ariel vehicle applications, including military surveillance, land characterization, and disaster damage assessments. Recent real-time semantic segmentation neural networks promise low computation and inference time, appropriate for resource-limited platforms, such as edge devices. However, these methods are mainly trained on human-centric view datasets, such as Cityscapes and CamVid, unsuitable for aerial applications. Furthermore, we do not know the feasibility of these models under adversarial settings, such as flooding events. To solve these problems, we train the most recent real-time semantic segmentation architectures on the FloodNet dataset containing annotated aerial images captured after hurricane Harvey. This article comprehensively studies several lightweight architectures, including encoder-decoder and two-pathway architectures, evaluating their performance on aerial imagery datasets. Moreover, we benchmark the efficiency and accuracy of different models on the FloodNet dataset to examine the practicability of these models during emergency response for aerial image segmentation. Some lightweight models attain more than 60% test mIoU on the FloodNet dataset and yield qualitative results on images. This article highlights the strengths and weaknesses of current segmentation models for aerial imagery, requiring low computation and inference time. Our experiment has direct applications during catastrophic events, such as flooding events.
引用
收藏
页码:15 / 31
页数:17
相关论文
共 50 条
  • [1] Comparative Study Between Real-Time and Non-Real-Time Segmentation Models on Flooding Events
    Safavi, Farshad
    Chowdhury, Tashnim
    Rahnemoonfar, Maryam
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 4199 - 4207
  • [2] RTSEG: REAL-TIME SEMANTIC SEGMENTATION COMPARATIVE STUDY
    Siam, Mennatullah
    Gamal, Mostafa
    Abdel-Razek, Moemen
    Yogamani, Senthil
    Jagersand, Martin
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 1603 - 1607
  • [3] A REAL-TIME SEMANTIC SEGMENTATION ALGORITHM FOR AERIAL IMAGERY
    Blokhinov, Y. B.
    Gorbachev, V. A.
    Rakutin, Y. O.
    Nikitin, D. A.
    [J]. COMPUTER OPTICS, 2018, 42 (01) : 141 - 148
  • [4] A Comparative Study of Real-time Semantic Segmentation for Autonomous Driving
    Siam, Mennatullah
    Gamal, Mostafa
    Abdel-Razek, Moemen
    Yogamani, Senthil
    Jagersand, Martin
    Zhang, Hong
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 700 - 710
  • [5] A Comparative Study of Deep Neural Networks for Real-Time Semantic Segmentation during the Transurethral Resection of Bladder Tumors
    Varnyu, Dora
    Szirmay-Kalos, Laszlo
    [J]. DIAGNOSTICS, 2022, 12 (11)
  • [6] Real-Time Semantic Segmentation A brief survey and comparative study in remote sensing
    Broni-Bediako, Clifford
    Xia, Junshi
    Yokoya, Naoto
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2023, 11 (04) : 94 - 124
  • [7] Aerial-BiSeNet: A real-time semantic segmentation network for high resolution aerial imagery
    Fang WANG
    Xiaoyan LUO
    Qixiong WANG
    Lu LI
    [J]. Chinese Journal of Aeronautics , 2021, (09) : 47 - 59
  • [8] Aerial-BiSeNet: A real-time semantic segmentation network for high resolution aerial imagery
    Fang WANG
    Xiaoyan LUO
    Qixiong WANG
    Lu LI
    [J]. Chinese Journal of Aeronautics, 2021, 34 (09) : 47 - 59
  • [9] Aerial-BiSeNet: A real-time semantic segmentation network for high resolution aerial imagery
    Wang, Fang
    Luo, Xiaoyan
    Wang, Qixiong
    Li, Lu
    [J]. CHINESE JOURNAL OF AERONAUTICS, 2021, 34 (09) : 47 - 59
  • [10] Real-time reliable semantic segmentation of thyroid nodules in ultrasound images
    Xing, Guangxin
    Wang, Shuaijie
    Gao, Jie
    Li, Xuewei
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (02):