Forest Segmentation with Spatial Pyramid Pooling Modules: A Surveillance System Based on Satellite Images

被引:8
|
作者
Ru, Fung Xin [1 ]
Zulkifley, Mohd Asyraf [1 ]
Abdani, Siti Raihanah [2 ]
Spraggon, Martin [3 ]
机构
[1] Univ Kebangsaan Malaysia, Fac Engn & Built Environm, Dept Elect Elect & Syst Engn, Bangi 43600, Selangor, Malaysia
[2] Univ Teknol MARA, Sch Comp Sci, Coll Comp Informat & Media, Shah Alam 40450, Selangor, Malaysia
[3] Rabdan Acad, 65 Al Inshirah,POB 22401, Abu Dhabi, U Arab Emirates
来源
FORESTS | 2023年 / 14卷 / 02期
关键词
automated forest monitoring; machine learning; deep learning; convolutional neural network; semantic segmentation; DEFORESTATION;
D O I
10.3390/f14020405
中图分类号
S7 [林业];
学科分类号
0829 ; 0907 ;
摘要
The global deforestation rate continues to worsen each year, and will eventually lead to various negative consequences for humans and the environment. It is essential to develop an effective forest monitoring system to detect any changes in forest areas, in particular, by monitoring the progress of forest conservation efforts. In general, changes in forest status are difficult to annotate manually, whereby the boundaries can be small in size or hard to discern, especially in areas that are bordering residential areas. The previously implemented forest monitoring systems were ineffective due to their use of low-resolution satellite images and the inefficiency of drone-based data that offer a limited field of view. Most government agencies also still rely on manual annotation, which makes the monitoring process time-consuming, tedious, and expensive. Therefore, the goal of this study is to overcome these issues by developing a forest monitoring system that relies on a robust deep semantic segmentation network that is capable of discerning forest boundaries automatically, so that any changes over the years can be tracked. The backbone of this system is based on satellite imaging supplied to a modified U-Net deep architecture to incorporate multi-scale modules to deliver the semantic segmentation output. A dataset of 6048 Landsat-8 satellite sub-images that were taken from eight land parcels of forest areas was collected and annotated, and then further divided into training and testing datasets. The novelty of this system is the optimal integration of the spatial pyramid pooling (SPP) mechanism into the base model, which allows the model to effectively segment forest areas regardless of their varying sizes, patterns, and colors. To investigate the impact of SPP on the forest segmentation system, a set of experiments was conducted by integrating several variants of SPP ranging from two to four parallel paths with different combinations of pooling kernel size, placed at the bottleneck layer of the U-Net model. The results demonstrated the effectiveness of the SPP module in improving the performance of the forest segmentation system by 2.57%, 6.74%, and 7.75% in accuracy (acc), intersection over union (IoU), and F1-score (F1score), respectively. The best SPP variant consists of four parallel paths with a combination of pooling kernel sizes of 2x2, 4x4, 6x6, and 8x8 pixels that produced the highest acc, IoU, and F1score of 86.71%, 75.59%, and 82.88%, respectively. As a result, the multi-scale module improved the proposed forest segmentation system, making it a highly useful system for government and private agencies in tracking any changes in forest areas.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Semantic Segmentation Method of Autonomous Driving Images Based on Atrous Spatial Pyramid Pooling
    Wang D.
    Liu L.
    Cao J.
    Zhao G.
    Zhao W.
    Tang W.
    Qiche Gongcheng/Automotive Engineering, 2022, 44 (12): : 1818 - 1824
  • [2] Analysis of Spatial Pyramid Pooling Variations in Semantic Segmentation for Satellite Image Applications
    Abdani, Siti Raihanah
    Zulkifley, Mohd Asyraf
    Zulkifley, Nuraisyah Hani
    2021 INTERNATIONAL CONFERENCE ON DECISION AID SCIENCES AND APPLICATION (DASA), 2021,
  • [3] Mixed spatial pyramid pooling for semantic segmentation
    Xia, Zhengyu
    Kim, Joohee
    APPLIED SOFT COMPUTING, 2020, 91
  • [4] Atrous Convolution and Spatial Pyramid Pooling for More Accurate Tumor Segmentation in MR Images
    Men, K.
    Boimel, P.
    Janopaul-Naylor, J.
    Zhong, H.
    Huang, M.
    Geng, H.
    Cheng, C.
    Fan, Y.
    Plastaras, J.
    Ben-Josef, E.
    Xiao, Y.
    MEDICAL PHYSICS, 2018, 45 (06) : E687 - E688
  • [5] Semantic Segmentation Based on Spatial Pyramid Pooling and Multilayer Feature Fusion
    Ji, Jian
    Li, Sitong
    Liao, Xianfu
    Zhang, Fangrong
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (03) : 1524 - 1535
  • [6] Large Kernel Spatial Pyramid Pooling for Semantic Segmentation
    Yang, Jiayi
    Hu, Tianshi
    Yang, Junli
    Zhang, Zhaoxing
    Pan, Yue
    IMAGE AND GRAPHICS, ICIG 2019, PT I, 2019, 11901 : 595 - 605
  • [7] Encoder-decoder with dense dilated spatial pyramid pooling for prostate MR images segmentation
    Geng, Lei
    Wang, Jia
    Xiao, Zhitao
    Tong, Jun
    Zhang, Fang
    Wu, Jun
    COMPUTER ASSISTED SURGERY, 2019, 24 : 13 - 19
  • [8] DeepDisc: Optic Disc Segmentation Based on Atrous Convolution and Spatial Pyramid Pooling
    Gu, Zaiwang
    Liu, Peng
    Zhou, Kang
    Jiang, Yuming
    Mao, Haoyu
    Cheng, Jun
    Liu, Jiang
    COMPUTATIONAL PATHOLOGY AND OPHTHALMIC MEDICAL IMAGE ANALYSIS, 2018, 11039 : 253 - 260
  • [9] White blood segmentation based on dual path and atrous spatial pyramid pooling
    Li Z.
    Lu Y.
    Cao X.
    Qiu L.
    Qin X.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2022, 39 (03): : 471 - 479
  • [10] Fusion network based on the dual attention mechanism and atrous spatial pyramid pooling for automatic segmentation in retinal vessel images
    Liang, Bingtao
    Tang, Chen
    Xu, Min
    Wu, Tianbo
    Lei, Zhenkun
    Journal of the Optical Society of America A: Optics and Image Science, and Vision, 2022, 39 (08): : 1393 - 1402