A Deep Learning Network for Individual Tree Segmentation in UAV Images with a Coupled CSPNet and Attention Mechanism

被引:10
|
作者
Lv, Lujin [1 ,2 ,3 ]
Li, Xuejian [1 ,2 ,3 ]
Mao, Fangjie [1 ,2 ,3 ]
Zhou, Lv [4 ]
Xuan, Jie [1 ,2 ,3 ]
Zhao, Yinyin [1 ,2 ,3 ]
Yu, Jiacong [1 ,2 ,3 ]
Song, Meixuan [1 ,2 ,3 ]
Huang, Lei [1 ,2 ,3 ]
Du, Huaqiang [1 ,2 ,3 ]
机构
[1] Zhejiang A&F Univ, State Key Lab Subtrop Silviculture, Hangzhou 311300, Peoples R China
[2] Zhejiang A&F Univ, Key Lab Carbon Cycling Forest Ecosyst & Carbon Seq, Hangzhou 311300, Peoples R China
[3] Zhejiang A&F Univ, Sch Environm & Resources Sci, Hangzhou 311300, Peoples R China
[4] Beijing Forestry Univ, Res Ctr Forest Management Engn State Forestry & Gr, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
individual tree detection; Mask R-CNN; urban forest; deep learning; UAV; attention mechanism; CONVOLUTIONAL NEURAL-NETWORKS; CROWN DELINEATION; EXTRACTION; URBAN; CNN;
D O I
10.3390/rs15184420
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Accurate individual tree detection by unmanned aerial vehicles (UAVs) is a critical technique for smart forest management and serves as the foundation for evaluating ecological functions. Existing object detection and segmentation methods, on the other hand, have reduced accuracy when detecting and segmenting individual trees in complicated urban forest landscapes, as well as poor mask segmentation quality. This study proposes a novel Mask-CSP-attention-coupled network (MCAN) based on the Mask R-CNN algorithm. MCAN uses the Cross Stage Partial Net (CSPNet) framework with the Sigmoid Linear Unit (SiLU) activation function in the backbone network to form a new Cross Stage Partial Residual Net (CSPResNet) and employs a convolutional block attention module (CBAM) mechanism to the feature pyramid network (FPN) for feature fusion and multiscale segmentation to further improve the feature extraction ability of the model, enhance its detail information detection ability, and improve its individual tree detection accuracy. In this study, aerial photography of the study area was conducted by UAVs, and the acquired images were used to produce a dataset for training and validation. The method was compared with the Mask Region-based Convolutional Neural Network (Mask R-CNN), Faster Region-based Convolutional Neural Network (Faster R-CNN), and You Only Look Once v5 (YOLOv5) on the test set. In addition, four scenes-namely, a dense forest distribution, building forest intersection, street trees, and active plaza vegetation-were set up, and the improved segmentation network was used to perform individual tree segmentation on these scenes to test the large-scale segmentation ability of the model. MCAN's average precision (AP) value for individual tree identification is 92.40%, which is 3.7%, 3.84%, and 12.53% better than that of Mask R-CNN, Faster R-CNN, and YOLOv5, respectively. In comparison to Mask R-CNN, the segmentation AP value is 97.70%, an increase of 8.9%. The segmentation network's precision for the four scenes in multi-scene segmentation ranges from 95.55% to 92.33%, showing that the proposed network performs high-precision segmentation in many contexts.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Individual Tree Segmentation Quality Evaluation Using Deep Learning Models LiDAR Based
    I. A. Grishin
    T. Y. Krutov
    A. I. Kanev
    V. I. Terekhov
    Optical Memory and Neural Networks, 2023, 32 : S270 - S276
  • [32] Individual Tree Segmentation Quality Evaluation Using Deep Learning Models LiDAR Based
    Grishin, I. A.
    Krutov, T. Y.
    Kanev, A. I.
    Terekhov, V. I.
    OPTICAL MEMORY AND NEURAL NETWORKS, 2023, 32 (Suppl 2) : S270 - S276
  • [33] VISN: virus instance segmentation network for TEM images using deep attention transformer
    Xiao, Chi
    Wang, Jun
    Yang, Shenrong
    Heng, Minxin
    Su, Junyi
    Xiao, Hao
    Song, Jingdong
    Li, Weifu
    BRIEFINGS IN BIOINFORMATICS, 2023, 24 (06)
  • [34] A New Deep Learning Network for Automatic Bridge Detection from SAR Images Based on Balanced and Attention Mechanism
    Chen, Lifu
    Weng, Ting
    Xing, Jin
    Pan, Zhouhao
    Yuan, Zhihui
    Xing, Xuemin
    Zhang, Peng
    REMOTE SENSING, 2020, 12 (03)
  • [35] Development of Deep Learning Pavement Extraction and Crack Segmentation Algorithms to Analyze UAV Images of Roadways
    Moon, Byungkyu
    Lee, Hosin
    INTERNATIONAL CONFERENCE ON TRANSPORTATION AND DEVELOPMENT 2023: TRANSPORTATION SAFETY AND EMERGING TECHNOLOGIES, 2023, : 392 - 399
  • [36] Development of Deep Learning Pavement Extraction and Crack Segmentation Algorithms to Analyze UAV Images of Roadways
    Moon, Byungkyu
    Lee, Hosin David
    JOURNAL OF INFRASTRUCTURE SYSTEMS, 2024, 30 (03)
  • [37] A Lightweight Deep Learning Architecture for Vegetation Segmentation using UAV-captured Aerial Images
    Behera, Tanmay Kumar
    Bakshi, Sambit
    Sa, Pankaj Kumar
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2023, 37
  • [38] Research progress on deep learning methods for object detection and semantic segmentation in UAV aerial images
    Luo X.
    Wu Y.
    Chen J.
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2024, 45 (06):
  • [39] Dual attention deep learning network for automatic steel surface defect segmentation
    Pan, Y.
    Zhang, L.
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2022, 37 (11) : 1468 - 1487
  • [40] ATTENTION-ENRICHED DEEP LEARNING MODEL FOR BREAST TUMOR SEGMENTATION IN ULTRASOUND IMAGES
    Vakanski, Aleksandar
    Xian, Min
    Freer, Phoebe E.
    ULTRASOUND IN MEDICINE AND BIOLOGY, 2020, 46 (10): : 2819 - 2833