Coastal Aquaculture Area Extraction Based on Self-Attention Mechanism and Auxiliary Loss

被引:10
|
作者
Ai, Bo [1 ]
Xiao, Heng [1 ]
Xu, Hanwen [1 ]
Yuan, Feng [2 ]
Ling, Mengyun
机构
[1] Shandong Univ Sci & Technol, Coll Geodesy & Geomat, Qingdao 266590, Peoples R China
[2] Guangdong Ocean Univ, Guangdong Ocean Dev Planning Res Ctr, Guangzhou 510220, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Aquaculture; Satellites; Neural networks; Image segmentation; Data mining; Sea measurements; Aquaculture area extraction; auxiliary loss; self-attention mechanism; deep learning;
D O I
10.1109/JSTARS.2022.3230081
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the development of deep learning in satellite remote sensing image segmentation, convolutional neural networks have achieved better results than traditional methods. In some full convolutional networks, the number of network layers usually increases to obtain deep features, but the gradient disappearance problem occurs when the number of network layers deepens. Many scholars have obtained multiscale features by using different convolutional calculations. We want to obtain multiscale features in the network structure while obtaining contextual information by other means. This article employs the self-attention mechanism and auxiliary loss network (SAMALNet) structure to solve the above problems. We adopt the self-attention strategy in the atrous spatial pyramid pooling module to extract multiscale features while considering the contextual information. We add auxiliary loss to overcome the gradient disappearance problem. The experimental results of extracting aquaculture areas in the Jiaozhou Bay area of Qingdao from high-resolution GF-2 satellite images show that, in general, SAMALNet achieves better experimental results compared with UPS-Net, SegNet, DeepLabv3, UNet, DeepLabv3+, and PSPNet network structures, including recall 96.34%, precision 95.91%, F1 score 96.12%, and MIoU 92.60%. SAMALNet achieved better results extracting aquaculture area boundaries than the other network structures listed above. The high accuracy of the aquaculture area can provide data support for the rational planning and environmental protection of the coastal aquaculture area and promote more rational usage of the coastal aquaculture area.
引用
收藏
页码:2250 / 2261
页数:12
相关论文
共 50 条
  • [1] Unsupervised Pansharpening Based on Self-Attention Mechanism
    Qu, Ying
    Baghbaderani, Razieh Kaviani
    Qi, Hairong
    Kwan, Chiman
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (04): : 3192 - 3208
  • [2] Keyphrase Generation Based on Self-Attention Mechanism
    Yang, Kehua
    Wang, Yaodong
    Zhang, Wei
    Yao, Jiqing
    Le, Yuquan
    CMC-COMPUTERS MATERIALS & CONTINUA, 2019, 61 (02): : 569 - 581
  • [3] Chinese medical relation extraction based on multi-hop self-attention mechanism
    Tongxuan Zhang
    Hongfei Lin
    Michael M. Tadesse
    Yuqi Ren
    Xiaodong Duan
    Bo Xu
    International Journal of Machine Learning and Cybernetics, 2021, 12 : 355 - 363
  • [4] Chinese medical relation extraction based on multi-hop self-attention mechanism
    Zhang, Tongxuan
    Lin, Hongfei
    Tadesse, Michael M.
    Ren, Yuqi
    Duan, Xiaodong
    Xu, Bo
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2021, 12 (02) : 355 - 363
  • [5] Face Inpainting Based on Dual Self-attention Mechanism
    Yue H.
    Liao L.
    Yang J.
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2023, 50 (08): : 32 - 41
  • [6] Multimodal Fusion Method Based on Self-Attention Mechanism
    Zhu, Hu
    Wang, Ze
    Shi, Yu
    Hua, Yingying
    Xu, Guoxia
    Deng, Lizhen
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2020, 2020
  • [7] Double Attention: An Optimization Method for the Self-Attention Mechanism Based on Human Attention
    Zhang, Zeyu
    Li, Bin
    Yan, Chenyang
    Furuichi, Kengo
    Todo, Yuki
    BIOMIMETICS, 2025, 10 (01)
  • [8] Deepfake face discrimination based on self-attention mechanism
    Wang, Shuai
    Zhu, Donghui
    Chen, Jian
    Bi, Jiangbo
    Wang, Wenyi
    PATTERN RECOGNITION LETTERS, 2024, 183 : 92 - 97
  • [9] Web service classification based on self-attention mechanism
    Jia, Zhichun
    Zhang, Zhiying
    Dong, Rui
    Yang, Zhongxuan
    Xing, Xing
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 2164 - 2169
  • [10] Piecewise convolutional neural network relation extraction with self-attention mechanism
    Zhang, Bo
    Xu, Li
    Liu, Ke-Hao
    Yang, Ru
    Li, Mao-Zhen
    Guo, Xiao-Yang
    PATTERN RECOGNITION, 2025, 159