A self-attention multi-scale convolutional neural network method for SAR image despeckling

被引:8
|
作者
Wen, Zhiqing [1 ,2 ,3 ]
He, Yi [1 ,2 ,3 ,4 ]
Yao, Sheng [1 ,2 ,3 ]
Yang, Wang [1 ,2 ,3 ]
Zhang, Lifeng [1 ,2 ,3 ]
机构
[1] Lanzhou Jiaotong Univ, Fac Geomat, Lanzhou, Peoples R China
[2] Lanzhou Jiaotong Univ, Natl Local Joint Engn Res Ctr Technol & Applicat N, Lanzhou, Peoples R China
[3] Lanzhou Jiaotong Univ, Gansu Prov Engn Lab Natl Geog State Monitoring, Lanzhou, Peoples R China
[4] Lanzhou Jiaotong Univ, Fac Geomat, Duxing Bldg, 88 Anning West Rd, Lanzhou 1513, Peoples R China
关键词
Convolutional neural network; attention mechanism; multi-scale features; SAR image despeckling; QUALITY ASSESSMENT; WAVELET ENERGY; DEEP CNN; SEGMENTATION; NOISE; MODEL;
D O I
10.1080/01431161.2023.2173029
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The speckle noise found in synthetic aperture radar (SAR) images severely affects the efficiency of image interpretation, retrieval and other applications. Thus, effective methods for despeckling SAR image are required. The traditional methods for SAR image despeckling fail to balance in terms of the relationship between the intensity of speckle noise filtering and the retention of texture details. Deep learning based SAR image despeckling methods have been shown to have the potential to achieve this balance. Therefore, this study proposes a self-attention multi-scale convolution neural network (SAMSCNN) method for SAR image despeckling. The advantage of the SAMSCNN method is that it considers both multi-scale feature extraction and channel attention mechanisms for multi-scale fused features. In the SAMSCNN method, multi-scale features are extracted from SAR images through convolution layers with different depths. These are concatenated; then, and an attention mechanism is introduced to assign different weights to features of different scales, obtaining multi-scale fused features with weights. Finally, the despeckled SAR image is generated through global residual noise reduction and image structure fine-tuning. The despeckling experiments in this study involved a variety of scenes using simulated and real data. The performance of the proposed model was analysed using quantitative and qualitative evaluation methods and compared to probabilistic patch-based (PPB), SAR block-matching 3-D (SAR-BM3D) and SAR-CNN methods. The experimental results show that the method proposed in this paper improves the objective indexes and shows great advantages in visual effects compared to these classical methods. The method proposed in this study can provide key technical support for the practical application of SAR images.
引用
收藏
页码:902 / 923
页数:22
相关论文
共 50 条
  • [1] Multi-scale Convolutional Neural Network for SAR Image Semantic Segmentation
    Duan, Yiping
    Tao, Xiaoming
    Han, Chaoyi
    Qin, Xiaowei
    Lu, Jianhua
    [J]. 2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [2] SAR Image Despeckling Using a Convolutional Neural Network
    Wang, Puyang
    Zhang, He
    Patel, Vishal M.
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (12) : 1763 - 1767
  • [3] Multi-scale self-attention generative adversarial network for pathology image restoration
    Liang, Meiyan
    Zhang, Qiannan
    Wang, Guogang
    Xu, Na
    Wang, Lin
    Liu, Haishun
    Zhang, Cunlin
    [J]. VISUAL COMPUTER, 2023, 39 (09): : 4305 - 4321
  • [4] Multi-scale self-attention generative adversarial network for pathology image restoration
    Meiyan Liang
    Qiannan Zhang
    Guogang Wang
    Na Xu
    Lin Wang
    Haishun Liu
    Cunlin Zhang
    [J]. The Visual Computer, 2023, 39 : 4305 - 4321
  • [5] Image Classification based on Self-attention Convolutional Neural Network
    Cai, Xiaohong
    Li, Ming
    Cao, Hui
    Ma, Jingang
    Wang, Xiaoyan
    Zhuang, Xuqiang
    [J]. SIXTH INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2021, 11913
  • [6] Image Classification Method Based on Multi-Scale Convolutional Neural Network
    Du, Shaobo
    Li, Jing
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (10)
  • [7] Remaining Useful Life Prediction of Bearings Based on Multi-head Self-attention Mechanism, Multi-scale Temporal Convolutional Network and Convolutional Neural Network
    Wei, Hao
    Gu, Yu
    Zhang, Qinghua
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3027 - 3032
  • [8] Multi-Scale Self-Attention Network for Denoising Medical Images
    Lee, Kyungsu
    Lee, Haeyun
    Lee, Moon Hwan
    Chang, Jin Ho
    Kuo, C. -C. Jay
    Oh, Seung-June
    Woo, Jonghye
    Hwang, Jae Youn
    [J]. APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2023, 12 (05) : 1 - 26
  • [9] A MULTI-SCALE SELF-ATTENTION NETWORK TO DISCRIMINATE PULMONARY NODULES
    Moreno, Alejandra
    Rueda, Andrea
    Martinez, Fabio
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [10] Self-attention convolutional neural network for improved MR image reconstruction
    Wu, Yan
    Ma, Yajun
    Liu, Jing
    Du, Jiang
    Xing, Lei
    [J]. INFORMATION SCIENCES, 2019, 490 : 317 - 328