Multispectral attention-based network for single image deraining

被引:0
|
作者
Gao, Weihao [1 ,2 ]
Zhang, Yongjun [1 ,2 ]
Jian, Huachun [1 ,2 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, Guiyang 550025, Peoples R China
[2] Guizhou Univ, Inst Artificial Intelligence, Coll Comp Sci & Technol, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
关键词
Single image deraining; Feature enhancement; Deep learning; Multispectral attention; RAIN STREAKS REMOVAL; QUALITY ASSESSMENT;
D O I
10.1007/s11760-023-02777-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In challenging weather conditions, rain streaks can significantly degrade captured scenes and negatively impact other low-level tasks. Therefore, researching rain removal tasks is of utmost importance. The diversity of rain streak characteristics, such as different orientations, densities, and magnitudes, makes capturing rain information challenging. To address this issue, this paper introduces a multispectral attention-based network called MSABN, which exhibits exceptional performance in the deraining task. To effectively extract rain information, we design a multispectral attention module (MSAM). Moreover, in complex rainy scenarios, image background information is often distorted, leading to the loss of essential details. To address this, we propose a feature enhancement module (FEM) that extracts background features to compensate for the lost original details. Additionally, we employ a context aggregation mechanism (CAM) to enhance the information flow, thereby optimizing the proposed algorithm's performance. Our MSABN demonstrates superior performance compared to state-of-the-art methods for both synthetic and real-world scenes. Moreover, experiments on semantic segmentation and object detection tasks also show that our method outperforms other comparative algorithms.
引用
收藏
页码:691 / 701
页数:11
相关论文
共 50 条
  • [1] Multispectral attention-based network for single image deraining
    Weihao Gao
    Yongjun Zhang
    Huachun Jian
    [J]. Signal, Image and Video Processing, 2024, 18 : 691 - 701
  • [2] Split frequency attention network for single image deraining
    Hu Bin
    Li Jinhang
    Zhao Lili
    Cheng Shi
    [J]. Signal, Image and Video Processing, 2023, 17 : 3741 - 3748
  • [3] A novel attention-based network for single image dehazing
    Gao, Weihao
    Zhang, Yongjun
    Jian, Huachun
    [J]. VISUAL COMPUTER, 2024, 40 (08): : 5681 - 5693
  • [4] An Attention-Based Network for Single Image HDR Reconstruction
    Dafaallah, Mohamed
    Yuan, Hui
    Jiang, Shiqi
    Yang, Ye
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022,
  • [5] Split frequency attention network for single image deraining
    Bin, Hu
    Jinhang, Li
    Lili, Zhao
    Shi, Cheng
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (07) : 3741 - 3748
  • [6] Complementary Parallel Residual Attention Network for Single Image Deraining
    Gai, Shan
    Yin, Minglei
    Zhi, Yuan
    [J]. CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2024,
  • [7] Lightweight densely connected network based on attention mechanism for single-image deraining
    Chai, Guoqiang
    Wang, Dawei
    Lu, Bin
    Li, Zhu
    [J]. Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2022, 48 (11): : 2186 - 2192
  • [8] Single Image Deraining Using Dual Branch Network Based on Attention Mechanism for IoT
    Wang, Di
    Wei, Bingcai
    Zhang, Liye
    [J]. CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 137 (02): : 1989 - 2000
  • [9] Recurrent RLCN-Guided Attention Network for Single Image Deraining
    Li, Yizhou
    Monno, Yusuke
    Okutomi, Masatoshi
    [J]. PROCEEDINGS OF 17TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA 2021), 2021,
  • [10] WAVELET CHANNEL ATTENTION MODULE WITH A FUSION NETWORK FOR SINGLE IMAGE DERAINING
    Yang, Hao-Hsiang
    Yang, Chao-Han Huck
    Wang, Yu-Chiang Frank
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 883 - 887