Encoder-decoder Network with Self-attention Module for Image Restoration

被引:0
|
作者
Jin, Qing [1 ]
Yu, Qi [1 ]
Liu, Jiying [1 ]
Tan, Xintong [1 ]
机构
[1] Natl Univ Def Technol, Coll Liberal Arts & Sci, Changsha, Peoples R China
关键词
self-attention; Linknet; pyramid pooling network; BoTNet; image restoration; VISION;
D O I
10.1117/12.2623391
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Due to the absorption and scattering effect of the atmosphere, it is difficult to extract effective target information from the image sensor under severe hazy conditions. We propose an end-to-end convolutional neural network designed to solve the problem of image restoration in scattering imaging. And we explicitly consider the atmospheric scattering model of the hazing process in the network design. The encoder and decoder modules are used for feature extraction, and the pyramid pooling network is used to preserve the multi-scale features of the image. The attention mechanism is introduced in the network. Encoder module is adopted for BoTNet that incorporates self-attention for multiple computer vision tasks. Due to the lack of real hazy images, we collected scattered images under low visibility conditions and corresponding haze-free images. We examine the proposed method by the challenge datasets, the experiments demonstrate that the proposed method can effectively extract and recover the feature information of the target. The results show that, compared with the traditional signal processing method, our model achieves significant practical performance gains and restores the detailed information of the image.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Self-Attention based encoder-Decoder for multistep human density prediction
    Violos, John
    Theodoropoulos, Theodoros
    Maroudis, Angelos-Christos
    Leivadeas, Aris
    Tserpes, Konstantinos
    [J]. JOURNAL OF URBAN MOBILITY, 2022, 2
  • [2] MEDUSA: Multi-Scale Encoder-Decoder Self-Attention Deep Neural Network Architecture for Medical Image Analysis
    Aboutalebi, Hossein
    Pavlova, Maya
    Gunraj, Hayden
    Shafiee, Mohammad Javad
    Sabri, Ali
    Alaref, Amer
    Wong, Alexander
    [J]. FRONTIERS IN MEDICINE, 2022, 8
  • [3] ATTENTION-BASED ENCODER-DECODER NETWORK FOR SINGLE IMAGE DEHAZING
    Gao, Shunan
    Zhu, Jinghua
    Xi, Heran
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [4] Single image deraining via deep residual attention and encoder-decoder network
    Wei, Mingrun
    Wang, Hongjuan
    Cheng, Ru
    Yu, Yue
    Wang, Lukun
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (03) : 3453 - 3467
  • [5] LAEDNet: A Lightweight Attention Encoder-Decoder Network for ultrasound medical image segmentation
    Zhou, Quan
    Wang, Qianwen
    Bao, Yunchao
    Kong, Lingjun
    Jin, Xin
    Ou, Weihua
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2022, 99
  • [6] An Attention Encoder-Decoder Network Based on Generative Adversarial Network for Remote Sensing Image Dehazing
    Zhao, Liquan
    Zhang, Yupeng
    Cui, Ying
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (11) : 10890 - 10900
  • [7] Underwater image restoration using deep encoder-decoder network with symmetric skip connections
    Gangisetty, Shankar
    Rai, Raghu Raj
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (01) : 247 - 255
  • [8] Multi-level Encoder-Decoder Architectures for Image Restoration
    Mastan, Indra Deep
    Raman, Shanmuganathan
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1728 - 1737
  • [9] An Improved Encoder-Decoder Network for Ore Image Segmentation
    Yang, Hao
    Huang, Chao
    Wang, Long
    Luo, Xiong
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (10) : 11469 - 11475
  • [10] Deep Hierarchical Encoder-Decoder Network for Image Captioning
    Xiao, Xinyu
    Wang, Lingfeng
    Ding, Kun
    Xiang, Shiming
    Pan, Chunhong
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (11) : 2942 - 2956