An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network

被引:2
|
作者
Xu, Jun [1 ]
Chen, Zi-Xuan [2 ]
Luo, Hao [2 ]
Lu, Zhe-Ming [2 ]
机构
[1] Wenzhou Mass Transit Railway Investment Grp Co Ltd, Wenzhou 325000, Peoples R China
[2] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
关键词
image dehazing; deep learning; convolutional neural network; Transformer; Transformer-Convolution fusion dehazing network (TCFDN);
D O I
10.3390/s23010043
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The purpose of image dehazing is to remove the interference from weather factors in degraded images and enhance the clarity and color saturation of images to maximize the restoration of useful features. Single image dehazing is one of the most important tasks in the field of image restoration. In recent years, due to the progress of deep learning, single image dehazing has made great progress. With the success of Transformer in advanced computer vision tasks, some research studies also began to apply Transformer to image dehazing tasks and obtained surprising results. However, both the deconvolution-neural-network-based dehazing algorithm and Transformer based dehazing algorithm magnify their advantages and disadvantages separately. Therefore, this paper proposes a novel Transformer-Convolution fusion dehazing network (TCFDN), which uses Transformer's global modeling ability and convolutional neural network's local modeling ability to improve the dehazing ability. In the Transformer-Convolution fusion dehazing network, the classic self-encoder structure is used. This paper proposes a Transformer-Convolution hybrid layer, which uses an adaptive fusion strategy to make full use of the Swin-Transformer and convolutional neural network to extract and reconstruct image features. On the basis of previous research, this layer further improves the ability of the network to remove haze. A series of contrast experiments and ablation experiments not only proved that the Transformer-Convolution fusion dehazing network proposed in this paper exceeded the more advanced dehazing algorithm, but also provided solid and powerful evidence for the basic theory on which it depends.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A Fusion Deraining Network Based on Swin Transformer and Convolutional Neural Network
    Tang, Junhao
    Feng, Guorui
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2023, E106D (07) : 1254 - 1257
  • [2] A Visible and Synthetic Aperture Radar Image Fusion Algorithm Based on a Transformer and a Convolutional Neural Network
    Hu, Liushun
    Su, Shaojing
    Zuo, Zhen
    Wei, Junyu
    Huang, Siyang
    Zhao, Zongqing
    Tong, Xiaozhong
    Yuan, Shudong
    [J]. ELECTRONICS, 2024, 13 (12)
  • [3] Image Dehazing Algorithm Based on Convolutional Neural Network and Dynamic Ambient Light
    Liu Jieping
    Yang Yezhang
    Chen Minyuan
    Ma Lihong
    [J]. ACTA OPTICA SINICA, 2019, 39 (11)
  • [4] Image dehazing network based on improved convolutional neural network
    Dai, Changxiu
    [J]. International Journal of Manufacturing Technology and Management, 2024, 38 (4-5) : 302 - 320
  • [5] Image dehazing algorithm based on multi-scale concat convolutional neural network
    Qiao Dan
    Zhang Chuang
    Zhu Chen-yu
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (10) : 1420 - 1429
  • [6] Infrared and Visible Image Fusion with Convolutional Neural Network and Transformer
    Yang, Yang
    Ren, Zhennan
    Li, Beichen
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (16)
  • [7] ADAPTIVE PATCH BASED CONVOLUTIONAL NEURAL NETWORK FOR ROBUST DEHAZING
    Kim, Guisik
    Ha, Suhyeon
    Kwon, Junseok
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2845 - 2849
  • [8] Automatic Segmentation Algorithm of Dermoscopy Image Based on Transformer and Convolutional Neural Network
    Wei, Chunmiao
    Xu, Yan
    Jiang, Xinhui
    Wei, Yiming
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (12): : 1877 - 1886
  • [9] An Efficient and Accurate Stereo Matching Algorithm Based on Convolutional Neural Network
    Zhang, Wen
    Shao, Xiaotao
    Yang, Wei
    Guo, Mingkun
    Jing, Nianzhao
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (01): : 45 - 53
  • [10] Single-image Dehazing Algorithm Based on Convolutional Neural Networks
    Xiao, Jinsheng
    Luo, Li
    Liu, Enyu
    Lei, Junfeng
    Klette, Reinhard
    [J]. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1259 - 1264