Multiscale feature fusion deep network for single image dehazing with continuous memory mechanism

被引:0
|
作者
Xie Z. [1 ]
Li Q. [1 ]
Zong S. [1 ]
Liu G. [1 ]
机构
[1] Key Lab of Optic-Electronic and Communication, Jiangxi Science and Technology Normal University, Nanchang
来源
Optik | 2023年 / 287卷
基金
中国国家自然科学基金;
关键词
Attention mechanism; Continuous memory mechanism; Image dehazing; Residual dense block module; U-Net;
D O I
10.1016/j.ijleo.2023.171144
中图分类号
学科分类号
摘要
Haze scenes seriously degrade the performance of computer vision systems. Thus, the single image dehazing based on convolutional neural network (CNN), as an important direction of computer vision, has always attracted extraordinary attentions of researchers and made great progress on dehazing effects. However, there are still some non-trivial issues such as uneven dehazing and color distortion, which are not well addressed. To alleviate these issues, this work proposes a new multiscale feature fusion image dehazing network incorporating a contiguous memory mechanism (MFFDN-CM). Specifically, the pixel attention mechanism, continuous memory strategy and residual dense blocks are jointly integrated into the dehazing model with a prevalent encoder-decoder structure(U-Net). Firstly, our model obtains multiscale feature maps by subsampling operations, and further employs skip connections between the corresponding network layers to connect the feature maps between the encoder and the decoder for good feature fusion. Then, we introduce a continuous memory residual block to strengthen the information flows for feature reuse. Moreover, to leverage detail representation and accomplish adaptive dehazing according to the haze density, MFFDN-CM adopts a pixel attention module on the skip connections to combine the residual dense block module of the corresponding decoding layers. Finally, multiple residual blocks are exploited on the bottleneck in encoder-decoder structure to prevent network performance degradation due to vanishing gradients. Experimental results demonstrate the proposed model can achieve better dehazing performance than the state-of-the-art methods based on other deep neural networks. © 2023 Elsevier GmbH
引用
收藏
相关论文
共 50 条
  • [1] Image Dehazing Based on Deep Multiscale Fusion Network and Continuous Memory Mechanism
    Li, Qiang
    Xie, Zhihua
    Zong, Sha
    Liu, Guodong
    [J]. INTELLIGENT COMPUTING METHODOLOGIES, PT III, 2022, 13395 : 409 - 422
  • [2] Content Feature and Style Feature Fusion Network for Single Image Dehazing
    Yang A.-P.
    Liu J.
    Xing J.-N.
    Li X.-X.
    He Y.-Q.
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2023, 49 (04): : 769 - 777
  • [3] Adaptive feature fusion network based on boosted attention mechanism for single image dehazing
    Wang, Zhao
    Li, Feng
    Cong, Runmin
    Bai, Huihui
    Zhao, Yao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (08) : 11325 - 11339
  • [4] Adaptive feature fusion network based on boosted attention mechanism for single image dehazing
    Zhao Wang
    Feng Li
    Runmin Cong
    Huihui Bai
    Yao Zhao
    [J]. Multimedia Tools and Applications, 2022, 81 : 11325 - 11339
  • [5] GLOBAL FEATURE FUSION ATTENTION NETWORK FOR SINGLE IMAGE DEHAZING
    Luo, Jie
    Bu, Qirong
    Zhang, Lei
    Feng, Jun
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [6] Multi-Scale Attentive Feature Fusion Network for Single Image Dehazing
    Zhang, Chenxi
    Wu, Chunming
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] Multi-Scale Feature Fusion Network with Attention for Single Image Dehazing
    Hu, Bin
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS, 2021, 31 (04) : 608 - 615
  • [8] Multi-Scale Feature Fusion Network with Attention for Single Image Dehazing
    [J]. Pattern Recognition and Image Analysis, 2021, 31 : 608 - 615
  • [9] FFA-Net: Feature Fusion Attention Network for Single Image Dehazing
    Qin, Xu
    Wang, Zhilin
    Bai, Yuanchao
    Xie, Xiaodong
    Jia, Huizhu
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11908 - 11915
  • [10] MSAFF-Net: Multiscale Attention Feature Fusion Networks for Single Image Dehazing and Beyond
    Lin, Cunyi
    Rong, Xianwei
    Yu, Xiaoyan
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 3089 - 3100