U-TransCNN: A U-shape transformer-CNN fusion model for underwater image enhancement☆

被引:0
|
作者
Yao, Haiyang [1 ]
Guo, Ruige [1 ]
Zhao, Zhongda [4 ]
Zang, Yuzhang [2 ]
Zhao, Xiaobo [3 ]
Lei, Tao [1 ]
Wang, Haiyan [1 ,4 ]
机构
[1] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710016, Peoples R China
[2] Western Washington Univ, Engn & Design Dept, Bellingham, WA USA
[3] Aarhus Univ, Dept Elect & Comp Engn, DK-8200 Aarhus, Denmark
[4] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Peoples R China
关键词
Underwater image enhancement; Feature fusion; Transformer; CNN;
D O I
10.1016/j.displa.2025.103047
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Underwater imaging faces significant challenges due to nonuniform optical absorption and scattering, resulting in visual quality issues like color distortion, contrast reduction, and image blurring. These factors hinder the accurate capture and clear depiction of underwater imagery. To address these complexities, we propose UTransCNN, a U-shape Transformer- Convolutional Neural Networks (CNN) model, designed to enhance underwater images by integrating the strengths of CNNs and Transformers. The core of U-TransCNN is the GlobalDetail Feature Synchronization Fusion Module. This innovative component enhances global color and contrast while meticulously preserving the intricate texture details, ensuring that both macroscopic and microscopic aspects of the image are enhanced in unison. Then we design the Multiscale Detail Fusion Block to aggregate a richer spectrum of feature information using a variety of convolution kernels. Furthermore, our optimization strategy is augmented with a joint loss function, adynamic approach allowing the model to assign varying weights to the loss associated with different pixel points, depending on their loss magnitude. Six experiments (including reference and non-reference) on three public underwater datasets confirm that U-TransCNN comprehensively surpasses other contemporary state-of-the-art deep learning algorithms, demonstrating marked improvement in visualization quality and quantization parameters of underwater images. Our code is available at https://github.com/GuoRuige/UTransCNN.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] U-Shape Transformer for Underwater Image Enhancement
    Peng, Lintao
    Zhu, Chunli
    Bian, Liheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 3066 - 3079
  • [2] DAUT: UNDERWATER IMAGE ENHANCEMENT USING DEPTH AWARE U-SHAPE TRANSFORMER
    Badran, Mohamed
    Torki, Marwan
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1830 - 1834
  • [3] Retinex-based underwater image enhancement via adaptive color correction and hierarchical U-shape transformer
    Zhang, Yi
    Chandler, Damon M.
    Leszczuk, Mikolaj
    OPTICS EXPRESS, 2024, 32 (14): : 24018 - 24040
  • [4] TransCNN-HAE: Transformer-CNN Hybrid AutoEncoder for Blind Image Inpainting
    Zhao, Haoru
    Gu, Zhaorui
    Zheng, Bing
    Zheng, Haiyong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6813 - 6821
  • [5] Dual branch Transformer-CNN parametric filtering network for underwater image enhancement
    Chang, Baocai
    Li, Jinjiang
    Ren, Lu
    Chen, Zheng
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [6] Parallel Transformer-CNN Model for Medical Image Segmentation
    Zhou, Mingkun
    Nie, Xueyun
    Liu, Yuhang
    Li, Doudou
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 1048 - 1051
  • [7] A Novel Multi-Focus Image Fusion Network with U-Shape Structure
    Pan, Tao
    Jiang, Jiaqin
    Yao, Jian
    Wang, Bin
    Tan, Bin
    SENSORS, 2020, 20 (14) : 1 - 20
  • [8] U-SHAPE SPECTRAL-TRANSFORMER FOR ROBUST FUSION BASED HYPERSPECTRAL SUPER-RESOLUTION
    Chen, Guochao
    Wu, Boxiong
    Xing, Haijiao
    Fu, Bowen
    Wei, Wei
    Zhang, Lei
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6763 - 6766
  • [9] AutoEnhancer: Transformer on U-Net Architecture Search for Underwater Image Enhancement
    Tang, Yi
    Iwaguchi, Takafumi
    Kawasaki, Hiroshi
    Sagawa, Ryusuke
    Furukawa, Ryo
    COMPUTER VISION - ACCV 2022, PT III, 2023, 13843 : 120 - 137
  • [10] Swin transformer and fusion for underwater image enhancement
    Sun, Jinghao
    Dong, Junyu
    Lv, Qingxuan
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2022, 2022, 12177