U-TransCNN: A U-shape transformer-CNN fusion model for underwater image enhancement☆

被引:0
|
作者
Yao, Haiyang [1 ]
Guo, Ruige [1 ]
Zhao, Zhongda [4 ]
Zang, Yuzhang [2 ]
Zhao, Xiaobo [3 ]
Lei, Tao [1 ]
Wang, Haiyan [1 ,4 ]
机构
[1] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710016, Peoples R China
[2] Western Washington Univ, Engn & Design Dept, Bellingham, WA USA
[3] Aarhus Univ, Dept Elect & Comp Engn, DK-8200 Aarhus, Denmark
[4] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Peoples R China
关键词
Underwater image enhancement; Feature fusion; Transformer; CNN;
D O I
10.1016/j.displa.2025.103047
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Underwater imaging faces significant challenges due to nonuniform optical absorption and scattering, resulting in visual quality issues like color distortion, contrast reduction, and image blurring. These factors hinder the accurate capture and clear depiction of underwater imagery. To address these complexities, we propose UTransCNN, a U-shape Transformer- Convolutional Neural Networks (CNN) model, designed to enhance underwater images by integrating the strengths of CNNs and Transformers. The core of U-TransCNN is the GlobalDetail Feature Synchronization Fusion Module. This innovative component enhances global color and contrast while meticulously preserving the intricate texture details, ensuring that both macroscopic and microscopic aspects of the image are enhanced in unison. Then we design the Multiscale Detail Fusion Block to aggregate a richer spectrum of feature information using a variety of convolution kernels. Furthermore, our optimization strategy is augmented with a joint loss function, adynamic approach allowing the model to assign varying weights to the loss associated with different pixel points, depending on their loss magnitude. Six experiments (including reference and non-reference) on three public underwater datasets confirm that U-TransCNN comprehensively surpasses other contemporary state-of-the-art deep learning algorithms, demonstrating marked improvement in visualization quality and quantization parameters of underwater images. Our code is available at https://github.com/GuoRuige/UTransCNN.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] A Low-Complexity Transformer-CNN Hybrid Model Combining Dynamic Attention for Remote Sensing Image Compression
    Zhang, Lili
    Wang, Xianjun
    Liu, Jiahui
    Fang, Qizhi
    RADIOENGINEERING, 2024, 33 (04) : 642 - 659
  • [42] UIE-Convformer: Underwater Image Enhancement Based on Convolution and Feature Fusion Transformer
    Wang, Biao
    Xu, Haiyong
    Jiang, Gangyi
    Yu, Mei
    Ren, Tingdi
    Luo, Ting
    Zhu, Zhongjie
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1952 - 1968
  • [43] A Stacked Generalization U-shape network based on zoom strategy and its application in biomedical image segmentation
    Shi, Tianyu
    Jiang, Huiyan
    Zheng, Bin
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 197 (197)
  • [44] U-ONet: Remote sensing image semantic labelling based on octave convolution and coordination attention in U-shape deep neural network
    Hu, Qiongqiong
    Wang, Feiting
    Wu, Yuechao
    Li, Ying
    ELECTRONICS LETTERS, 2024, 60 (20)
  • [45] Real-World Image Super-Resolutioin Based on Noise and U-Shape Discrimination Network
    Li, Hao
    Yang, Zhijing
    Wang, Meilin
    Ling, Wing-Kuen
    Computer Engineering and Applications, 2023, 59 (06) : 204 - 211
  • [46] Fusion-UWnet: Multi-channel Fusion-based Deep CNN for Underwater Image Enhancement
    Pradhan, Pious
    Mazumder, Alokendu
    Mandal, Srimanta
    Subudhi, Badri N.
    OCEANS 2021: SAN DIEGO - PORTO, 2021,
  • [47] Natural period measurement of U-shape anti-roll tank using model experiment
    Ai, XY
    Li, GB
    Zhang, H
    Liang, LH
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON INTELLIGENT MECHATRONICS AND AUTOMATION, 2004, : 704 - 707
  • [48] Rotated fourfold U-shape metasurface for polarization-insensitive strong enhancement of mid-infrared photodetection
    Tong, Jinchao
    Suo, Fei
    Tobing, Landobasa Y. M.
    Xu, Zhengji
    Xiong, Yao
    Zhang, Dao Hua
    OPTICS EXPRESS, 2020, 28 (03) : 4225 - 4233
  • [49] CSTSUNet: A Cross Swin Transformer-Based Siamese U-Shape Network for Change Detection in Remote Sensing Images
    Wu, Yaping
    Li, Lu
    Wang, Nan
    Li, Wei
    Fan, Junfang
    Tao, Ran
    Wen, Xin
    Wang, Yanfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [50] Real-World Underwater Image Enhancement Based on Attention U-Net
    Tang, Pengfei
    Li, Liangliang
    Xue, Yuan
    Lv, Ming
    Jia, Zhenhong
    Ma, Hongbing
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (03)