Cformer: An underwater image enhancement hybrid network combining convolution and transformer

被引:4
|
作者
Deng, Ruhui [1 ]
Zhao, Lei [1 ]
Li, Heng [1 ]
Liu, Hui [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automation, 727 Jingming South Rd, Kunming, Yunnan, Peoples R China
基金
中国国家自然科学基金;
关键词
image enhancement; image processing; MODEL;
D O I
10.1049/ipr2.12901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater images are the most direct and effective ways to obtain underwater information. However, underwater images typically suffer from contrast reduction and colour distortion due to the absorption and scattering of water by light, which seriously limits the further development of underwater visual tasks. Recently, the convolutional neural network has been extensively applied in underwater image enhancement for its powerful local information extraction capabilities, but due to the locality of convolution operation, it cannot capture the global context well. Although the recently emerging Transformer can capture global context, it cannot model local correlations. Cformer is proposed, which is an Unet-like hybrid network structure. First, a Depth Self-Calibrated block is proposed to extract the local features of the image effectively. Second, a novel Cross-Shaped Enhanced Window Transformer block is proposed. It captures long-range pixel interactions while dramatically reducing the computational complexity of feature maps. Finally, the depth self-calibrated block and the cross-shaped enhanced window Transformer block are ingeniously fused to build a global-local Transformer module. Extensive ablation studies are performed on public underwater datasets to demonstrate the effectiveness of individual components in the network. The qualitative and quantitative comparisons indicate that Cformer achieves superior performance compared to other competitive models.
引用
收藏
页码:3841 / 3855
页数:15
相关论文
共 50 条
  • [1] Convolution-transformer blend pyramid network for underwater image enhancement ☆
    Ma, Lunpeng
    Hong, Dongyang
    Yin, Shibai
    Deng, Wanqiu
    Yang, Yang
    Yang, Yee-Hong
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 101
  • [2] UIE-Convformer: Underwater Image Enhancement Based on Convolution and Feature Fusion Transformer
    Wang, Biao
    Xu, Haiyong
    Jiang, Gangyi
    Yu, Mei
    Ren, Tingdi
    Luo, Ting
    Zhu, Zhongjie
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1952 - 1968
  • [3] TEGAN: Transformer Embedded Generative Adversarial Network for Underwater Image Enhancement
    Zhi Gao
    Jing Yang
    Lu Zhang
    Fengling Jiang
    Xixiang Jiao
    Cognitive Computation, 2024, 16 : 191 - 214
  • [4] A transformer-based network for perceptual contrastive underwater image enhancement
    Cheng, Na
    Sun, Zhixuan
    Zhu, Xuanbing
    Wang, Hongyu
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 118
  • [5] TEGAN: Transformer Embedded Generative Adversarial Network for Underwater Image Enhancement
    Gao, Zhi
    Yang, Jing
    Zhang, Lu
    Jiang, Fengling
    Jiao, Xixiang
    COGNITIVE COMPUTATION, 2024, 16 (01) : 191 - 214
  • [6] A hybrid attention network with convolutional neural network and transformer for underwater image restoration
    Jiao Z.
    Wang R.
    Zhang X.
    Fu B.
    Thanh D.N.H.
    PeerJ Computer Science, 2023, 9
  • [7] A hybrid attention network with convolutional neural network and transformer for underwater image restoration
    Jiao, Zhan
    Wang, Ruizi
    Zhang, Xiangyi
    Fu, Bo
    Thanh, Dang Ngoc Hoang
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [8] An underwater image enhancement model combining physical priors and residual network
    Fan, Xinnan
    Zhou, Xuan
    Chen, Hongzhu
    Xin, Yuanxue
    Shi, Pengfei
    ELECTRONICS LETTERS, 2023, 59 (21)
  • [9] HCTIRdeblur: A hybrid convolution-transformer network for single infrared image deblurring
    Yi, Shi
    Li, Li
    Liu, Xi
    Li, Junjie
    Chen, Ling
    INFRARED PHYSICS & TECHNOLOGY, 2023, 131
  • [10] Hybrid Transformer and Convolution for Image Compressed Sensing
    Nan, Ruili
    Sun, Guiling
    Zheng, Bowen
    Zhang, Pengchen
    ELECTRONICS, 2024, 13 (17)