Cformer: An underwater image enhancement hybrid network combining convolution and transformer

被引:4
|
作者
Deng, Ruhui [1 ]
Zhao, Lei [1 ]
Li, Heng [1 ]
Liu, Hui [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automation, 727 Jingming South Rd, Kunming, Yunnan, Peoples R China
基金
中国国家自然科学基金;
关键词
image enhancement; image processing; MODEL;
D O I
10.1049/ipr2.12901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater images are the most direct and effective ways to obtain underwater information. However, underwater images typically suffer from contrast reduction and colour distortion due to the absorption and scattering of water by light, which seriously limits the further development of underwater visual tasks. Recently, the convolutional neural network has been extensively applied in underwater image enhancement for its powerful local information extraction capabilities, but due to the locality of convolution operation, it cannot capture the global context well. Although the recently emerging Transformer can capture global context, it cannot model local correlations. Cformer is proposed, which is an Unet-like hybrid network structure. First, a Depth Self-Calibrated block is proposed to extract the local features of the image effectively. Second, a novel Cross-Shaped Enhanced Window Transformer block is proposed. It captures long-range pixel interactions while dramatically reducing the computational complexity of feature maps. Finally, the depth self-calibrated block and the cross-shaped enhanced window Transformer block are ingeniously fused to build a global-local Transformer module. Extensive ablation studies are performed on public underwater datasets to demonstrate the effectiveness of individual components in the network. The qualitative and quantitative comparisons indicate that Cformer achieves superior performance compared to other competitive models.
引用
收藏
页码:3841 / 3855
页数:15
相关论文
共 50 条
  • [41] Reinforced Res-Unet transformer for underwater image enhancement
    Li, Peitong
    Chen, Jiaying
    Cai, Chengtao
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2024, 127
  • [42] Underwater Image Enhancement Using Pre-trained Transformer
    Boudiaf, Abderrahmene
    Guo, Yuhang
    Ghimire, Adarsh
    Werghi, Naoufel
    De Masi, Giulia
    Javed, Sajid
    Dias, Jorge
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 480 - 488
  • [43] Globally Deformable Information Selection Transformer for Underwater Image Enhancement
    Zhuang, Junbin
    Zheng, Yan
    Guo, Baolong
    Yan, Yunyi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 19 - 32
  • [44] UDAformer: Underwater image enhancement based on dual attention transformer
    Shen, Zhen
    Xu, Haiyong
    Luo, Ting
    Song, Yang
    He, Zhouyan
    COMPUTERS & GRAPHICS-UK, 2023, 111 : 77 - 88
  • [45] Underwater Image Enhancement Based on Parallel Guidance of Transformer and CNN
    Chang, Jian
    Chen, Hongfu
    Wang, Bingbing
    Computer Engineering and Applications, 2024, 60 (04) : 280 - 288
  • [46] Underwater Image Enhancement With Lightweight Cascaded Network
    Jiang, Nanfeng
    Chen, Weiling
    Lin, Yuting
    Zhao, Tiesong
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4301 - 4313
  • [47] Multi-scale convolution underwater image restoration network
    Tang, Zhijie
    Li, Jianda
    Huang, Jingke
    Wang, Zhanhua
    Luo, Zhihang
    MACHINE VISION AND APPLICATIONS, 2022, 33 (06)
  • [48] Multi-scale convolution underwater image restoration network
    Zhijie Tang
    Jianda Li
    Jingke Huang
    Zhanhua Wang
    Zhihang Luo
    Machine Vision and Applications, 2022, 33
  • [49] Convolution Transformer Fusion Splicing Network for Hyperspectral Image Classification
    Zhao, Feng
    Li, Shijie
    Zhang, Junjie
    Liu, Hanqiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [50] Convolution Transformer Fusion Splicing Network for Hyperspectral Image Classification
    Zhao, Feng
    Li, Shijie
    Zhang, Junjie
    Liu, Hanqiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20