Cformer: An underwater image enhancement hybrid network combining convolution and transformer

被引:4
|
作者
Deng, Ruhui [1 ]
Zhao, Lei [1 ]
Li, Heng [1 ]
Liu, Hui [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automation, 727 Jingming South Rd, Kunming, Yunnan, Peoples R China
基金
中国国家自然科学基金;
关键词
image enhancement; image processing; MODEL;
D O I
10.1049/ipr2.12901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater images are the most direct and effective ways to obtain underwater information. However, underwater images typically suffer from contrast reduction and colour distortion due to the absorption and scattering of water by light, which seriously limits the further development of underwater visual tasks. Recently, the convolutional neural network has been extensively applied in underwater image enhancement for its powerful local information extraction capabilities, but due to the locality of convolution operation, it cannot capture the global context well. Although the recently emerging Transformer can capture global context, it cannot model local correlations. Cformer is proposed, which is an Unet-like hybrid network structure. First, a Depth Self-Calibrated block is proposed to extract the local features of the image effectively. Second, a novel Cross-Shaped Enhanced Window Transformer block is proposed. It captures long-range pixel interactions while dramatically reducing the computational complexity of feature maps. Finally, the depth self-calibrated block and the cross-shaped enhanced window Transformer block are ingeniously fused to build a global-local Transformer module. Extensive ablation studies are performed on public underwater datasets to demonstrate the effectiveness of individual components in the network. The qualitative and quantitative comparisons indicate that Cformer achieves superior performance compared to other competitive models.
引用
收藏
页码:3841 / 3855
页数:15
相关论文
共 50 条
  • [31] Underwater Image Enhancement Method Combining Color and Luminance
    Zhao Baiting
    Wang Feng
    Jia Xiaofen
    Guo Yongcun
    Wang Chengjun
    RECENT ADVANCES IN ELECTRICAL & ELECTRONIC ENGINEERING, 2021, 14 (02) : 241 - 249
  • [32] Mutual Retinex: Combining Transformer and CNN for Image Enhancement
    Jiang, Kui
    Wang, Qiong
    An, Zhaoyi
    Wang, Zheng
    Zhang, Cong
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (03): : 2240 - 2252
  • [33] Underwater Color Image Enhancement Using Combining Schemes
    Luan, Xin
    Hou, Guojia
    Sun, Zhengyuan
    Wang, Yongfang
    Song, Dalei
    Wang, Shuxin
    MARINE TECHNOLOGY SOCIETY JOURNAL, 2014, 48 (03) : 57 - 62
  • [34] CATDS: cross aggregation transformer-based dynamic supplement network for underwater image enhancement
    Huang, Zhixiong
    Li, Jinjiang
    Hua, Zhen
    Fan, Linwei
    COMMUNICATIONS IN INFORMATION AND SYSTEMS, 2023, 23 (01) : 1 - 30
  • [35] A Two-Stage Network Based on Transformer and Physical Model for Single Underwater Image Enhancement
    Zhang, Yuhao
    Chen, Dujing
    Zhang, Yanyan
    Shen, Meiling
    Zhao, Weiyu
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (04)
  • [36] A learnable full-frequency transformer dual generative adversarial network for underwater image enhancement
    Zheng, Shijian
    Wang, Rujing
    Zheng, Shitao
    Wang, Liusan
    Liu, Zhigui
    FRONTIERS IN MARINE SCIENCE, 2024, 11
  • [37] A hyperspectral image classification method based on feature enhancement and a hybrid deformable convolution network
    Zhao, Yunji
    Zhang, Zhihao
    Bao, Wenming
    Xu, Xiaozhuo
    Gao, Zhifang
    REMOTE SENSING LETTERS, 2024, 15 (03) : 179 - 191
  • [38] Hybrid Approach for Underwater Image Restoration and Enhancement
    Sequeira, Gary
    Mekkalki, Vidyasagar
    Prabhu, Jeevan
    Borkar, Samarth
    Desai, Mangish
    2021 INTERNATIONAL CONFERENCE ON EMERGING SMART COMPUTING AND INFORMATICS (ESCI), 2021, : 427 - 432
  • [39] A framework for the efficient enhancement of non-uniform illumination underwater image using convolution neural network?
    Zhang, Wenbo
    Liu, Weidong
    Li, Le
    Jiao, Huifeng
    Li, Yanli
    Guo, Liwei
    Xu, Jingming
    COMPUTERS & GRAPHICS-UK, 2023, 112 : 60 - 71
  • [40] TAFormer: A Transmission-Aware Transformer for Underwater Image Enhancement
    Li, Yuanyuan
    Mi, Zetian
    Wang, Yulin
    Jiang, Shuaiyong
    Fu, Xianping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 601 - 616