LightingFormer: Transformer-CNN hybrid network for low-light image enhancement

被引:0
|
作者
Bi, Cong [1 ]
Qian, Wenhua [1 ]
Cao, Jinde [2 ]
Wang, Xue [1 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650500, Peoples R China
[2] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2024年 / 124卷
关键词
Low-light image enhancement; Swin transformer; Attention mechanism; Deep learning;
D O I
10.1016/j.cag.2024.104089
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent deep-learning methods have shown promising results in low-light image enhancement. However, current methods often suffer from noise and artifacts, and most are based on convolutional neural networks, which have limitations in capturing long-range dependencies resulting in insufficient recovery of extremely dark parts in low-light images. To tackle these issues, this paper proposes a novel Transformer-based low- light image enhancement network called LightingFormer. Specifically, we propose a novel Transformer-CNN hybrid block that captures global and local information via mixed attention. It combines the advantages of the Transformer in capturing long-range dependencies and the advantages of CNNs in extracting low-level features and enhancing locality to recover extremely dark parts and enhance local details in low-light images. Moreover, we adopt the U-Net discriminator to enhance different regions in low-light images adaptively, avoiding overexposure or underexposure, and suppressing noise and artifacts. Extensive experiments show that our method outperforms the state-of-the-art methods quantitatively and qualitatively. Furthermore, the application to object detection demonstrates the potential of our method in high-level vision tasks.
引用
下载
收藏
页数:11
相关论文
共 50 条
  • [1] TCPCNet: a transformer-CNN parallel cooperative network for low-light image enhancement
    Wanjun Zhang
    Yujie Ding
    Miaohui Zhang
    Yonghua Zhang
    Lvchen Cao
    Ziqing Huang
    Jun Wang
    Multimedia Tools and Applications, 2024, 83 : 52957 - 52972
  • [2] TCPCNet: a transformer-CNN parallel cooperative network for low-light image enhancement
    Zhang, Wanjun
    Ding, Yujie
    Zhang, Miaohui
    Zhang, Yonghua
    Cao, Lvchen
    Huang, Ziqing
    Wang, Jun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (17) : 52957 - 52972
  • [3] Low-light image enhancement based on Transformer and CNN architecture
    Chen, Keyuan
    Chen, Bin
    Wu, Shiqian
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3628 - 3633
  • [4] Adaptive lightweight Transformer network for low-light image enhancement
    Meng, De
    Lei, Zhichun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (6-7) : 5365 - 5375
  • [5] Transformer-CNN hybrid network for crowd counting
    Yu J.
    Yu Y.
    Qian J.
    Han X.
    Zhu F.
    Zhu Z.
    Journal of Intelligent and Fuzzy Systems, 2024, 46 (04): : 10773 - 10785
  • [6] Hybrid Transformer-CNN for Real Image Denoising
    Zhao, Mo
    Cao, Gang
    Huang, Xianglin
    Yang, Lifang
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1252 - 1256
  • [7] Low-Light Image Enhancement by Combining Transformer and Convolutional Neural Network
    Yuan, Nianzeng
    Zhao, Xingyun
    Sun, Bangyong
    Han, Wenjia
    Tan, Jiahai
    Duan, Tao
    Gao, Xiaomei
    MATHEMATICS, 2023, 11 (07)
  • [8] Low-Light Image Enhancement via a Deep Hybrid Network
    Ren, Wenqi
    Liu, Sifei
    Ma, Lin
    Xu, Qianqian
    Xu, Xiangyu
    Cao, Xiaochun
    Du, Junping
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) : 4364 - 4375
  • [9] Dual branch Transformer-CNN parametric filtering network for underwater image enhancement
    Chang, Baocai
    Li, Jinjiang
    Ren, Lu
    Chen, Zheng
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [10] LET: a local enhancement transformer for low-light image enhancement
    Pan, Lei
    Tian, Jun
    Zheng, Yuan
    Fu, Qiang
    Zhao, Zhiqing
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)