LightingFormer: Transformer-CNN hybrid network for low-light image enhancement

被引:0
|
作者
Bi, Cong [1 ]
Qian, Wenhua [1 ]
Cao, Jinde [2 ]
Wang, Xue [1 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650500, Peoples R China
[2] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2024年 / 124卷
关键词
Low-light image enhancement; Swin transformer; Attention mechanism; Deep learning;
D O I
10.1016/j.cag.2024.104089
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent deep-learning methods have shown promising results in low-light image enhancement. However, current methods often suffer from noise and artifacts, and most are based on convolutional neural networks, which have limitations in capturing long-range dependencies resulting in insufficient recovery of extremely dark parts in low-light images. To tackle these issues, this paper proposes a novel Transformer-based low- light image enhancement network called LightingFormer. Specifically, we propose a novel Transformer-CNN hybrid block that captures global and local information via mixed attention. It combines the advantages of the Transformer in capturing long-range dependencies and the advantages of CNNs in extracting low-level features and enhancing locality to recover extremely dark parts and enhance local details in low-light images. Moreover, we adopt the U-Net discriminator to enhance different regions in low-light images adaptively, avoiding overexposure or underexposure, and suppressing noise and artifacts. Extensive experiments show that our method outperforms the state-of-the-art methods quantitatively and qualitatively. Furthermore, the application to object detection demonstrates the potential of our method in high-level vision tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [11] An Efficient Transformer-CNN Network for Document Image Binarization
    Zhang, Lina
    Wang, Kaiyuan
    Wan, Yi
    ELECTRONICS, 2024, 13 (12)
  • [12] Low-Light Image Enhancement via Stage-Transformer-Guided Network
    Jiang, Nanfeng
    Lin, Junhong
    Zhang, Ting
    Zheng, Haifeng
    Zhao, Tiesong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 3701 - 3712
  • [13] LLIEFORMER: A LOW-LIGHT IMAGE ENHANCEMENT TRANSFORMER NETWORK WITH A DEGRADED RESTORATION MODEL
    Yi, Xunpeng
    Wang, Yuxuan
    Zhao, Yizhen
    Yan, Jia
    Zhang, Weixia
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1195 - 1199
  • [14] LIELFormer: Low-Light Image Enhancement with a Lightweight Transformer
    Zhao, Wei
    Xie, Zhaoyang
    Huang, Lina
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT I, 2024, 14495 : 489 - 500
  • [15] TChange: A Hybrid Transformer-CNN Change Detection Network
    Deng, Yupeng
    Meng, Yu
    Chen, Jingbo
    Yue, Anzhi
    Liu, Diyou
    Chen, Jing
    REMOTE SENSING, 2023, 15 (05)
  • [16] TPET: Two-stage Perceptual Enhancement Transformer Network for Low-light Image Enhancement
    Cui, Hengshuai
    Li, Jinjiang
    Hua, Zhen
    Fan, Linwei
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 116
  • [17] TPET: Two-stage Perceptual Enhancement Transformer Network for Low-light Image Enhancement
    Cui, Hengshuai
    Li, Jinjiang
    Hua, Zhen
    Fan, Linwei
    Engineering Applications of Artificial Intelligence, 2022, 116
  • [18] Lightening Network for Low-Light Image Enhancement
    Wang, Li-Wen
    Liu, Zhi-Song
    Siu, Wan-Chi
    Lun, Daniel P. K.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7984 - 7996
  • [19] A Comparative Study on CNN based Low-light Image Enhancement
    Lal, Kanishk Jayant
    Rana, Deepanshu
    Parihar, Anil Singh
    2021 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2021), 2021, : 459 - 464
  • [20] Inception-Based CNN for Low-Light Image Enhancement
    Panwar, Moomal
    Gaur, Sanjay B. C.
    COMPUTATIONAL VISION AND BIO-INSPIRED COMPUTING ( ICCVBIC 2021), 2022, 1420 : 533 - 545