LightingFormer: Transformer-CNN hybrid network for low-light image enhancement

被引:0
|
作者
Bi, Cong [1 ]
Qian, Wenhua [1 ]
Cao, Jinde [2 ]
Wang, Xue [1 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650500, Peoples R China
[2] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2024年 / 124卷
关键词
Low-light image enhancement; Swin transformer; Attention mechanism; Deep learning;
D O I
10.1016/j.cag.2024.104089
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent deep-learning methods have shown promising results in low-light image enhancement. However, current methods often suffer from noise and artifacts, and most are based on convolutional neural networks, which have limitations in capturing long-range dependencies resulting in insufficient recovery of extremely dark parts in low-light images. To tackle these issues, this paper proposes a novel Transformer-based low- light image enhancement network called LightingFormer. Specifically, we propose a novel Transformer-CNN hybrid block that captures global and local information via mixed attention. It combines the advantages of the Transformer in capturing long-range dependencies and the advantages of CNNs in extracting low-level features and enhancing locality to recover extremely dark parts and enhance local details in low-light images. Moreover, we adopt the U-Net discriminator to enhance different regions in low-light images adaptively, avoiding overexposure or underexposure, and suppressing noise and artifacts. Extensive experiments show that our method outperforms the state-of-the-art methods quantitatively and qualitatively. Furthermore, the application to object detection demonstrates the potential of our method in high-level vision tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Weight Uncertainty Network for Low-Light Image Enhancement
    Jin, Yutao
    Sun, Yue
    Chen, Xiaoyan
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VIII, ICIC 2024, 2024, 14869 : 106 - 117
  • [32] Invertible network for unpaired low-light image enhancement
    Zhang, Jize
    Wang, Haolin
    Wu, Xiaohe
    Zuo, Wangmeng
    VISUAL COMPUTER, 2024, 40 (01): : 109 - 120
  • [33] Deep Lightening Network for Low-light Image Enhancement
    Wang, Li-Wen
    Liu, Zhi-Song
    Siu, Wan-Chi
    Lun, Daniel Pak-Kong
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [34] LOW-LIGHT IMAGE ENHANCEMENT USING CNN AND BRIGHT CHANNEL PRIOR
    Tao, Li
    Zhu, Chuang
    Song, Jiawen
    Lu, Tao
    Jia, Huizhu
    Xie, Xiaodong
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3215 - 3219
  • [35] HyFormer: a hybrid transformer-CNN architecture for retinal OCT image segmentation
    Jiang, Qingxin
    Fan, Ying
    Li, Menghan
    Fang, Sheng
    Zhu, Weifang
    Xiang, Dehui
    Peng, Tao
    Chen, Xinjian
    Xu, Xun
    Shi, Fei
    Biomedical Optics Express, 2024, 15 (11) : 6156 - 6170
  • [36] Transformer-Based Multi-scale Optimization Network for Low-Light Image Enhancement
    Niu Y.
    Lin X.
    Xu H.
    Li Y.
    Chen Y.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (06): : 511 - 529
  • [37] RawFormer: An Efficient Vision Transformer for Low-Light RAW Image Enhancement
    Xu, Wanyan
    Dong, Xingbo
    Ma, Lan
    Teoh, Andrew Beng Jin
    Lin, Zhixian
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2677 - 2681
  • [38] A transformer-CNN for deep image inpainting forensics
    Zhu, Xinshan
    Lu, Junyan
    Ren, Honghao
    Wang, Hongquan
    Sun, Biao
    VISUAL COMPUTER, 2023, 39 (10): : 4721 - 4735
  • [39] DEANet: Decomposition Enhancement and Adjustment Network for Low-Light Image Enhancement
    Jiang, Yonglong
    Li, Liangliang
    Zhu, Jiahe
    Xue, Yuan
    Ma, Hongbing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2023, 28 (04): : 743 - 753
  • [40] Transformer-CNN hybrid network for improving PET time of flight prediction
    Feng, Xuhui
    Muhashi, Amanjule
    Onishi, Yuya
    Ota, Ryosuke
    Liu, Huafeng
    PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (11):