Structure- and Texture-Aware Learning for Low-Light Image Enhancement

被引:13
|
作者
Zhang, Jinghao [1 ]
Huang, Jie [1 ]
Yao, Mingde [1 ]
Zhou, Man [1 ]
Zhao, Feng [1 ]
机构
[1] Univ Sci & Tech China, Hefei, Peoples R China
关键词
Low-light image enhancement; image aware; frequency modeling; HISTOGRAM EQUALIZATION; GAMMA CORRECTION; FRAMEWORK; RETINEX;
D O I
10.1145/3503161.3548359
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Structure and texture information is critically important for low-light image enhancement, in terms of stable global adjustment and fine details recovery. However, most existing methods tend to learn the structure and texture of low-light images in a coupled manner, without well considering the heterogeneity between them, which challenges the capability of the model to learn both adequately. In this paper, we tackle this problem in a divide-and-conquer strategy, based on the observation that the structure and texture representations are highly separated in the frequency spectrum. Specifically, we propose a Structure and Texture Aware Network (STAN) for low-light image enhancement, which consists of a structure sub-network and a texture sub-network. The former exploits the low-pass characteristic of the transformer to capture low-frequency-related structural representation, while the latter builds upon central difference convolution to capture high-frequency-related texture representation. We establish the Multi-Spectrum Interaction (MSI) module between two sub-networks to bidirectionally provide complementary information. In addition, to further elevate the capability of the model, we introduce a dual distillation scheme that assists the learning process of two sub-networks via counterparts' normal-light structure and texture representations. Comprehensive experiments show that the proposed STAN outperforms the state-of-the-art methods qualitatively and quantitatively.
引用
收藏
页码:6483 / 6492
页数:10
相关论文
共 50 条
  • [1] Structure-Texture Aware Network for Low-Light Image Enhancement
    Xu, Kai
    Chen, Huaian
    Xu, Chunmei
    Jin, Yi
    Zhu, Changan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 4983 - 4996
  • [2] Fractional structure and texture aware model for image Retinex and low-light enhancement
    Li, Chengxue
    He, Chuanjiang
    [J]. APPLIED MATHEMATICAL MODELLING, 2024, 130 : 496 - 513
  • [3] Image inpainting based on GAN-driven structure- and texture-aware learning with application to object removal
    Yeh, Chia-Hung
    Yang, Hsin-Fu
    Chen, Mei-Juan
    Kang, Li-Wei
    [J]. APPLIED SOFT COMPUTING, 2024, 161
  • [4] Light-Aware Contrastive Learning for Low-Light Image Enhancement
    Xu, W.U.
    Zhihui, L.A.I.
    Zhou, Jie
    Xianxu, H.O.U.
    Pedrycz, Witold
    Shen, Linlin
    [J]. ACM Transactions on Multimedia Computing, Communications and Applications, 2024, 20 (09)
  • [5] Learning deep texture-structure decomposition for low-light image restoration and enhancement
    Zhao, Lijun
    Wang, Ke
    Zhang, Jinjing
    Wang, Anhong
    Bai, Huihui
    [J]. NEUROCOMPUTING, 2023, 524 : 126 - 141
  • [6] Texture-aware and color-consistent learning for underwater image enhancement
    Hu, Shuteng
    Cheng, Zheng
    Fan, Guodong
    Gan, Min
    Chen, C. L. Philip
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 98
  • [7] ClassLIE: Structure- and Illumination-Adaptive Classification for Low-Light Image Enhancement
    Wei, Zixiang
    Wang, Yiting
    Sun, Lichao
    Vasilakos, Athanasios V.
    Wang, Lin
    [J]. IEEE Transactions on Artificial Intelligence, 2024, 5 (09): : 4765 - 4775
  • [8] A structure and texture revealing retinex model for low-light image enhancement
    Xuesong Li
    Qilei Li
    Marco Anisetti
    Gwanggil Jeon
    Mingliang Gao
    [J]. Multimedia Tools and Applications, 2024, 83 : 2323 - 2347
  • [9] A structure and texture revealing retinex model for low-light image enhancement
    Li, Xuesong
    Li, Qilei
    Anisetti, Marco
    Jeon, Gwanggil
    Gao, Mingliang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (1) : 2323 - 2347
  • [10] SNR-Aware Low-light Image Enhancement
    Xu, Xiaogang
    Wang, Ruixing
    Fu, Chi-Wing
    Jia, Jiaya
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 17693 - 17703