HFMNet: Hierarchical Feature Mining Network for Low-Light Image Enhancement

被引:24
|
作者
Xu, Kai [1 ]
Chen, Huaian [1 ]
Tan, Xiao [1 ]
Chen, Yuxuan [1 ]
Jin, Yi [1 ,2 ]
Kan, Yan [3 ]
Zhu, Changan [1 ,2 ]
机构
[1] Univ Sci & Technol China, Sch Engn Sci, Hefei 230022, Anhui, Peoples R China
[2] Univ Sci & Technol China, Sch Data Sci, Hefei 230022, Anhui, Peoples R China
[3] Univ Sci & Technol China, Innovat Lab WuHu State Owned Factory Machining, Hefei 230022, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Lighting; Image edge detection; Feature extraction; Visualization; Image enhancement; Task analysis; Image restoration; Feature mining; hierarchical supervised loss; illumination and edge features; low-light image enhancement; QUALITY ASSESSMENT; SEGMENTATION;
D O I
10.1109/TIM.2022.3181280
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured in low-light environments often suffer from issues related to dark illumination and damaged details, which results in poor visibility. To address these problems, existing methods have attempted to enhance the visibility of low-light images using convolutional neural networks (CNNs). However, due to the insufficient consideration of crucial features such as illumination and edge details, most of them yield unnatural illumination and blurry details. In this work, to fully exploit these features, we present a detailed analysis of the illumination and edge features of low-light images, observing that the frequency components of these two features are considerably different. Therefore, we explore the frequency distributions of the feature maps extracted from different layers of a CNN model and try to seek the best representation for the illumination and edge information. Based on this, we present a hierarchical feature mining network (HFMNet) that extracts illumination and edge features in different network layers. Specifically, we build a feature mining attention (FMA) module combined with a hierarchical supervised loss to mine crucial features in appropriate network layer. Since deep hierarchical supervision tends to cause overfitting, we introduce an unpaired adversarial loss for improving the generality of the enhancement model. Through extensive experiments and analysis, we demonstrate the advantages of the proposed network, which achieves the state-of-the-art performance in terms of image quality.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Hierarchical guided network for low-light image enhancement
    Feng, Xiaomei
    Li, Jinjiang
    Fan, Hui
    IET IMAGE PROCESSING, 2021, 15 (13) : 3254 - 3266
  • [2] Feature spatial pyramid network for low-light image enhancement
    Song, Xijuan
    Huang, Jijiang
    Cao, Jianzhong
    Song, Dawei
    VISUAL COMPUTER, 2023, 39 (01): : 489 - 499
  • [3] Feature spatial pyramid network for low-light image enhancement
    Xijuan Song
    Jijiang Huang
    Jianzhong Cao
    Dawei Song
    The Visual Computer, 2023, 39 : 489 - 499
  • [4] Efficient adaptive feature aggregation network for low-light image enhancement
    Li, Canlin
    Gao, Pengcheng
    Liu, Jinhua
    Song, Shun
    Bi, Lihua
    PLOS ONE, 2022, 17 (08):
  • [5] Low-light image enhancement via multistage feature fusion network
    Tan, Mingming
    Fan, Jiayi
    Fan, Guodong
    Gan, Min
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (06)
  • [6] Lightening Network for Low-Light Image Enhancement
    Wang, Li-Wen
    Liu, Zhi-Song
    Siu, Wan-Chi
    Lun, Daniel P. K.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7984 - 7996
  • [7] Low-Light Image Enhancement Network Using Informative Feature Stretch and Attention
    Chun, Sung Min
    Park, Jun Young
    Eom, Il Kyu
    ELECTRONICS, 2024, 13 (19)
  • [8] LOW-LIGHT IMAGE ENHANCEMENT VIA FEATURE RESTORATION
    Yang, Yang
    Zhang, Yonghua
    Guo, Xiaojie
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2440 - 2444
  • [9] Brightening the shadows: low-light image feature enhancement
    Halford, Gavin
    Depoian, Arthur C., II
    Bailey, Colleen P.
    MULTIMODAL IMAGE EXPLOITATION AND LEARNING 2024, 2024, 13033
  • [10] Attention-guided network with hierarchical global priors for low-light image enhancement
    An Gong
    Zhonghao Li
    Heng Wang
    Guangtong Li
    Signal, Image and Video Processing, 2023, 17 : 2083 - 2091