Bilevel Fast Scene Adaptation for Low-Light Image Enhancement

被引:20
|
作者
Ma, Long [1 ]
Jin, Dian [2 ]
An, Nan [3 ]
Liu, Jinyuan [4 ]
Fan, Xin [1 ]
Luo, Zhongxuan [3 ]
Liu, Risheng [1 ]
机构
[1] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Engn, Dalian 116024, Peoples R China
[2] Xiaomi AI Lab, Beijing 100085, Peoples R China
[3] Dalian Univ Technol, Sch Software Technol, Dalian 116024, Peoples R China
[4] Dalian Univ Technol, Sch Mech Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Image denoising; Fast adaptation; Bilevel optimization; Hyperparameter optimization; Meta learning;
D O I
10.1007/s11263-023-01900-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Enhancing images in low-light scenes is a challenging but widely concerned task in the computer vision. The mainstream learning-based methods mainly acquire the enhanced model by learning the data distribution from the specific scenes, causing poor adaptability (even failure) when meeting real-world scenarios that have never been encountered before. The main obstacle lies in the modeling conundrum from distribution discrepancy across different scenes. To remedy this, we first explore relationships between diverse low-light scenes based on statistical analysis, i.e., the network parameters of the encoder trained in different data distributions are close. We introduce the bilevel paradigm to model the above latent correspondence from the perspective of hyperparameter optimization. A bilevel learning framework is constructed to endow the scene-irrelevant generality of the encoder towards diverse scenes (i.e., freezing the encoder in the adaptation and testing phases). Further, we define a reinforced bilevel learning framework to provide a meta-initialization for scene-specific decoder to further ameliorate visual quality. Moreover, to improve the practicability, we establish a Retinex-induced architecture with adaptive denoising and apply our built learning framework to acquire its parameters by using two training losses including supervised and unsupervised forms. Extensive experimental evaluations on multiple datasets verify our adaptability and competitive performance against existing state-of-the-art works. The code and datasets will be available at https://github.com/vis-opt-group/BL.
引用
下载
收藏
页数:19
相关论文
共 50 条
  • [41] Dual-band low-light image enhancement
    Aizhong Mi
    Wenhui Luo
    Zhanqiang Huo
    Multimedia Systems, 2024, 30
  • [42] Low-light image enhancement based on normal-light image degradation
    Bai Zhao
    Xiaolin Gong
    Jian Wang
    Lingchao Zhao
    Signal, Image and Video Processing, 2022, 16 : 1409 - 1416
  • [43] Perceptual Quality Assessment of Low-light Image Enhancement
    Zhai, Guangtao
    Sun, Wei
    Min, Xiongkuo
    Zhou, Jiantao
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (04)
  • [44] Gradient-Based Low-Light Image Enhancement
    Tanaka, Masayuki
    Shibata, Takashi
    Okutomi, Masatoshi
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2019,
  • [45] LOW-LIGHT IMAGE ENHANCEMENT VIA FEATURE RESTORATION
    Yang, Yang
    Zhang, Yonghua
    Guo, Xiaojie
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2440 - 2444
  • [46] A Variational Model for Nonuniform Low-Light Image Enhancement
    Jia, Fan
    Mao, Shen
    Tai, Xue-Cheng
    Zeng, Tieyong
    SIAM JOURNAL ON IMAGING SCIENCES, 2024, 17 (01): : 1 - 30
  • [47] Task Decoupling Guided Low-Light Image Enhancement
    Niu Y.-Z.
    Chen M.-M.
    Li Y.-Z.
    Zhao T.-S.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (01): : 34 - 45
  • [48] Fusion-Based Low-Light Image Enhancement
    Wang, Haodian
    Wang, Yang
    Cao, Yang
    Zha, Zheng-Jun
    MULTIMEDIA MODELING, MMM 2023, PT I, 2023, 13833 : 121 - 133
  • [49] Unsupervised Low-light Image Enhancement with Decoupled Networks
    Xiong, Wei
    Liu, Ding
    Shen, Xiaohui
    Fang, Chen
    Luo, Jiebo
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 457 - 463
  • [50] SNR-Aware Low-light Image Enhancement
    Xu, Xiaogang
    Wang, Ruixing
    Fu, Chi-Wing
    Jia, Jiaya
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 17693 - 17703