Bilevel Fast Scene Adaptation for Low-Light Image Enhancement

被引:20
|
作者
Ma, Long [1 ]
Jin, Dian [2 ]
An, Nan [3 ]
Liu, Jinyuan [4 ]
Fan, Xin [1 ]
Luo, Zhongxuan [3 ]
Liu, Risheng [1 ]
机构
[1] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Engn, Dalian 116024, Peoples R China
[2] Xiaomi AI Lab, Beijing 100085, Peoples R China
[3] Dalian Univ Technol, Sch Software Technol, Dalian 116024, Peoples R China
[4] Dalian Univ Technol, Sch Mech Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Image denoising; Fast adaptation; Bilevel optimization; Hyperparameter optimization; Meta learning;
D O I
10.1007/s11263-023-01900-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Enhancing images in low-light scenes is a challenging but widely concerned task in the computer vision. The mainstream learning-based methods mainly acquire the enhanced model by learning the data distribution from the specific scenes, causing poor adaptability (even failure) when meeting real-world scenarios that have never been encountered before. The main obstacle lies in the modeling conundrum from distribution discrepancy across different scenes. To remedy this, we first explore relationships between diverse low-light scenes based on statistical analysis, i.e., the network parameters of the encoder trained in different data distributions are close. We introduce the bilevel paradigm to model the above latent correspondence from the perspective of hyperparameter optimization. A bilevel learning framework is constructed to endow the scene-irrelevant generality of the encoder towards diverse scenes (i.e., freezing the encoder in the adaptation and testing phases). Further, we define a reinforced bilevel learning framework to provide a meta-initialization for scene-specific decoder to further ameliorate visual quality. Moreover, to improve the practicability, we establish a Retinex-induced architecture with adaptive denoising and apply our built learning framework to acquire its parameters by using two training losses including supervised and unsupervised forms. Extensive experimental evaluations on multiple datasets verify our adaptability and competitive performance against existing state-of-the-art works. The code and datasets will be available at https://github.com/vis-opt-group/BL.
引用
下载
收藏
页数:19
相关论文
共 50 条
  • [21] Low-light Image Enhancement Using Fast Adaptive Binning for Mobile Phone Cameras
    Yu, Soohwan
    Ko, Seungyong
    Kang, Wonseok
    Paik, Joonki
    2015 IEEE 5TH INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - BERLIN (ICCE-BERLIN), 2015, : 170 - 171
  • [22] Low-light image enhancement for infrared and visible image fusion
    Zhou, Yiqiao
    Xie, Lisiqi
    He, Kangjian
    Xu, Dan
    Tao, Dapeng
    Lin, Xu
    IET IMAGE PROCESSING, 2023, 17 (11) : 3216 - 3234
  • [23] Low-Light Image Enhancement Based on RAW Domain Image
    Chen L.
    Zhang Y.
    Lyu Z.
    Ding D.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (02): : 303 - 311
  • [24] Low-light image enhancement based on variational image decomposition
    Su, Yonggang
    Yang, Xuejie
    Multimedia Systems, 2024, 30 (06)
  • [25] FRR-NET: a fast reparameterized residual network for low-light image enhancement
    Chen, Yuhan
    Zhu, Ge
    Wang, Xianquan
    Yang, Huan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (05) : 4925 - 4934
  • [26] Exploring Fast and Flexible Zero-Shot Low-Light Image/Video Enhancement
    Han, Xianjun
    Bao, Taoli
    Yang, Hongyu
    Computer Graphics Forum, 2024, 43 (07)
  • [27] Fast, Zero-Reference Low-Light Image Enhancement with Camera Response Model
    Wang, Xiaofeng
    Huang, Liang
    Li, Mingxuan
    Han, Chengshan
    Liu, Xin
    Nie, Ting
    SENSORS, 2024, 24 (15)
  • [28] Attention Guided Low-Light Image Enhancement with a Large Scale Low-Light Simulation Dataset
    Feifan Lv
    Yu Li
    Feng Lu
    International Journal of Computer Vision, 2021, 129 : 2175 - 2193
  • [29] Attention Guided Low-Light Image Enhancement with a Large Scale Low-Light Simulation Dataset
    Lv, Feifan
    Li, Yu
    Lu, Feng
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (07) : 2175 - 2193
  • [30] Low-light image enhancement using inverted image normalized by atmospheric light
    Jeon, Jong Ju
    Eom, I. I. Kyu
    SIGNAL PROCESSING, 2022, 196