Bilevel Fast Scene Adaptation for Low-Light Image Enhancement

被引:20
|
作者
Ma, Long [1 ]
Jin, Dian [2 ]
An, Nan [3 ]
Liu, Jinyuan [4 ]
Fan, Xin [1 ]
Luo, Zhongxuan [3 ]
Liu, Risheng [1 ]
机构
[1] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Engn, Dalian 116024, Peoples R China
[2] Xiaomi AI Lab, Beijing 100085, Peoples R China
[3] Dalian Univ Technol, Sch Software Technol, Dalian 116024, Peoples R China
[4] Dalian Univ Technol, Sch Mech Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Image denoising; Fast adaptation; Bilevel optimization; Hyperparameter optimization; Meta learning;
D O I
10.1007/s11263-023-01900-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Enhancing images in low-light scenes is a challenging but widely concerned task in the computer vision. The mainstream learning-based methods mainly acquire the enhanced model by learning the data distribution from the specific scenes, causing poor adaptability (even failure) when meeting real-world scenarios that have never been encountered before. The main obstacle lies in the modeling conundrum from distribution discrepancy across different scenes. To remedy this, we first explore relationships between diverse low-light scenes based on statistical analysis, i.e., the network parameters of the encoder trained in different data distributions are close. We introduce the bilevel paradigm to model the above latent correspondence from the perspective of hyperparameter optimization. A bilevel learning framework is constructed to endow the scene-irrelevant generality of the encoder towards diverse scenes (i.e., freezing the encoder in the adaptation and testing phases). Further, we define a reinforced bilevel learning framework to provide a meta-initialization for scene-specific decoder to further ameliorate visual quality. Moreover, to improve the practicability, we establish a Retinex-induced architecture with adaptive denoising and apply our built learning framework to acquire its parameters by using two training losses including supervised and unsupervised forms. Extensive experimental evaluations on multiple datasets verify our adaptability and competitive performance against existing state-of-the-art works. The code and datasets will be available at https://github.com/vis-opt-group/BL.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Low-light Image Enhancement with Domain Adaptation
    Zhang, Yunjie
    Gao, Bin
    [J]. 2022 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY, HUMAN-COMPUTER INTERACTION AND ARTIFICIAL INTELLIGENCE, VRHCIAI, 2022, : 55 - 60
  • [2] Extremely Low-Light Image Enhancement with Scene Text Restoration
    Hsu, Po-Hao
    Lin, Che-Tsung
    Ng, Chun Chet
    Kew, Jie Long
    Tan, Mei Yih
    Lai, Shang-Hong
    Chan, Chee Seng
    Zach, Christopher
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 317 - 323
  • [3] Bridging the Gap between Low-Light Scenes: Bilevel Learning for Fast Adaptation
    Jin, Dian
    Ma, Long
    Liu, Risheng
    Fan, Xin
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2401 - 2409
  • [4] Combining Low-Light Scene Enhancement for Fast and Accurate Lane Detection
    Ke, Changshuo
    Xu, Zhijie
    Zhang, Jianqin
    Zhang, Dongmei
    [J]. SENSORS, 2023, 23 (10)
  • [5] Toward Fast, Flexible, and Robust Low-Light Image Enhancement
    Ma, Long
    Ma, Tengyu
    Liu, Risheng
    Fan, Xin
    Luo, Zhongxuan
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5627 - 5636
  • [6] Retinex-Based Fast Algorithm for Low-Light Image Enhancement
    Liu, Shouxin
    Long, Wei
    He, Lei
    Li, Yanyan
    Ding, Wei
    [J]. ENTROPY, 2021, 23 (06)
  • [7] Lightweight and Fast Low-Light Image Enhancement Method Based on PoolFormer
    Hu, Xin
    Wang, Jinhua
    Xu, Sunhan
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2024, E107D (01) : 157 - 160
  • [8] Low-Light Hyperspectral Image Enhancement
    Li, Xuelong
    Li, Guanlin
    Zhao, Bin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Low-Light Stereo Image Enhancement
    Huang, Jie
    Fu, Xueyang
    Xiao, Zeyu
    Zhao, Feng
    Xiong, Zhiwei
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2978 - 2992
  • [10] Decoupled Low-Light Image Enhancement
    Hao, Shijie
    Han, Xu
    Guo, Yanrong
    Wang, Meng
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (04)