Bilevel Fast Scene Adaptation for Low-Light Image Enhancement

被引:20
|
作者
Ma, Long [1 ]
Jin, Dian [2 ]
An, Nan [3 ]
Liu, Jinyuan [4 ]
Fan, Xin [1 ]
Luo, Zhongxuan [3 ]
Liu, Risheng [1 ]
机构
[1] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Engn, Dalian 116024, Peoples R China
[2] Xiaomi AI Lab, Beijing 100085, Peoples R China
[3] Dalian Univ Technol, Sch Software Technol, Dalian 116024, Peoples R China
[4] Dalian Univ Technol, Sch Mech Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Image denoising; Fast adaptation; Bilevel optimization; Hyperparameter optimization; Meta learning;
D O I
10.1007/s11263-023-01900-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Enhancing images in low-light scenes is a challenging but widely concerned task in the computer vision. The mainstream learning-based methods mainly acquire the enhanced model by learning the data distribution from the specific scenes, causing poor adaptability (even failure) when meeting real-world scenarios that have never been encountered before. The main obstacle lies in the modeling conundrum from distribution discrepancy across different scenes. To remedy this, we first explore relationships between diverse low-light scenes based on statistical analysis, i.e., the network parameters of the encoder trained in different data distributions are close. We introduce the bilevel paradigm to model the above latent correspondence from the perspective of hyperparameter optimization. A bilevel learning framework is constructed to endow the scene-irrelevant generality of the encoder towards diverse scenes (i.e., freezing the encoder in the adaptation and testing phases). Further, we define a reinforced bilevel learning framework to provide a meta-initialization for scene-specific decoder to further ameliorate visual quality. Moreover, to improve the practicability, we establish a Retinex-induced architecture with adaptive denoising and apply our built learning framework to acquire its parameters by using two training losses including supervised and unsupervised forms. Extensive experimental evaluations on multiple datasets verify our adaptability and competitive performance against existing state-of-the-art works. The code and datasets will be available at https://github.com/vis-opt-group/BL.
引用
下载
收藏
页数:19
相关论文
共 50 条
  • [31] Low-light image enhancement based on normal-light image degradation
    Zhao, Bai
    Gong, Xiaolin
    Wang, Jian
    Zhao, Lingchao
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (05) : 1409 - 1416
  • [32] SurroundNet: Towards effective low-light image enhancement
    Zhou, Fei
    Sun, Xin
    Dong, Junyu
    Zhu, Xiao Xiang
    PATTERN RECOGNITION, 2023, 141
  • [33] Low-light color image enhancement based on NSST
    Wu Xiaochu
    Tang Guijin
    Liu Xiaohua
    Cui Ziguan
    Luo Suhuai
    The Journal of China Universities of Posts and Telecommunications, 2019, 26 (05) : 41 - 48
  • [34] Low-light image enhancement with geometrical sparse representation
    Jin Tan
    Taiping Zhang
    Linchang Zhao
    Darong Huang
    Zhenyuan Zhang
    Applied Intelligence, 2023, 53 : 11019 - 11033
  • [35] Invertible network for unpaired low-light image enhancement
    Jize Zhang
    Haolin Wang
    Xiaohe Wu
    Wangmeng Zuo
    The Visual Computer, 2024, 40 : 109 - 120
  • [36] Generative adversarial network for low-light image enhancement
    Li, Fei
    Zheng, Jiangbin
    Zhang, Yuan-fang
    IET IMAGE PROCESSING, 2021, 15 (07) : 1542 - 1552
  • [37] Image Enhancement for Remote Photoplethysmography in a Low-Light Environment
    Xi, Lin
    Chen, Weihai
    Zhao, Changchen
    Wu, Xingming
    Wang, Jianhua
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 1 - 7
  • [38] Retinex-based Low-Light Image Enhancement
    Luo, Rui
    Feng, Yan
    He, Mingxin
    Zhang, Yuliang
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 1429 - 1434
  • [39] Low-light color image enhancement based on NSST
    Wu Xiaochu
    Tang Guijin
    Liu Xiaohua
    Cui Ziguan
    Luo Suhuai
    The Journal of China Universities of Posts and Telecommunications, 2019, (05) : 41 - 48
  • [40] Low-light image enhancement by diffusion pyramid with residuals
    Kim, Wonjun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81