Unsupervised Illumination Adaptation for Low-Light Vision

被引:3
|
作者
Wang, Wenjing [1 ]
Luo, Rundong [1 ]
Yang, Wenhan [2 ]
Liu, Jiaying [1 ]
机构
[1] Peking Univ, Wangxuan Inst Comp Technol, Beijing 100080, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Training; Adaptation models; Lighting; Cameras; Data models; Face recognition; Domain adaptation; high-level vision; illumination enhancement; low-light; self-supervised learning; IMAGE; ENHANCEMENT; RETINEX;
D O I
10.1109/TPAMI.2024.3382108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Insufficient lighting poses challenges to both human and machine visual analytics. While existing low-light enhancement methods prioritize human visual perception, they often neglect machine vision and high-level semantics. In this paper, we make pioneering efforts to build an illumination enhancement model for high-level vision. Drawing inspiration from camera response functions, our model could enhance images from the machine vision perspective despite being lightweight in architecture and simple in formulation. We also introduce two approaches that leverage knowledge from base enhancement curves and self-supervised pretext tasks to train for different downstream normal-to-low-light adaptation scenarios. Our proposed framework overcomes the limitations of existing algorithms without requiring access to labeled data in low-light conditions. It facilitates more effective illumination restoration and feature alignment, significantly improving the performance of downstream tasks in a plug-and-play manner. This research advances the field of low-light machine analytics and broadly applies to various high-level vision tasks, including classification, face detection, optical flow estimation, and video action recognition.
引用
收藏
页码:5951 / 5966
页数:16
相关论文
共 50 条
  • [41] Low-light Level CMOS Sensor for Night Vision Systems
    Gross, Elad
    Ginat, Ran
    Nesher, Ofer
    INFRARED TECHNOLOGY AND APPLICATIONS XLI, 2015, 9451
  • [42] Bilevel Fast Scene Adaptation for Low-Light Image Enhancement
    Ma, Long
    Jin, Dian
    An, Nan
    Liu, Jinyuan
    Fan, Xin
    Luo, Zhongxuan
    Liu, Risheng
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023,
  • [43] Low-Light Image Enhancement via Implicit Priors Regularized Illumination Optimization
    Ma, Qianting
    Wang, Yang
    Zeng, Tieyong
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 944 - 953
  • [44] ITRE: Low-light image enhancement based on illumination transmission ratio estimation
    Wang, Yu
    Wang, Yihong
    Liu, Tong
    Li, Jinyu
    Sui, Xiubao
    Chen, Qian
    KNOWLEDGE-BASED SYSTEMS, 2024, 303
  • [45] Low-light image enhancement with joint illumination and noise data distribution transformation
    Guo, Sheng
    Wang, Wei
    Wang, Xiao
    Xu, Xin
    VISUAL COMPUTER, 2023, 39 (04): : 1363 - 1374
  • [46] Illumination-Aware Image Quality Assessment for Enhanced Low-Light Image
    Yao, Sigan
    Zhu, Yiqin
    Liang, Lingyu
    Wang, Tao
    PATTERN RECOGNITION AND COMPUTER VISION,, PT III, 2021, 13021 : 226 - 237
  • [47] Low-Light Image Enhancement With Regularized Illumination Optimization and Deep Noise Suppression
    Guo, Yu
    Lu, Yuxu
    Liu, Ryan Wen
    Yang, Meifang
    Chui, Kwok Tai
    IEEE ACCESS, 2020, 8 (145297-145315): : 145297 - 145315
  • [48] Content-illumination coupling guided low-light image enhancement network
    Zhao, Ruini
    Xie, Meilin
    Feng, Xubin
    Su, Xiuqin
    Zhang, Huiming
    Yang, Wei
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [49] Contrast Enhancement of Low-light Image Using Histogram Equalization and Illumination Adjustment
    Banik, Partha Pratim
    Saha, Rappy
    Kim, Ki-Doo
    2018 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2018, : 218 - 221
  • [50] The Modified Unsupervised Low-Light Image Enhancement Approach Based on the Retinex Theory
    Zhang, Yingchun
    Jiang, Shan
    Liu, Xuan
    2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 431 - 436