Flow Learning Based Dual Networks for Low-Light Image Enhancement

被引:0
|
作者
Wang, Siyu [1 ,2 ]
Hu, Changhui [1 ,2 ]
Yi, Weilin [1 ,2 ]
Cai, Ziyun [1 ,2 ]
Zhai, Mingliang [1 ,2 ]
Yang, Wankou [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Automat, 9 Wenyuan Rd, Nanjing 210023, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Coll Artificial Intelligence, 9 Wenyuan Rd, Nanjing 210023, Jiangsu, Peoples R China
[3] Southeast Univ, Sch Automat, 2 Sipailou, Nanjing 210018, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Conditional normalizing flow; Residual; Unet; Swin transformer;
D O I
10.1007/s11063-023-11303-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The deep learning-based low-light image enhancement task aims to learn a mapping that converts low-light images to normally exposed images by training with paired or unpaired datasets. Most of these existing methods are based on convolutional neural networks, which largely limits the network's ability to learn global information. Meanwhile, the reconstruction loss or adversarial loss they adopt often cannot accurately measure the visual distance between the prediction and the target, resulting in blurred regions in the enhancement results. In this paper, we propose a novel flow learning based dual networks (FDN), which consists of a dual network and a flow learning based model. The dual network is mainly composed of a reidual-based Unet encoder and a residual-based Swin Transformer encoder, which can make up for the lack of global information processing and has more advantages in processing deep and shallow information. Moreover, we use a single loss function named negative log-likelihood to train the entire network, which enables the flow models to adequately learn the complex conditional distribution of normally exposed images and avoid blurry outputs. Experimental results on two benchmark datasets show that the proposed FDN method can achieve the sate-of-the-art performances on low-light image enhancement task.
引用
收藏
页码:8115 / 8130
页数:16
相关论文
共 50 条
  • [1] Flow Learning Based Dual Networks for Low-Light Image Enhancement
    Siyu Wang
    Changhui Hu
    Weilin Yi
    Ziyun Cai
    Mingliang Zhai
    Wankou Yang
    [J]. Neural Processing Letters, 2023, 55 : 8115 - 8130
  • [2] Low-Light Image Enhancement via Dual Information-Based Networks
    Liu, Manlu
    Li, Xiangsheng
    Fang, Yi
    [J]. ELECTRONICS, 2024, 13 (18)
  • [3] Unsupervised learning based dual-branch fusion low-light image enhancement
    Han, Guang
    Zhou, Yu
    Zeng, Fanyu
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (24) : 37593 - 37614
  • [4] Unsupervised learning based dual-branch fusion low-light image enhancement
    Guang Han
    Yu Zhou
    Fanyu Zeng
    [J]. Multimedia Tools and Applications, 2023, 82 : 37593 - 37614
  • [5] Zero-shot Learning for Low-light Image Enhancement Based on Dual Iteration
    Xiang Sen
    Wang Yingfeng
    Deng Huiping
    Wu Jin
    Yu Li
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (10) : 3379 - 3388
  • [6] Low-Light Image Enhancement with Normalizing Flow
    Wang, Yufei
    Wan, Renjie
    Yang, Wenhan
    Li, Haoliang
    Chau, Lap-Pui
    Kot, Alex
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2604 - 2612
  • [7] Low-light image enhancement based on deep learning: a survey
    Wang, Yong
    Xie, Wenjie
    Liu, Hongqi
    [J]. OPTICAL ENGINEERING, 2022, 61 (04)
  • [8] Dual-band low-light image enhancement
    Aizhong Mi
    Wenhui Luo
    Zhanqiang Huo
    [J]. Multimedia Systems, 2024, 30
  • [9] Dual-band low-light image enhancement
    Mi, Aizhong
    Luo, Wenhui
    Huo, Zhanqiang
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (02)
  • [10] An Improved Low-Light Image Enhancement Algorithm Based on Deep Learning
    Chen, Wen
    Hu, Chao
    [J]. ADVANCED INTELLIGENT TECHNOLOGIES FOR INDUSTRY, 2022, 285 : 563 - 572