RNVE: A Real Nighttime Vision Enhancement Benchmark and Dual-Stream Fusion Network

被引:0
|
作者
Wang, Yuehang [1 ,2 ]
Zhang, Yongji [1 ,2 ]
Guo, Qianren [3 ]
Zhao, Minghao [4 ]
Jiang, Yu [1 ,2 ]
机构
[1] Jilin Univ, Key Lab Symbol Computat & Knowledge Engn, Minist Educ, Changchun 130012, Peoples R China
[2] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
[3] Jilin Univ, Coll Software, Changchun 130012, Peoples R China
[4] Jilin Univ, Coll Earth Sci, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Pipelines; Training; Semantics; Cameras; Signal processing algorithms; Visualization; Streaming media; Fusion network; image enhancement; low-light; nighttime vision; QUALITY ASSESSMENT; LIGHT ENHANCEMENT;
D O I
10.1109/LSP.2023.3343972
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured under challenging low-light conditions often suffer from myriad issues, including diminished contrast and obscured details, stemming from factors such as constrained lighting conditions or pervasive noise interference. Existing learning-based methods struggle in extreme low-light scenarios due to a lack of diverse paired datasets. In this letter, we meticulously curate a challenging real nighttime vision enhancement dataset called RNVE. RNVE comprises diverse data from various devices, including cameras and smartphones, available in both RGB and RAW formats. To enhance data diversity and enable comprehensive algorithm validation, we integrate synthetically generated low-light data, showcasing a spectrum of low-light effects. Additionally, we propose a low-light vision enhancement pipeline based on a dual-stream fusion network, proficiently improving the reconstruction quality of real nighttime scenes and restoring their authentic colors and contrast. Numerous experiments consistently demonstrate that the proposed pipeline excels in low-light enhancement and exhibits robust generalization capabilities across different datasets.
引用
下载
收藏
页码:131 / 135
页数:5
相关论文
共 50 条
  • [1] Dual-stream GNN fusion network for hyperspectral classification
    Weiming Li
    Qikang Liu
    Shuaishuai Fan
    Cong’an Xu
    Hongyang Bai
    Applied Intelligence, 2023, 53 : 26542 - 26567
  • [2] Dual-stream GNN fusion network for hyperspectral classification
    Li, Weiming
    Liu, Qikang
    Fan, Shuaishuai
    Xu, Cong'an
    Bai, Hongyang
    APPLIED INTELLIGENCE, 2023, 53 (22) : 26542 - 26567
  • [3] Dual-Stream Intermediate Fusion Network for Image Forgery Localization
    Yan, Caiping
    Liu, Renhai
    Li, Hong
    Wu, Jinghui
    Pan, Haojie
    IEEE ACCESS, 2024, 12 : 90511 - 90524
  • [4] A DUAL-STREAM CONVOLUTIONAL FEATURE FUSION NETWORK FOR HYPERSPECTRAL UNMIXING
    Hua, Haoyue
    Li, Jie
    Wang, Ying
    Gao, Xinbo
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7531 - 7534
  • [5] Modular dual-stream visual fusion network for visual question answering
    Xue, Lixia
    Wang, Wenhao
    Wang, Ronggui
    Yang, Juan
    VISUAL COMPUTER, 2024, : 549 - 562
  • [6] HDNet: A dual-stream network with progressive fusion for image hazing detection
    Chen, Jiyou
    Yang, Gaobo
    Xia, Ming
    Guo, Zhiqing
    Huang, Tianqiang
    JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2022, 69
  • [7] Dual-stream feature fusion network for person re-identification
    Zhang, Wenbin
    Li, Zhaoyang
    Du, Haishun
    Tong, Jiangang
    Liu, Zhihua
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
  • [8] Dual-Stream Convolutional Neural Network With Residual Information Enhancement for Pansharpening
    Yang, Yong
    Tu, Wei
    Huang, Shuying
    Lu, Hangyuan
    Wan, Weiguo
    Gan, Lixin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] A WAVELET-BASED DUAL-STREAM NETWORK FOR UNDERWATER IMAGE ENHANCEMENT
    Ma, Ziyin
    Oh, Changjae
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2769 - 2773
  • [10] Dual-Stream Fusion Network for Spatiotemporal Video Super-Resolution
    Tseng, Min-Yuan
    Chen, Yen-Chung
    Lee, Yi-Lun
    Lai, Wei-Sheng
    Tsai, Yi-Hsuan
    Chiu, Wei-Chen
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2683 - 2692