EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement

被引:4
|
作者
Zhang, Xin [1 ]
Wang, Xia [1 ]
Yan, Changda [1 ]
Sun, Qiyang [1 ]
机构
[1] Beijing Inst Technol, Key Lab Photoelect Imaging Technol & Syst, Minist Educ China, Beijing 100081, Peoples R China
关键词
Image color analysis; Image fusion; Feature extraction; Image enhancement; Task analysis; Sensor phenomena and characterization; Lighting; infrared and visible image; nighttime environment; visible image enhancement; FRAMEWORK; NEST;
D O I
10.1109/JSEN.2023.3346886
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared and visible image fusion can effectively integrate the advantages of two source images, preserving significant target information and rich texture details. However, most existing fusion methods are only designed for well-illuminated scenes and tend to lose details when encountering low-light scenes because of the poor brightness of visible images. Some methods incorporate a light adjustment module, but they typically focus only on enhancing intensity information and neglect the enhancement of color feature, resulting in unsatisfactory visual effects in the fused images. To address this issue, this article proposes a novel method called EV-fusion, which explores the potential color and detail features in visible images and improve the visual perception of fused images. Specifically, an unsupervised image enhancement module is designed that effectively restores texture, structure, and color information in visible images by several non-reference loss functions. Then, an intensity image fusion module is devised to integrate the enhanced visible image and the infrared image. Moreover, to improve the infrared salient object feature in the fused images, we propose an infrared bilateral-guided salience map embedding into the fusion loss functions. Extensive experiments demonstrate that our method outperforms state-of-the-art (SOTA) infrared visible image fusion methods.
引用
收藏
页码:4920 / 4934
页数:15
相关论文
共 50 条
  • [31] Low-light image enhancement network with decomposition and adaptive information fusion
    Zhu, Hegui
    Wang, Kai
    Zhang, Ziwei
    Liu, Yuelin
    Jiang, Wuming
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (10): : 7733 - 7748
  • [32] Unsupervised end-to-end infrared and visible image fusion network using learnable fusion strategy
    Chen, Yili
    Wan, Minjie
    Xu, Yunkai
    Cao, Xiqing
    Zhang, Xiaojie
    Chen, Qian
    Gu, Gouhua
    [J]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2022, 39 (12) : 2257 - 2270
  • [33] A Noisy Infrared and Visible Light Image Fusion Algorithm
    Shen, Yu
    Xiang, Keyun
    Chen, Xiaopeng
    Liu, Cheng
    [J]. JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2021, 17 (05): : 1004 - 1019
  • [34] Infrared and Visible Light Image Fusion Based on Image Enhancement and Secondary Nonsubsampled Contourlet Transform
    Zhao Qingdian
    Yang Dehong
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (04)
  • [35] An Efficient Network Model for Visible and Infrared Image Fusion
    Pan, Zhu
    Ouyang, Wanqi
    [J]. IEEE ACCESS, 2023, 11 : 86413 - 86430
  • [36] Multigrained Attention Network for Infrared and Visible Image Fusion
    Li, Jing
    Huo, Hongtao
    Li, Chang
    Wang, Renhua
    Sui, Chenhong
    Liu, Zhao
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [37] SimpliFusion: a simplified infrared and visible image fusion network
    Liu, Yong
    Li, Xingyuan
    Liu, Yong
    Zhong, Wei
    [J]. VISUAL COMPUTER, 2024,
  • [38] CFNet: An infrared and visible image compression fusion network
    Xing, Mengliang
    Liu, Gang
    Tang, Haojie
    Qian, Yao
    Zhang, Jun
    [J]. PATTERN RECOGNITION, 2024, 156
  • [39] Infrared and Visible Image Fusion via Decoupling Network
    Wang, Xue
    Guan, Zheng
    Yu, Shishuang
    Cao, Jinde
    Li, Ya
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [40] Target interpretation of visible light image and infrared image fusion method
    Sun, Wei
    Xiao, Wen
    Pan, Feng
    Du, Chao
    [J]. AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462