EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement

被引:4
|
作者
Zhang, Xin [1 ]
Wang, Xia [1 ]
Yan, Changda [1 ]
Sun, Qiyang [1 ]
机构
[1] Beijing Inst Technol, Key Lab Photoelect Imaging Technol & Syst, Minist Educ China, Beijing 100081, Peoples R China
关键词
Image color analysis; Image fusion; Feature extraction; Image enhancement; Task analysis; Sensor phenomena and characterization; Lighting; infrared and visible image; nighttime environment; visible image enhancement; FRAMEWORK; NEST;
D O I
10.1109/JSEN.2023.3346886
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared and visible image fusion can effectively integrate the advantages of two source images, preserving significant target information and rich texture details. However, most existing fusion methods are only designed for well-illuminated scenes and tend to lose details when encountering low-light scenes because of the poor brightness of visible images. Some methods incorporate a light adjustment module, but they typically focus only on enhancing intensity information and neglect the enhancement of color feature, resulting in unsatisfactory visual effects in the fused images. To address this issue, this article proposes a novel method called EV-fusion, which explores the potential color and detail features in visible images and improve the visual perception of fused images. Specifically, an unsupervised image enhancement module is designed that effectively restores texture, structure, and color information in visible images by several non-reference loss functions. Then, an intensity image fusion module is devised to integrate the enhanced visible image and the infrared image. Moreover, to improve the infrared salient object feature in the fused images, we propose an infrared bilateral-guided salience map embedding into the fusion loss functions. Extensive experiments demonstrate that our method outperforms state-of-the-art (SOTA) infrared visible image fusion methods.
引用
收藏
页码:4920 / 4934
页数:15
相关论文
共 50 条
  • [41] Low-light image enhancement using transformer with color fusion and channel attention
    Sun, Yinbang
    Sun, Jing
    Sun, Fuming
    Wang, Fasheng
    Li, Haojie
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (13): : 18365 - 18391
  • [42] Fusion-Based Low-Light Image Enhancement
    Wang, Haodian
    Wang, Yang
    Cao, Yang
    Zha, Zheng-Jun
    [J]. MULTIMEDIA MODELING, MMM 2023, PT I, 2023, 13833 : 121 - 133
  • [43] StyleFuse: An unsupervised network based on style loss function for infrared and visible image fusion
    Cheng, Chen
    Sun, Cheng
    Sun, Yongqi
    Zhu, Jiahui
    [J]. Signal Processing: Image Communication, 2022, 106
  • [44] Low-light True Color Image Enhancement Algorithm Based on Adaptive Truncation Simulation Exposure and Unsupervised Fusion
    Han Yongcheng
    Zhang Wenwen
    He Weiji
    Chen Qian
    [J]. ACTA PHOTONICA SINICA, 2023, 52 (09)
  • [45] Objective quality evaluation of visible and infrared color fusion image
    Yuan, Yihui
    Zhang, Junju
    Chang, Benkang
    Han, Yiyong
    [J]. OPTICAL ENGINEERING, 2011, 50 (03)
  • [46] A new color image fusion method for visible and infrared images
    Sun, Fengmei
    Li, Shutao
    Yang, Bin
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS, VOLS 1-5, 2007, : 2043 - 2048
  • [47] Unsupervised learning based dual-branch fusion low-light image enhancement
    Han, Guang
    Zhou, Yu
    Zeng, Fanyu
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (24) : 37593 - 37614
  • [48] Unsupervised learning based dual-branch fusion low-light image enhancement
    Guang Han
    Yu Zhou
    Fanyu Zeng
    [J]. Multimedia Tools and Applications, 2023, 82 : 37593 - 37614
  • [49] A NOVEL FUSION ALGORITHM of VISIBLE IMAGE AND INFRARED IMAGE BASED ON NSCT
    Cao, Zhenghong
    Guan, Yudong
    Wang, Peng
    Ti, Chunli
    [J]. ADVANCED RESEARCH ON ENGINEERING MATERIALS, ENERGY, MANAGEMENT AND CONTROL, PTS 1 AND 2, 2012, 424-425 : 223 - +
  • [50] Adjustable Visible and Infrared Image Fusion
    Wu, Boxiong
    Nie, Jiangtao
    Wei, Wei
    Zhang, Lei
    Zhang, Yanning
    [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34 (12) : 13463 - 13477