EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement

被引:4
|
作者
Zhang, Xin [1 ]
Wang, Xia [1 ]
Yan, Changda [1 ]
Sun, Qiyang [1 ]
机构
[1] Beijing Inst Technol, Key Lab Photoelect Imaging Technol & Syst, Minist Educ China, Beijing 100081, Peoples R China
关键词
Image color analysis; Image fusion; Feature extraction; Image enhancement; Task analysis; Sensor phenomena and characterization; Lighting; infrared and visible image; nighttime environment; visible image enhancement; FRAMEWORK; NEST;
D O I
10.1109/JSEN.2023.3346886
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared and visible image fusion can effectively integrate the advantages of two source images, preserving significant target information and rich texture details. However, most existing fusion methods are only designed for well-illuminated scenes and tend to lose details when encountering low-light scenes because of the poor brightness of visible images. Some methods incorporate a light adjustment module, but they typically focus only on enhancing intensity information and neglect the enhancement of color feature, resulting in unsatisfactory visual effects in the fused images. To address this issue, this article proposes a novel method called EV-fusion, which explores the potential color and detail features in visible images and improve the visual perception of fused images. Specifically, an unsupervised image enhancement module is designed that effectively restores texture, structure, and color information in visible images by several non-reference loss functions. Then, an intensity image fusion module is devised to integrate the enhanced visible image and the infrared image. Moreover, to improve the infrared salient object feature in the fused images, we propose an infrared bilateral-guided salience map embedding into the fusion loss functions. Extensive experiments demonstrate that our method outperforms state-of-the-art (SOTA) infrared visible image fusion methods.
引用
收藏
页码:4920 / 4934
页数:15
相关论文
共 50 条
  • [1] Low-light image enhancement for infrared and visible image fusion
    Zhou, Yiqiao
    Xie, Lisiqi
    He, Kangjian
    Xu, Dan
    Tao, Dapeng
    Lin, Xu
    [J]. IET IMAGE PROCESSING, 2023, 17 (11) : 3216 - 3234
  • [2] LENFusion: A Joint Low-Light Enhancement and Fusion Network for Nighttime Infrared and Visible Image Fusion
    Chen, Jun
    Yang, Liling
    Liu, Wei
    Tian, Xin
    Ma, Jiayi
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 15
  • [3] Contrast Enhanced Low-light Visible and Infrared Image Fusion
    Teku, Sandhya Kumari
    Rao, S. Koteswara
    Prabha, I. Santhi
    [J]. DEFENCE SCIENCE JOURNAL, 2016, 66 (03) : 266 - 271
  • [4] Research on fusion technology based on low-light visible image and infrared image
    Liu, Shuo
    Piao, Yan
    Tahir, Muhammad
    [J]. OPTICAL ENGINEERING, 2016, 55 (12)
  • [5] COLOR CHANNEL FUSION NETWORK FOR LOW-LIGHT IMAGE ENHANCEMENT
    Zhao, Lingchao
    Gong, Xiaolin
    Liu, Kaihua
    Wang, Jian
    Zhao, Bai
    Liu, Yu
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1654 - 1658
  • [6] AN IMPROVED FUSION METHOD FOR INFRARED AND LOW-LIGHT LEVEL VISIBLE IMAGE
    Wu, Ruiqing
    Yu, Dayan
    Liu, Jian
    Wu, Hao
    Chen, Wei
    Gu, Qingshui
    [J]. 2017 14TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2017, : 147 - 151
  • [7] L2FUSION: LOW-LIGHT ORIENTED INFRARED AND VISIBLE IMAGE FUSION
    Gao, Xiang
    Lv, Guohua
    Dong, Aimei
    Wei, Zhonghe
    Cheng, Jinyong
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2405 - 2409
  • [8] Unsupervised Boosted Fusion Network for Single Low-Light Image Enhancement
    Zhang, Jianfeng
    Li, Hengxuan
    Huo, Zhanqiang
    [J]. IEEE Access, 2024, 12 : 179252 - 179264
  • [9] Infrared and visible image fusion via salient object extraction and low-light region enhancement
    Liu, Yaochen
    Dong, Lili
    Xu, Wenhai
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2022, 124
  • [10] Low-Light Infrared and Visible Image Fusion with Imbalanced Thermal Radiation Distribution
    Lei, Xinyu
    Liu, Longjun
    Jia, Puhang
    Li, Haoteng
    Zhang, Haonan
    [J]. IEEE Transactions on Instrumentation and Measurement, 2024, 73