MMFuse: A multi-scale infrared and visible images fusion algorithm based on morphological reconstruction and membership filtering

被引:1
|
作者
Zhao, Liangjun [1 ,4 ]
Yang, Hao [1 ]
Dong, Linlu [2 ]
Zheng, Liping [1 ]
Asiya, Manlike [3 ]
Zheng, Fengling [3 ]
机构
[1] Sichuan Univ Sci & Engn, Comp Sci & Engn, Zigong, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Peoples R China
[3] Xinjiang Acad Anim Sci, Grassland Res Inst, Urumqi, Peoples R China
[4] Sichuan Key Prov Res Base Intelligent Tourism, Zigong, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Multi-scale transformation; Fuzzy c-means clustering(FCM); Morphological reconstruction (MR); SALIENCY ANALYSIS; PERFORMANCE; TRANSFORM; ENTROPY; LIGHT;
D O I
10.1049/ipr2.12701
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a multi-scale transformation method based on morphological reconstruction and membership filtering, termed as MMFuse, to fuse infrared and visible images. This method employs a fuzzy c-means clustering algorithm for multi-scale decomposition by introducing morphological reconstruction operations and modifying member partitions to ensure noise resistance and image detail preservation. In addition, the MMFuse utilises the image attributes of layers as their fusion weights at each scale for adaptive feature fusion, which reduces the difficulty of manual adjustment of fusion weights. Moreover, on the basis of histogram enhancement, a visible image enhancement method is proposed, which can help exploit additional texture details in low-light visible images and transfer these details to the fused image. The experiments performed on public datasets indicates that the MMFuse can generate sharp and clean fused images with high robustness and good fusion results for the images corrupted by different noises. Moreover, the results of this method appear as high-quality visible images with clear highlighted infrared targets.
引用
收藏
页码:1126 / 1148
页数:23
相关论文
共 50 条
  • [41] An end-to-end multi-scale network based on autoencoder for infrared and visible image fusion
    Liu, Hongzhe
    Yan, Hua
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (13) : 20139 - 20156
  • [42] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    Infrared Physics and Technology, 2022, 125
  • [43] Infrared and visible image fusion based on hybrid multi-scale decomposition and adaptive contrast enhancement
    Luo, Yueying
    He, Kangjian
    Xu, Dan
    Shi, Hongzhen
    Yin, Wenxia
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2025, 130
  • [44] An end-to-end multi-scale network based on autoencoder for infrared and visible image fusion
    Hongzhe Liu
    Hua Yan
    Multimedia Tools and Applications, 2023, 82 : 20139 - 20156
  • [45] MGRCFusion: An infrared and visible image fusion network based on multi-scale group residual convolution
    Zhu, Pan
    Yin, Yufei
    Zhou, Xinglin
    OPTICS AND LASER TECHNOLOGY, 2025, 180
  • [46] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    INFRARED PHYSICS & TECHNOLOGY, 2022, 125
  • [47] Multi-scale infrared and visible image fusion framework based on dual partial differential equations
    Guo, Chentong
    Liu, Chenhua
    Deng, Lei
    Chen, Zhixiang
    Dong, Mingli
    Zhu, Lianqing
    Chen, Hanrui
    Lu, Xitian
    INFRARED PHYSICS & TECHNOLOGY, 2023, 135
  • [48] Infrared and visible image fusion based on saliency detection and deep multi-scale orientational features
    Liu, Gang
    Jia, Menghan
    Wang, Xiao
    Bavirisetti, Durga
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)
  • [49] Multi-scale decomposition based detail perception fusion algorithm for extreme exposure images
    Zhang J.
    Huang J.
    Yang D.
    Liang B.
    Chen J.
    Zhao D.
    Guofang Keji Daxue Xuebao/Journal of National University of Defense Technology, 2024, 46 (02): : 162 - 173
  • [50] A Multi-Scale Gradient Algorithm Based on Morphological Operators
    LU Guan-ming (Department of Information Engineering
    The Journal of China Universities of Posts and Telecommunications, 2000, (Z1) : 56 - 59