MMFuse: A multi-scale infrared and visible images fusion algorithm based on morphological reconstruction and membership filtering

被引:1
|
作者
Zhao, Liangjun [1 ,4 ]
Yang, Hao [1 ]
Dong, Linlu [2 ]
Zheng, Liping [1 ]
Asiya, Manlike [3 ]
Zheng, Fengling [3 ]
机构
[1] Sichuan Univ Sci & Engn, Comp Sci & Engn, Zigong, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Peoples R China
[3] Xinjiang Acad Anim Sci, Grassland Res Inst, Urumqi, Peoples R China
[4] Sichuan Key Prov Res Base Intelligent Tourism, Zigong, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Multi-scale transformation; Fuzzy c-means clustering(FCM); Morphological reconstruction (MR); SALIENCY ANALYSIS; PERFORMANCE; TRANSFORM; ENTROPY; LIGHT;
D O I
10.1049/ipr2.12701
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a multi-scale transformation method based on morphological reconstruction and membership filtering, termed as MMFuse, to fuse infrared and visible images. This method employs a fuzzy c-means clustering algorithm for multi-scale decomposition by introducing morphological reconstruction operations and modifying member partitions to ensure noise resistance and image detail preservation. In addition, the MMFuse utilises the image attributes of layers as their fusion weights at each scale for adaptive feature fusion, which reduces the difficulty of manual adjustment of fusion weights. Moreover, on the basis of histogram enhancement, a visible image enhancement method is proposed, which can help exploit additional texture details in low-light visible images and transfer these details to the fused image. The experiments performed on public datasets indicates that the MMFuse can generate sharp and clean fused images with high robustness and good fusion results for the images corrupted by different noises. Moreover, the results of this method appear as high-quality visible images with clear highlighted infrared targets.
引用
收藏
页码:1126 / 1148
页数:23
相关论文
共 50 条
  • [1] An improved fusion algorithm for infrared and visible images based on multi-scale transform
    Li, He
    Liu, Lei
    Huang, Wei
    Yue, Chao
    INFRARED PHYSICS & TECHNOLOGY, 2016, 74 : 28 - 37
  • [2] Infrared and visible images fusion based on improved multi-scale structural fusion
    Long Z.
    Deng Y.
    Xie J.
    Wang R.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (07): : 1101 - 1110
  • [3] Multi-scale Fusion of Stretched Infrared and Visible Images
    Jia, Weibin
    Song, Zhihuan
    Li, Zhengguo
    SENSORS, 2022, 22 (17)
  • [4] Fusion of visible and infrared images based on multi-scale image enhancement
    Sun, Ming-Chao
    Zhang, Chong
    Liu, Jing-Hong
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2012, 42 (03): : 738 - 742
  • [5] Fusion method for infrared and other-type images based on the multi-scale Gaussian filtering and morphological transform
    Li Zhi-Jian
    Yang Feng-Bao
    Gao Yu-Bin
    Ji Lin-Na
    Hu Peng
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2020, 39 (06) : 810 - 817
  • [6] BDMFuse: Multi-scale network fusion for infrared and visible images based on base and detail features
    Si, Hai-Ping
    Zhao, Wen-Rui
    Li, Ting-Ting
    Li, Fei-Tao
    Fernado, Bacao
    Sun, Chang-Xia
    Li, Yan-Ling
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2025, 44 (02) : 275 - 284
  • [7] Change Detection Based on Fusion Difference Image and Multi-Scale Morphological Reconstruction for SAR Images
    Xuan, Jiayu
    Xin, Zhihui
    Liao, Guisheng
    Huang, Penghui
    Wang, Zhixu
    Sun, Yu
    REMOTE SENSING, 2022, 14 (15)
  • [8] Fusion of Infrared and Visible Images based on Multi-scale Edge-preserving Decomposition and Sparse Representation
    Rong, Chuanzhen
    Jia, Yongxing
    Yang, Yu
    Zhu, Ying
    Wang, Yuan
    2018 11TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2018), 2018,
  • [9] LMHFusion: A lightweight multi-scale hierarchical dense fusion network for infrared and visible images
    Liping Zhang
    Zhengyu Guo
    Delin Luo
    Science China Technological Sciences, 2025, 68 (5)
  • [10] FCM Segmentation Algorithm Based on Morphological Reconstruction and Membership Filtering
    Duan P.
    Cheng W.
    Qian Q.
    Zhang Q.
    Gao D.
    Yang R.
    Pan Y.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (04): : 541 - 551