MMFuse: A multi-scale infrared and visible images fusion algorithm based on morphological reconstruction and membership filtering

被引:1
|
作者
Zhao, Liangjun [1 ,4 ]
Yang, Hao [1 ]
Dong, Linlu [2 ]
Zheng, Liping [1 ]
Asiya, Manlike [3 ]
Zheng, Fengling [3 ]
机构
[1] Sichuan Univ Sci & Engn, Comp Sci & Engn, Zigong, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Peoples R China
[3] Xinjiang Acad Anim Sci, Grassland Res Inst, Urumqi, Peoples R China
[4] Sichuan Key Prov Res Base Intelligent Tourism, Zigong, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Multi-scale transformation; Fuzzy c-means clustering(FCM); Morphological reconstruction (MR); SALIENCY ANALYSIS; PERFORMANCE; TRANSFORM; ENTROPY; LIGHT;
D O I
10.1049/ipr2.12701
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a multi-scale transformation method based on morphological reconstruction and membership filtering, termed as MMFuse, to fuse infrared and visible images. This method employs a fuzzy c-means clustering algorithm for multi-scale decomposition by introducing morphological reconstruction operations and modifying member partitions to ensure noise resistance and image detail preservation. In addition, the MMFuse utilises the image attributes of layers as their fusion weights at each scale for adaptive feature fusion, which reduces the difficulty of manual adjustment of fusion weights. Moreover, on the basis of histogram enhancement, a visible image enhancement method is proposed, which can help exploit additional texture details in low-light visible images and transfer these details to the fused image. The experiments performed on public datasets indicates that the MMFuse can generate sharp and clean fused images with high robustness and good fusion results for the images corrupted by different noises. Moreover, the results of this method appear as high-quality visible images with clear highlighted infrared targets.
引用
收藏
页码:1126 / 1148
页数:23
相关论文
共 50 条
  • [21] Fusion of infrared and visible images with propagation filtering
    Xing, Changda
    Wang, Zhisheng
    Dong, Chong
    INFRARED PHYSICS & TECHNOLOGY, 2018, 94 : 232 - 243
  • [22] Tone mapping infrared images using conditional filtering based multi-scale retinex
    Luo, Haibo
    Xu, Lingyun
    Hui, Bin
    Chang, Zheng
    AOPC 2015: IMAGE PROCESSING AND ANALYSIS, 2015, 9675
  • [23] Fusion of near-infrared and visible images based on saliency-map-guided multi-scale transformation decomposition
    Jun, Chen
    Lei, Cai
    Wei, Liu
    Yang, Yu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (22) : 34631 - 34651
  • [24] Fusion of near-infrared and visible images based on saliency-map-guided multi-scale transformation decomposition
    Chen Jun
    Cai Lei
    Liu Wei
    Yu Yang
    Multimedia Tools and Applications, 2023, 82 : 34631 - 34651
  • [25] An infrared and visible image fusion method based on multi-scale transformation and norm optimization
    Li, Guofa
    Lin, Yongjie
    Qu, Xingda
    INFORMATION FUSION, 2021, 71 : 109 - 129
  • [26] Infrared and visible image fusion based on multi-scale dense attention connection network
    Chen Y.
    Zhang J.
    Wang Z.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (18): : 2253 - 2266
  • [27] Infrared and visible image fusion enhancement technology based on multi-scale directional analysis
    Zhou Xin
    Liu Rui-an
    Chen Fin
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, : 4035 - 4037
  • [28] FEATURE EXTRACTION OF GYMNASTICS IMAGES BASED ON MULTI-SCALE FEATURE FUSION ALGORITHM
    Tian, Kun
    Xia, Qionghua
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (05): : 3394 - 3407
  • [29] Infrared/Radar Data Fusion and Tracking Algorithm Based on the Multi-Scale model
    Sun Yongli
    Wang Bingjian
    Yi Xiang
    Hu Ge
    AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462
  • [30] Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters
    Zhou, Zhiqiang
    Wang, Bo
    Li, Sun
    Dong, Mingjie
    INFORMATION FUSION, 2016, 30 : 15 - 26