MMFuse: A multi-scale infrared and visible images fusion algorithm based on morphological reconstruction and membership filtering

被引:1
|
作者
Zhao, Liangjun [1 ,4 ]
Yang, Hao [1 ]
Dong, Linlu [2 ]
Zheng, Liping [1 ]
Asiya, Manlike [3 ]
Zheng, Fengling [3 ]
机构
[1] Sichuan Univ Sci & Engn, Comp Sci & Engn, Zigong, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Peoples R China
[3] Xinjiang Acad Anim Sci, Grassland Res Inst, Urumqi, Peoples R China
[4] Sichuan Key Prov Res Base Intelligent Tourism, Zigong, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Multi-scale transformation; Fuzzy c-means clustering(FCM); Morphological reconstruction (MR); SALIENCY ANALYSIS; PERFORMANCE; TRANSFORM; ENTROPY; LIGHT;
D O I
10.1049/ipr2.12701
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a multi-scale transformation method based on morphological reconstruction and membership filtering, termed as MMFuse, to fuse infrared and visible images. This method employs a fuzzy c-means clustering algorithm for multi-scale decomposition by introducing morphological reconstruction operations and modifying member partitions to ensure noise resistance and image detail preservation. In addition, the MMFuse utilises the image attributes of layers as their fusion weights at each scale for adaptive feature fusion, which reduces the difficulty of manual adjustment of fusion weights. Moreover, on the basis of histogram enhancement, a visible image enhancement method is proposed, which can help exploit additional texture details in low-light visible images and transfer these details to the fused image. The experiments performed on public datasets indicates that the MMFuse can generate sharp and clean fused images with high robustness and good fusion results for the images corrupted by different noises. Moreover, the results of this method appear as high-quality visible images with clear highlighted infrared targets.
引用
收藏
页码:1126 / 1148
页数:23
相关论文
共 50 条
  • [31] MPCFusion: Multi-scale parallel cross fusion for infrared and visible images via convolution and vision Transformer
    Tang, Haojie
    Qian, Yao
    Xing, Mengliang
    Cao, Yisheng
    Liu, Gang
    OPTICS AND LASERS IN ENGINEERING, 2024, 176
  • [32] Study on defect detection of morphological infrared images based on optimal multi-scale set
    Kang S.
    Chen C.
    Liu S.
    Zhou B.
    Tang W.
    Taiyangneng Xuebao/Acta Energiae Solaris Sinica, 2022, 43 (06): : 145 - 152
  • [33] Thermal Infrared-Image-Enhancement Algorithm Based on Multi-Scale Guided Filtering
    Li, Huaizhou
    Wang, Shuaijun
    Li, Sen
    Wang, Hong
    Wen, Shupei
    Li, Fengyu
    FIRE-SWITZERLAND, 2024, 7 (06):
  • [34] A multi-scale information integration framework for infrared and visible image fusion
    Yang, Guang
    Li, Jie
    Lei, Hanxiao
    Gao, Xinbo
    NEUROCOMPUTING, 2024, 600
  • [35] Prompt learning and multi-scale attention for infrared and visible image fusion
    Li, Yanan
    Ji, Qingtao
    Jiao, Shaokang
    INFRARED PHYSICS & TECHNOLOGY, 2025, 145
  • [36] Infrared and visible image fusion using multi-scale pyramid network
    Zuo, Fengyuan
    Huang, Yongdong
    Li, Qiufu
    Su, Weijian
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2022, 20 (05)
  • [37] Fusion Algorithm of Infrared and Visible Images Based on NSCT and PCNN
    Chen, Guo Li
    PROCESSING OF 2014 INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INFORMATION INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), 2014,
  • [38] Algorithm for visible and infrared images fusion based on visual attention
    Chen, Yanfei
    Sang, Nong
    Wang, Hongwei
    Dan, Zhiping
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2013, 41 (SUPPL.I): : 112 - 115
  • [39] Fusion Algorithm of Infrared and Visible Images Based on Multiresolution Decomposition
    Ding, Chen
    MEASUREMENT TECHNOLOGY AND ITS APPLICATION, PTS 1 AND 2, 2013, 239-240 : 229 - 232
  • [40] Infrared and Visible Images Fusion Algorithm Based on NSST and IFCNN
    Yang Yanchun
    Gao Xiaoyu
    Dang Jianwu
    Wang Yangping
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (20)