Integrating Parallel Attention Mechanisms and Multi-Scale Features for Infrared and Visible Image Fusion

被引:0
|
作者
Xu, Qian [1 ]
Zheng, Yuan [2 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
[2] Civil Aviat Flight Univ China, Sch Comp Sci, Guanghan 618311, Peoples R China
基金
中国国家自然科学基金;
关键词
Infrared and visible image fusion; parallel attention mechanism; multi-kernel convolution; MS-SSIM; PERFORMANCE; NETWORK; FRAMEWORK;
D O I
10.1109/ACCESS.2023.3348789
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared and visible image fusion (IVIF) aims to synthesize images that capitalize on the strengths of both modalities. Addressing the common challenge in IVIF of preserving thermal radiation from infrared and textural details from visible images, we introduce AMFusionNet. AMFusionNet uniquely combines a multi-kernel convolution block (MKCBlock) with parallel spatial attention and channel attention modules (PSCNet), streamlining the feature extraction process. This integration enhances the model's ability to simultaneously capture essential details from both image types. Additionally, we incorporate a multi-scale structural similarity (MS-SSIM) loss function in our comprehensive loss function to further refine the detail preservation in the fused images. Our experimental evaluations on the TNO and FLIR datasets demonstrate that AMFusionNet achieves superior performance in both objective and subjective assessments compared to recent methods.
引用
收藏
页码:8359 / 8372
页数:14
相关论文
共 50 条
  • [1] Infrared and visible image fusion based on multi-scale dense attention connection network
    Chen Y.
    Zhang J.
    Wang Z.
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (18): : 2253 - 2266
  • [2] MFT: Multi-scale Fusion Transformer for Infrared and Visible Image Fusion
    Zhang, Chen-Ming
    Yuan, Chengbo
    Luo, Yong
    Zhou, Xin
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 485 - 496
  • [3] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    [J]. Infrared Physics and Technology, 2022, 125
  • [4] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2022, 125
  • [5] Remote Sensing Image Registration Integrating Attention and Multi-Scale Features
    Ni, Lizheng
    Chen, Ying
    Li, Xiang
    Deng, Xiuhan
    Ma, Teng
    [J]. Computer Engineering and Applications, 61 (03): : 275 - 285
  • [6] A multi-scale information integration framework for infrared and visible image fusion
    Yang, Guang
    Li, Jie
    Lei, Hanxiao
    Gao, Xinbo
    [J]. NEUROCOMPUTING, 2024, 600
  • [7] Fusion of visible and infrared images based on multi-scale image enhancement
    Sun, Ming-Chao
    Zhang, Chong
    Liu, Jing-Hong
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2012, 42 (03): : 738 - 742
  • [8] Infrared and visible image fusion using multi-scale pyramid network
    Zuo, Fengyuan
    Huang, Yongdong
    Li, Qiufu
    Su, Weijian
    [J]. INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2022, 20 (05)
  • [9] MEEAFusion: Multi-Scale Edge Enhancement and Joint Attention Mechanism Based Infrared and Visible Image Fusion
    Xie, Yingjiang
    Fei, Zhennan
    Deng, Da
    Meng, Lingshuai
    Niu, Fu
    Sun, Jinggong
    [J]. SENSORS, 2024, 24 (17)
  • [10] Multi-scale attention-based lightweight network with dilated convolutions for infrared and visible image fusion
    Li, Fuquan
    Zhou, Yonghui
    Chen, YanLi
    Li, Jie
    Dong, ZhiCheng
    Tan, Mian
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (01) : 705 - 719