Residual texture-aware infrared and visible image fusion with feature selection attention and adaptive loss

被引:0
|
作者
Pan, Zhigeng [1 ]
Lin, Haitao [1 ]
Wu, Quan [1 ]
Xu, Guili [2 ]
Yu, Qida [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Coll Artificial Intelligence, Coll Future Technol, Nanjing 210000, Jiangsu, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 211106, Jiangsu, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Coll Elect & Informat Engn, Nanjing 210000, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Infrared and visible image fusion; Perception; Residual texture-aware attention block module; Adaptive decision block; GENERATIVE ADVERSARIAL NETWORK; MULTI-FOCUS IMAGE; ENHANCEMENT;
D O I
10.1016/j.infrared.2024.105410
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Infrared and visible image fusion plays a critical role in combining complementary information gathered from both types of images, thus enhancing the visual quality and the perception in the resulting fused image. Thus, this paper introduces RTAAFusion which is, an innovative image fusion framework that incorporates unique components. This proposed technique employs a Residual Texture-Aware Attention Block Module (RTAABM), meticulously engineered to effectively capture image disparities and texture information. Furthermore, it includes a feature selection attention mechanism that accurately identifies the importance and the weights of the different image features, thereby facilitating a precise and efficient fusion process. The framework also features an Adaptive Decision Block Loss (ADBL), which allows the fusion model to be adjusted to the distinctive characteristics and requirements of various image regions, thus leading to more accurate and targeted fusion results. Comprehensive experiments and comparisons with leading-edge approaches reflected the superior performance of RTAAFusion in terms of visual perception, information conservation, and spatial details across challenging scenarios and a broad range of image features. Therefore, RTAAFusion delivers a fast execution speed and is versatile across different scenarios and image features. This proposed framework shows immense potential for diverse applications within the field of infrared and visible image fusion.
引用
下载
收藏
页数:17
相关论文
共 50 条
  • [41] Infrared and visible image fusion via parallel scene and texture learning
    Xu, Meilong
    Tang, Linfeng
    Zhang, Hao
    Ma, Jiayi
    PATTERN RECOGNITION, 2022, 132
  • [42] Infrared and visible image fusion via parallel scene and texture learning
    Xu, Meilong
    Tang, Linfeng
    Zhang, Hao
    Ma, Jiayi
    Pattern Recognition, 2022, 132
  • [43] Residual guided coordinate attention for selection channel aware image steganalysis
    Wei, Kangkang
    Luo, Weiqi
    Liu, Minglin
    Ye, Miaoxin
    MULTIMEDIA SYSTEMS, 2023, 29 (04) : 2125 - 2135
  • [44] Residual guided coordinate attention for selection channel aware image steganalysis
    Kangkang Wei
    Weiqi Luo
    Minglin Liu
    Miaoxin Ye
    Multimedia Systems, 2023, 29 : 2125 - 2135
  • [45] Multiscale feature pyramid network based on activity level weight selection for infrared and visible image fusion
    Xu, Rui
    Liu, Gang
    Xie, Yuning
    Prasad, Bavirisetti Durga
    Qian, Yao
    Xing, Mengliang
    Journal of the Optical Society of America A: Optics and Image Science, and Vision, 2022, 39 (12): : 2193 - 2204
  • [46] Multiscale feature pyramid network based on activity level weight selection for infrared and visible image fusion
    Xu, Rui
    Liu, Gang
    Xie, Yuning
    Prasad, Bavirisetti Durga
    Qian, Yao
    XIng, Mengliang
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2022, 39 (12) : 2193 - 2204
  • [47] MFST: Multi-Modal Feature Self-Adaptive Transformer for Infrared and Visible Image Fusion
    Liu, Xiangzeng
    Gao, Haojie
    Miao, Qiguang
    Xi, Yue
    Ai, Yunfeng
    Gao, Dingguo
    REMOTE SENSING, 2022, 14 (13)
  • [48] A degradation-aware guided fusion network for infrared and visible image
    Wang, Xue
    Guan, Zheng
    Qian, Wenhua
    Cao, Jinde
    Ma, Runzhuo
    Bi, Cong
    Information Fusion, 2025, 118
  • [49] IAIFNet: An Illumination-Aware Infrared and Visible Image Fusion Network
    Yang, Qiao
    Zhang, Yu
    Zhao, Zijing
    Zhang, Jian
    Zhang, Shunli
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1374 - 1378
  • [50] DDFNet-A: Attention-Based Dual-Branch Feature Decomposition Fusion Network for Infrared and Visible Image Fusion
    Wei, Qiancheng
    Liu, Ying
    Jiang, Xiaoping
    Zhang, Ben
    Su, Qiya
    Yu, Muyao
    REMOTE SENSING, 2024, 16 (10)