Residual texture-aware infrared and visible image fusion with feature selection attention and adaptive loss

被引:0
|
作者
Pan, Zhigeng [1 ]
Lin, Haitao [1 ]
Wu, Quan [1 ]
Xu, Guili [2 ]
Yu, Qida [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Coll Artificial Intelligence, Coll Future Technol, Nanjing 210000, Jiangsu, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 211106, Jiangsu, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Coll Elect & Informat Engn, Nanjing 210000, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Infrared and visible image fusion; Perception; Residual texture-aware attention block module; Adaptive decision block; GENERATIVE ADVERSARIAL NETWORK; MULTI-FOCUS IMAGE; ENHANCEMENT;
D O I
10.1016/j.infrared.2024.105410
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Infrared and visible image fusion plays a critical role in combining complementary information gathered from both types of images, thus enhancing the visual quality and the perception in the resulting fused image. Thus, this paper introduces RTAAFusion which is, an innovative image fusion framework that incorporates unique components. This proposed technique employs a Residual Texture-Aware Attention Block Module (RTAABM), meticulously engineered to effectively capture image disparities and texture information. Furthermore, it includes a feature selection attention mechanism that accurately identifies the importance and the weights of the different image features, thereby facilitating a precise and efficient fusion process. The framework also features an Adaptive Decision Block Loss (ADBL), which allows the fusion model to be adjusted to the distinctive characteristics and requirements of various image regions, thus leading to more accurate and targeted fusion results. Comprehensive experiments and comparisons with leading-edge approaches reflected the superior performance of RTAAFusion in terms of visual perception, information conservation, and spatial details across challenging scenarios and a broad range of image features. Therefore, RTAAFusion delivers a fast execution speed and is versatile across different scenarios and image features. This proposed framework shows immense potential for diverse applications within the field of infrared and visible image fusion.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] A dilated convolution parallel attention mechanism and texture contrast enhancement for infrared and visible image fusion
    Di, Jing
    Ren, Li
    Liu, Ji-Zhao
    Guo, Wen-Qing
    Lian, Jing
    Kongzhi yu Juece/Control and Decision, 2024, 39 (11): : 3586 - 3596
  • [22] Infrared and Visible Image Fusion Based on Adaptive Feature Enhancement and Generator Path Interaction
    Yejun, Yang
    Gang, Liu
    Gang, Xiao
    Xinjie, Gu
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (14)
  • [23] Infrared and visible image fusion for ship targets based on scale-aware feature decomposition
    Zheng, Xin
    Kang, Di
    Si, Pengbo
    Wu, Qiang
    IET IMAGE PROCESSING, 2022, 16 (14) : 3977 - 3987
  • [24] Multigrained Attention Network for Infrared and Visible Image Fusion
    Li, Jing
    Huo, Hongtao
    Li, Chang
    Wang, Renhua
    Sui, Chenhong
    Liu, Zhao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [25] Infrared Image Recognition of Substation Equipment Based on Adaptive Feature Fusion and Attention Mechanism
    Wang, Yuanbin
    Wu, Bingchao
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (09): : 3749 - 3756
  • [26] Interactive Feature Embedding for Infrared and Visible Image Fusion
    Zhao, Fan
    Zhao, Wenda
    Lu, Huchuan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 12810 - 12822
  • [27] Infrared and Visible Image Fusion Based on Sparse Feature
    Ding Wen-shan
    Bi Du-yan
    He Lin-yuan
    Fan Zun-lin
    Wu Dong-peng
    ACTA PHOTONICA SINICA, 2018, 47 (09)
  • [28] An Infrared and Visible Image Fusion Approach of Self-calibrated Residual Networks and Feature Embedding
    Dai J.
    Luo Z.
    Li C.
    Recent Advances in Computer Science and Communications, 2023, 16 (02) : 2 - 13
  • [29] MFAGAN: A multiscale feature-attention generative adversarial network for infrared and visible image fusion
    Tang, Xuanji
    Zhao, Jufeng
    Cui, Guangmang
    Tian, Haijun
    Shi, Zhen
    Hou, Changlun
    INFRARED PHYSICS & TECHNOLOGY, 2023, 133
  • [30] Infrared and visible image fusion using a feature attention guided perceptual generative adversarial network
    Chen Y.
    Zheng W.
    Shin H.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (07) : 9099 - 9112