Residual texture-aware infrared and visible image fusion with feature selection attention and adaptive loss

被引:0
|
作者
Pan, Zhigeng [1 ]
Lin, Haitao [1 ]
Wu, Quan [1 ]
Xu, Guili [2 ]
Yu, Qida [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Coll Artificial Intelligence, Coll Future Technol, Nanjing 210000, Jiangsu, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 211106, Jiangsu, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Coll Elect & Informat Engn, Nanjing 210000, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Infrared and visible image fusion; Perception; Residual texture-aware attention block module; Adaptive decision block; GENERATIVE ADVERSARIAL NETWORK; MULTI-FOCUS IMAGE; ENHANCEMENT;
D O I
10.1016/j.infrared.2024.105410
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Infrared and visible image fusion plays a critical role in combining complementary information gathered from both types of images, thus enhancing the visual quality and the perception in the resulting fused image. Thus, this paper introduces RTAAFusion which is, an innovative image fusion framework that incorporates unique components. This proposed technique employs a Residual Texture-Aware Attention Block Module (RTAABM), meticulously engineered to effectively capture image disparities and texture information. Furthermore, it includes a feature selection attention mechanism that accurately identifies the importance and the weights of the different image features, thereby facilitating a precise and efficient fusion process. The framework also features an Adaptive Decision Block Loss (ADBL), which allows the fusion model to be adjusted to the distinctive characteristics and requirements of various image regions, thus leading to more accurate and targeted fusion results. Comprehensive experiments and comparisons with leading-edge approaches reflected the superior performance of RTAAFusion in terms of visual perception, information conservation, and spatial details across challenging scenarios and a broad range of image features. Therefore, RTAAFusion delivers a fast execution speed and is versatile across different scenarios and image features. This proposed framework shows immense potential for diverse applications within the field of infrared and visible image fusion.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Fusion of infrared and visible images via structure and texture-aware retinex
    Hu J.
    Hao M.
    Du Y.
    Xie Q.
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (24): : 3225 - 3228
  • [2] Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion
    Wang, Lei
    Hu, Ziming
    Kong, Quan
    Qi, Qian
    Liao, Qing
    [J]. ENTROPY, 2023, 25 (03)
  • [3] REGION-ADAPTIVE TEXTURE-AWARE IMAGE RESIZING
    Zhang, Jiangyang
    Kuo, C. -C. Jay
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 837 - 840
  • [4] ASFFuse: Infrared and visible image fusion model based on adaptive selection feature maps
    Liu, Kuizhuang
    Li, Min
    Zuo, Enguang
    Chen, Chen
    Chen, Cheng
    Wang, Bo
    Wang, Yunling
    Lv, Xiaoyi
    [J]. PATTERN RECOGNITION, 2024, 149
  • [5] Infrared and visible image fusion based on dilated residual attention network
    Mustafa, Hafiz Tayyab
    Yang, Jie
    Mustafa, Hamza
    Zareapoor, Masoumeh
    [J]. OPTIK, 2020, 224 (224):
  • [6] Multiscale feature learning and attention mechanism for infrared and visible image fusion
    Li Gao
    DeLin Luo
    Song Wang
    [J]. Science China Technological Sciences, 2024, 67 : 408 - 422
  • [7] Multiscale feature learning and attention mechanism for infrared and visible image fusion
    GAO Li
    LUO DeLin
    WANG Song
    [J]. Science China Technological Sciences, 2024, (02) : 408 - 422
  • [8] Multiscale feature learning and attention mechanism for infrared and visible image fusion
    Gao, Li
    Luo, Delin
    Wang, Song
    [J]. SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2024, 67 (02) : 408 - 422
  • [9] Robust Texture-Aware Local Adaptive Image Watermarking With Perceptual Guarantee
    Huang, Ying
    Guan, Hu
    Liu, Jie
    Zhang, Shuwu
    Niu, Baoning
    Zhang, Guixuan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4660 - 4674
  • [10] RAN: Infrared and Visible Image Fusion Network Based on Residual Attention Decomposition
    Yu, Jia
    Lu, Gehao
    Zhang, Jie
    [J]. ELECTRONICS, 2024, 13 (14)