Multi-granularity enhanced feature learning for visible-infrared person re-identification

被引:0
|
作者
Liu, Huilin [1 ]
Wu, Yuhao [1 ]
Tang, Zihan [2 ]
Li, Xiaolong [1 ]
Su, Shuzhi [1 ]
Liang, Xingzhu [1 ]
Zhang, Pengfei [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Peoples R China
[2] Univ Wisconsin Madison, Madison, WI USA
来源
JOURNAL OF SUPERCOMPUTING | 2025年 / 81卷 / 01期
关键词
Visible-infrared person re-identification; Attention mechanism; Feature embedding; Three-branch; MODALITY;
D O I
10.1007/s11227-024-06731-4
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Visible-infrared person re-identification aims to achieve mutual retrieval of pedestrian images captured by nonoverlapping RGB and IR cameras. Due to factors such as occlusion, changes in perspective, and modal differences, it is difficult for the model to extract the modal-invariant features of the same pedestrian across different modalities. Existing studies mainly map images of two modalities to the same feature embedding space, learning coarse-grained or fine-grained features that share modality. However, these methods neglect the complementarity of the multi-granularity feature information. In contrast to these methods, we propose an end-to-end Multi-granularity Enhanced Feature Learning Network (MEFL-Net). In the feature embedding module, we design a three-branch structure for learning modality-shared features at different granularities. Within each branch, we employ horizontal blocking technology to divide pedestrian features into multiple levels and extract modality-shared features at various scales. Moreover, to enhance the significance of multi-granularity features, we embed CBAM in the global branch to suppress background interference and enhance the attention on pedestrian bodies. Additionally, since features at different scales process different semantics, we fuse multiple fine-grained features to ensure semantic and feature complementarity. Extensive experiments demonstrate that our method outperforms state-of-the-art methods. In the SYSU-MM01 and RegDB datasets, we achieved an accuracy of 70.47%/73.23% and 91.46%/86.33% for rank1/mAP.
引用
收藏
页数:25
相关论文
共 50 条
  • [31] Counterfactual Intervention Feature Transfer for Visible-Infrared Person Re-identification
    Li, Xulin
    Lu, Yan
    Liu, Bin
    Liu, Yating
    Yin, Guojun
    Chu, Qi
    Huang, Jinyang
    Zhu, Feng
    Zhao, Rui
    Yu, Nenghai
    COMPUTER VISION, ECCV 2022, PT XXVI, 2022, 13686 : 381 - 398
  • [32] Feature Fusion and Center Aggregation for Visible-Infrared Person Re-Identification
    Wang, Xianju
    Chen, Cuiqun
    Zhu, Yong
    Chen, Shuguang
    IEEE ACCESS, 2022, 10 : 30949 - 30958
  • [33] Parameter sharing and multi-granularity feature learning for cross-modality person re-identification
    Sixian Chan
    Feng Du
    Tinglong Tang
    Guodao Zhang
    Xiaoliang Jiang
    Qiu Guan
    Complex & Intelligent Systems, 2024, 10 : 949 - 962
  • [34] Parameter sharing and multi-granularity feature learning for cross-modality person re-identification
    Chan, Sixian
    Du, Feng
    Tang, Tinglong
    Zhang, Guodao
    Jiang, Xiaoliang
    Guan, Qiu
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (01) : 949 - 962
  • [35] Person re-identification based on random occlusion and multi-granularity feature fusion
    Zhang N.
    Cheng D.
    Kou Q.
    Ma H.
    Qian J.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (12): : 3520 - 3527
  • [36] Combining information augmentation aggregation and dual-granularity feature fusion for visible-infrared person re-identification
    Tao, Mengzhu
    Long, Huiyun
    Kong, Guangqian
    Duan, Xun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)
  • [37] Receptive Multi-Granularity Representation for Person Re-Identification
    Wang, Guanshuo
    Yuan, Yufeng
    Li, Jiwei
    Ge, Shiming
    Zhou, Xi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6096 - 6109
  • [38] Hybrid Modality Metric Learning for Visible-Infrared Person Re-Identification
    Zhang, La
    Guo, Haiyun
    Zhu, Kuan
    Qiao, Honglin
    Huang, Gaopan
    Zhang, Sen
    Zhang, Huichen
    Sun, Jian
    Wang, Jinqiao
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (01)
  • [39] Robust Duality Learning for Unsupervised Visible-Infrared Person Re-Identification
    Li, Yongxiang
    Sun, Yuan
    Qin, Yang
    Peng, Dezhong
    Peng, Xi
    Hu, Peng
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 1937 - 1948
  • [40] Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification
    Ren, Kaijie
    Zhang, Lei
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 393 - 402