Multi-granularity enhanced feature learning for visible-infrared person re-identification

被引:0
|
作者
Liu, Huilin [1 ]
Wu, Yuhao [1 ]
Tang, Zihan [2 ]
Li, Xiaolong [1 ]
Su, Shuzhi [1 ]
Liang, Xingzhu [1 ]
Zhang, Pengfei [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Peoples R China
[2] Univ Wisconsin Madison, Madison, WI USA
来源
JOURNAL OF SUPERCOMPUTING | 2025年 / 81卷 / 01期
关键词
Visible-infrared person re-identification; Attention mechanism; Feature embedding; Three-branch; MODALITY;
D O I
10.1007/s11227-024-06731-4
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Visible-infrared person re-identification aims to achieve mutual retrieval of pedestrian images captured by nonoverlapping RGB and IR cameras. Due to factors such as occlusion, changes in perspective, and modal differences, it is difficult for the model to extract the modal-invariant features of the same pedestrian across different modalities. Existing studies mainly map images of two modalities to the same feature embedding space, learning coarse-grained or fine-grained features that share modality. However, these methods neglect the complementarity of the multi-granularity feature information. In contrast to these methods, we propose an end-to-end Multi-granularity Enhanced Feature Learning Network (MEFL-Net). In the feature embedding module, we design a three-branch structure for learning modality-shared features at different granularities. Within each branch, we employ horizontal blocking technology to divide pedestrian features into multiple levels and extract modality-shared features at various scales. Moreover, to enhance the significance of multi-granularity features, we embed CBAM in the global branch to suppress background interference and enhance the attention on pedestrian bodies. Additionally, since features at different scales process different semantics, we fuse multiple fine-grained features to ensure semantic and feature complementarity. Extensive experiments demonstrate that our method outperforms state-of-the-art methods. In the SYSU-MM01 and RegDB datasets, we achieved an accuracy of 70.47%/73.23% and 91.46%/86.33% for rank1/mAP.
引用
收藏
页数:25
相关论文
共 50 条
  • [41] Contrastive Learning with Information Compensation for Visible-Infrared Person Re-Identification
    Zhang, La
    Guo, Haiyun
    Zhao, Xu
    Sun, Jian
    Wang, Jinqiao
    2024 14TH ASIAN CONTROL CONFERENCE, ASCC 2024, 2024, : 1266 - 1271
  • [42] Four-Stream Network and Nonsignificant Feature Learning for Visible-Infrared Person Re-Identification
    Liang, Yilei
    Han, Hua
    Huang, Li
    Wang, Chunyuan
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (07)
  • [43] Fine-grained Learning for Visible-Infrared Person Re-identification
    Qi, Mengzan
    Chan, Sixian
    Hang, Chen
    Zhang, Guixu
    Li, Zhi
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2417 - 2422
  • [44] Learning with Twin Noisy Labels for Visible-Infrared Person Re-Identification
    Yang, Mouxing
    Huang, Zhenyu
    Hu, Peng
    Li, Taihao
    Lv, Jiancheng
    Peng, Xi
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14288 - 14297
  • [45] Attributes Based Visible-Infrared Person Re-identification
    Zheng, Aihua
    Feng, Mengya
    Pan, Peng
    Jiang, Bo
    Luo, Bin
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2022, 2022, 13534 : 254 - 266
  • [46] Minimizing Maximum Feature Space Deviation for Visible-Infrared Person Re-Identification
    Wu, Zhixiong
    Wen, Tingxi
    APPLIED SCIENCES-BASEL, 2022, 12 (17):
  • [47] Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification
    Lin, Ronghui
    Wang, Rong
    Zhang, Wenjing
    Wu, Ao
    Bi, Yihan
    SENSORS, 2023, 23 (11)
  • [48] Feature-Level Compensation and Alignment for Visible-Infrared Person Re-Identification
    Dong, Husheng
    Lu, Ping
    Yang, Yuanfeng
    Sun, Xun
    IET COMPUTER VISION, 2025, 19 (01)
  • [49] Interaction and Alignment for Visible-Infrared Person Re-Identification
    Gong, Jiahao
    Zhao, Sanyuan
    Lam, Kin-Man
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2253 - 2259
  • [50] Domain Adaptive Learning with Multi-Granularity Features for Unsupervised Person Re-identification
    FU Lihua
    DU Yubin
    DING Yu
    WANG Dan
    JIANG Hanxu
    ZHANG Haitao
    Chinese Journal of Electronics, 2022, 31 (01) : 116 - 128