MBA-Net: multi-branch attention network for occluded person re-identification

被引:1
|
作者
Hong, Xing [1 ]
Zhang, Langwen [1 ,2 ,3 ,4 ]
Yu, Xiaoyuan [5 ]
Xie, Wei [1 ,2 ,3 ,4 ]
Xie, Yumin [1 ]
机构
[1] South China Univ Technol, Sch Automat Sci & Engn, Guangzhou, Guangdong, Peoples R China
[2] South China Univ Technol, Key Lab Autonomous Syst & Networked Control, Guangzhou, Guangdong, Peoples R China
[3] South China Univ Technol, Guangdong Prov Key Lab Tech & Equipment Macromol A, Guangzhou, Guangdong, Peoples R China
[4] South China Univ Technol, Unmanned Aerial Vehicle Syst Engn Technol Res Ctr, Guangzhou, Guangdong, Peoples R China
[5] South China Normal Univ, Sch Phys & Telecommun Engn, Guangzhou, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Person Re-identification; Occlusion; Feature refinement; Attention mechanism;
D O I
10.1007/s11042-023-15312-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Occluded person re-identification (ReID) aims to retrieve the same pedestrian from partially occluded pedestrian images across non-overlapping cameras. Current state-of-the-art methods generally use auxiliary models to obtain non-occluded regions, which not only result in more complex models, but also cannot effectively handle the more generalized ReID task. To this end, a Multi-Branch Attention Network (MBA-Net) is proposed to achieve multi-level refinement of features through an end-to-end multi-branch framework with attention mechanisms. Specifically, we first achieve preliminary feature refinement through a backbone network with a non-local attention mechanism. Then, a two-level multi-branch architecture in MBA-Net is proposed with two-level features refinement to obtain aware local discriminative features from the self-attention branch, non-occluded local complementary features from the cross-attention branch, and global features from the global branch. Finally, we can obtain retrieval features that are robust to occlusion by concatenating all the above features. Experimental results show that our MBA-Net achieves state-of-the-art performance on an occluded person ReID dataset Occluded-Duke and simultaneously achieves competitive performance on two general person ReID datasets Market-1501 and DukeMTMC-ReID.
引用
收藏
页码:6393 / 6412
页数:20
相关论文
共 50 条
  • [31] Cross-Modality Person Re-Identification Based on Dual-Path Multi-Branch Network
    Xiang, Xuezhi
    Lv, Ning
    Yu, Zeting
    Zhai, Mingliang
    El Saddik, Abdulmotaleb
    IEEE SENSORS JOURNAL, 2019, 19 (23) : 11706 - 11713
  • [32] MSFL-Net: Multi-Semantic Feature Learning Network for Occluded Person Re-Identification
    Huang, Guangyu
    Zhang, Xiaokang
    Yan, Yan
    Chen, Si
    Zhu, Wentao
    Wang, Hanzi
    2022 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB), 2022,
  • [33] OCCLUDED PERSON RE-IDENTIFICATION
    Zhuo, Jiaxuan
    Chen, Zeyu
    Lai, Jianhuang
    Wang, Guangcong
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2018,
  • [34] Pixel Level Alignment Person Re-Identification based on Multi-Branch Part Reconstructing
    Jiang, Yi
    Xu, Xin
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3130 - 3135
  • [35] Person re-identification based on multi-branch visual transformer and self-distillation
    Chen, Wenjie
    Yin, Kuan
    Wu, Yongsheng
    Hu, Yunbing
    SCIENCE PROGRESS, 2024, 107 (01)
  • [36] Auto-ReID plus : Searching for a multi-branch ConvNet for person re-identification
    Gu, Hongyang
    Fu, Guangyuan
    Li, Jianmin
    Zhu, Jun
    NEUROCOMPUTING, 2021, 435 : 53 - 66
  • [37] Semi-attention Partition for Occluded Person Re-identification
    Jia, Mengxi
    Sun, Yifan
    Zhai, Yunpeng
    Cheng, Xinhua
    Yang, Yi
    Li, Ying
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 998 - 1006
  • [38] Occluded Person Re-Identification by Multi-Granularity Generation Adversarial Network
    Wang, Yanqi
    Sun, Yanguo
    Lan, Zhenping
    Sun, Fengxue
    Zhang, Nianchao
    Wang, Yuru
    IEEE ACCESS, 2023, 11 : 59612 - 59620
  • [39] Multi-scale occlusion suppression network for occluded person re-identification
    Zhang, Yunzuo
    Yang, Yuehui
    Kang, Weili
    Zhen, Jiawen
    PATTERN RECOGNITION LETTERS, 2024, 185 : 66 - 72
  • [40] OMNet: Object- Perception Multi-Branch Network for Pedestrian Re-Identification
    Hong, Feng
    Lu, Chang-hua
    Tao, Wang
    Jiang, Weiwei
    BIG DATA RESEARCH, 2022, 27