MHSA-Net: Multihead Self-Attention Network for Occluded Person Re-Identification

被引:75
|
作者
Tan, Hongchen [1 ]
Liu, Xiuping [2 ]
Yin, Baocai [1 ]
Li, Xin [3 ,4 ]
机构
[1] Beijing Univ Technol, Artificial Intelligence Res Inst, Beijing 100124, Peoples R China
[2] Dalian Univ Technol, Sch Math Sci, Dalian 116024, Peoples R China
[3] Louisiana State Univ, Sch Elect Engn & Comp Sci, Baton Rouge, LA 70808 USA
[4] Louisiana State Univ, Ctr Computat & Technol, Baton Rouge, LA 70808 USA
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Task analysis; Feature extraction; Standards; Computational modeling; Adaptation models; Tensors; Probes; Attention competition mechanism (ACM); feature fusion; multihead self-attention; occluded person re-identification (Re-ID);
D O I
10.1109/TNNLS.2022.3144163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article presents a novel person reidentification model, named multihead self-attention network (MHSA-Net), to prune unimportant information and capture key local information from person images. MHSA-Net contains two main novel components: multihead self-attention branch (MHSAB) and attention competition mechanism (ACM). The MHSAB adaptively captures key local person information and then produces effective diversity embeddings of an image for the person matching. The ACM further helps filter out attention noise and nonkey information. Through extensive ablation studies, we verified that the MHSAB and ACM both contribute to the performance improvement of the MHSA-Net. Our MHSA-Net achieves competitive performance in the standard and occluded person Re-ID tasks.
引用
收藏
页码:8210 / 8224
页数:15
相关论文
共 50 条
  • [1] Joint Convolutional and Self-Attention Network for Occluded Person Re-Identification
    Yang, Chuxia
    Fan, Wanshu
    Zhou, Dongsheng
    Zhang, Qiang
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 757 - 764
  • [2] Self-attention mechanism in person re-identification models
    Chen, Wenbai
    Lu, Yue
    Ma, Hang
    Chen, Qili
    Wu, Xibao
    Wu, Peiliang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) : 4649 - 4667
  • [3] Decoupled Self-attention Module for Person Re-identification
    Zhao, Chao
    Zhang, Zhenyu
    Yan, Jian
    Yan, Yan
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 7617 - 7624
  • [4] Self-attention mechanism in person re-identification models
    Wenbai Chen
    Yue Lu
    Hang Ma
    Qili Chen
    Xibao Wu
    Peiliang Wu
    Multimedia Tools and Applications, 2022, 81 : 4649 - 4667
  • [5] Semantic guidance attention network for occluded person re-identification
    Ren X.
    Zhang D.
    Bao X.
    Li B.
    Tongxin Xuebao/Journal on Communications, 2021, 42 (10): : 106 - 116
  • [6] Feature attention fusion network for occluded person re-identification
    Zhuang, Xuyao
    Wei, Dan
    Liang, Danyang
    Jiang, Lei
    IMAGE AND VISION COMPUTING, 2024, 143
  • [7] MBA-Net: multi-branch attention network for occluded person re-identification
    Hong, Xing
    Zhang, Langwen
    Yu, Xiaoyuan
    Xie, Wei
    Xie, Yumin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (2) : 6393 - 6412
  • [8] MBA-Net: multi-branch attention network for occluded person re-identification
    Xing Hong
    Langwen Zhang
    Xiaoyuan Yu
    Wei Xie
    Yumin Xie
    Multimedia Tools and Applications, 2024, 83 : 6393 - 6412
  • [9] Discriminant Feature Learning with Self-attention for Person Re-identification
    Li, Yang
    Jiang, Xiaoyan
    Hwang, Jenq-Neng
    NEURAL INFORMATION PROCESSING, ICONIP 2019, PT V, 2019, 1143 : 11 - 19
  • [10] Cloth-Changing Person Re-identification with Self-Attention
    Bansal, Vaibhav
    Foresti, Gian Luca
    Martinel, Niki
    2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022), 2022, : 602 - 610