Effective person re-identification by self-attention model guided feature learning

被引:28
|
作者
Li, Yang [1 ]
Jiang, Xiaoyan [1 ]
Hwang, Jenq-Neng [2 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, 333 Longteng Rd, Shanghai, Peoples R China
[2] Univ Washington, Dept Elect & Comp Engn, Box 352500, Seattle, WA 98195 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Feature extraction; Self-attention; Cross-entropy loss; Triplet loss;
D O I
10.1016/j.knosys.2019.07.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (re-ID), of which the goal is to recognize person identities of images captured by non-overlapping cameras, is a challenging topic in computer vision. Most existing person re-ID methods conduct directly on detected objects, which ignore the space misalignment caused by detectors, human pose variation, and occlusion problems. To tackle the above mentioned difficulties, we propose a self-attention model guided deep convolutional neural network(DCNN) to learn robust features from image shots. Kernels of the self-attention model evaluate weights for the importance of different person regions. To solve the local feature dependence problem of feature extraction, the non-local feature map generated by the self-attention model is fused with the original feature map generated from the resnet-50. Furthermore, the loss function considers both the cross-entropy loss and the triplet loss in the training process, which enables the network to capture common characteristics within the same individuals and significant differences between distinct persons. Extensive experiments and comparative evaluations show that our proposed strategy outperforms most of the state-of-the-art methods on standard datasets: Market-1501, DukeMTMC-relD, and CUHK03. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Discriminant Feature Learning with Self-attention for Person Re-identification
    Li, Yang
    Jiang, Xiaoyan
    Hwang, Jenq-Neng
    NEURAL INFORMATION PROCESSING, ICONIP 2019, PT V, 2019, 1143 : 11 - 19
  • [2] Enforcing Affinity Feature Learning through Self-attention for Person Re-identification
    Ainam, Jean-Paul
    Qin, Ke
    Liu, Guisong
    Luo, Guangchun
    Agyemang, Brighter
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (01)
  • [3] Self-attention mechanism in person re-identification models
    Chen, Wenbai
    Lu, Yue
    Ma, Hang
    Chen, Qili
    Wu, Xibao
    Wu, Peiliang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) : 4649 - 4667
  • [4] Decoupled Self-attention Module for Person Re-identification
    Zhao, Chao
    Zhang, Zhenyu
    Yan, Jian
    Yan, Yan
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 7617 - 7624
  • [5] Self-attention mechanism in person re-identification models
    Wenbai Chen
    Yue Lu
    Hang Ma
    Qili Chen
    Xibao Wu
    Peiliang Wu
    Multimedia Tools and Applications, 2022, 81 : 4649 - 4667
  • [6] Cloth-Changing Person Re-identification with Self-Attention
    Bansal, Vaibhav
    Foresti, Gian Luca
    Martinel, Niki
    2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022), 2022, : 602 - 610
  • [7] Discriminative Feature Learning With Foreground Attention for Person Re-Identification
    Zhou, Sanping
    Wang, Jinjun
    Meng, Deyu
    Liang, Yudong
    Gong, Yihong
    Zheng, Nanning
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) : 4671 - 4684
  • [8] Deep attention aware feature learning for person re-Identification
    Chen, Yifan
    Wang, Han
    Sun, Xiaolu
    Fan, Bin
    Tang, Chu
    Zeng, Hui
    PATTERN RECOGNITION, 2022, 126
  • [9] Joint Convolutional and Self-Attention Network for Occluded Person Re-Identification
    Yang, Chuxia
    Fan, Wanshu
    Zhou, Dongsheng
    Zhang, Qiang
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 757 - 764
  • [10] Person re-identification method based on fine-grained feature fusion and self-attention mechanism
    Yin, Kangning
    Ding, Zhen
    Dong, Zhihua
    Ji, Xinhui
    Wang, Zhipei
    Chen, Dongsheng
    Li, Ye
    Yin, Guangqiang
    Wang, Zhiguo
    COMPUTING, 2024, 106 (05) : 1681 - 1705