Effective person re-identification by self-attention model guided feature learning

被引:28
|
作者
Li, Yang [1 ]
Jiang, Xiaoyan [1 ]
Hwang, Jenq-Neng [2 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, 333 Longteng Rd, Shanghai, Peoples R China
[2] Univ Washington, Dept Elect & Comp Engn, Box 352500, Seattle, WA 98195 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Feature extraction; Self-attention; Cross-entropy loss; Triplet loss;
D O I
10.1016/j.knosys.2019.07.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (re-ID), of which the goal is to recognize person identities of images captured by non-overlapping cameras, is a challenging topic in computer vision. Most existing person re-ID methods conduct directly on detected objects, which ignore the space misalignment caused by detectors, human pose variation, and occlusion problems. To tackle the above mentioned difficulties, we propose a self-attention model guided deep convolutional neural network(DCNN) to learn robust features from image shots. Kernels of the self-attention model evaluate weights for the importance of different person regions. To solve the local feature dependence problem of feature extraction, the non-local feature map generated by the self-attention model is fused with the original feature map generated from the resnet-50. Furthermore, the loss function considers both the cross-entropy loss and the triplet loss in the training process, which enables the network to capture common characteristics within the same individuals and significant differences between distinct persons. Extensive experiments and comparative evaluations show that our proposed strategy outperforms most of the state-of-the-art methods on standard datasets: Market-1501, DukeMTMC-relD, and CUHK03. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Mask-guided Contrastive Attention Model for Person Re-Identification
    Song, Chunfeng
    Huang, Yan
    Ouyang, Wanli
    Wang, Liang
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1179 - 1188
  • [22] Flow guided mutual attention for person re-identification
    Kiran, Madhu
    Bhuiyan, Amran
    Nguyen-Meidine, Le Thanh
    Blais-Morin, Louis-Antoine
    Ben Ayed, Ismail
    Granger, Eric
    IMAGE AND VISION COMPUTING, 2021, 113
  • [23] Omnidirectional Feature Learning for Person Re-Identification
    Wu, Di
    Yang, Hong-Wei
    Huang, De-Shuang
    Yuan, Chang-An
    Qin, Xiao
    Zhao, Yang
    Zhao, Xin-Yong
    Sun, Jian-Hong
    IEEE ACCESS, 2019, 7 : 28402 - 28411
  • [24] MHSA-Net: Multihead Self-Attention Network for Occluded Person Re-Identification
    Tan, Hongchen
    Liu, Xiuping
    Yin, Baocai
    Li, Xin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 8210 - 8224
  • [25] SIF: Self-Inspirited Feature Learning for Person Re-Identification
    We, Long
    Wei, Zhenyong
    Jin, Zhongming
    Yu, Zhengxu
    Huang, Jianqiang
    Cai, Deng
    He, Xiaofei
    Hua, Xian-Sheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4942 - 4951
  • [26] Reliable Part Guided Multiple Level Attention Learning for Person Re-Identification
    Geng, Yanbing
    Lian, Yongjian
    Yang, Shunmin
    Zhou, Mingliang
    Cao, Jingchao
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2021, 30 (13)
  • [27] Learning dual attention enhancement feature for visible–infrared person re-identification
    Zhang, Guoqing
    Zhang, Yinyin
    Zhang, Hongwei
    Chen, Yuhao
    Zheng, Yuhui
    Journal of Visual Communication and Image Representation, 2024, 99
  • [28] Global Feature Learning with Human Body Region Guided for Person Re-identification
    Li, Zhiqiang
    Sang, Nong
    Chen, Kezhou
    Han, Chuchu
    Gao, Changxin
    PATTERN RECOGNITION AND COMPUTER VISION (PRCV 2018), PT I, 2018, 11256 : 15 - 25
  • [29] Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification
    Xiao, Tong
    Li, Hongsheng
    Ouyang, Wanli
    Wang, Xiaogang
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1249 - 1258
  • [30] Enhancing cross-modality person re-identification through attention-guided asymmetric feature learning
    Song, Xuehua
    Zhou, Junxing
    Jin, Hua
    Yuan, Xin
    Wang, Changda
    MULTIMEDIA SYSTEMS, 2025, 31 (02)