Learning Sparse and Identity-Preserved Hidden Attributes for Person Re-Identification

被引:68
|
作者
Wang, Zheng [1 ]
Jiang, Junjun [2 ,3 ]
Wu, Yang [4 ]
Ye, Mang [5 ]
Bai, Xiang [6 ]
Satoh, Shin'ichi [1 ]
机构
[1] Natl Inst Informat, Digital Content & Media Sci Res Div, Tokyo 1018430, Japan
[2] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[4] Nara Inst Sci & Technol, Int Collaborat Lab Robot Vis, Inst Res Initiat, Nara 6300192, Japan
[5] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[6] Huazhong Univ Sci & Technol, Sch Elect Informat & Commun, Wuhan 430074, Peoples R China
关键词
Semantics; Deep learning; Visualization; Feature extraction; Image reconstruction; Clothing; Training; Person re-identification; attribute learning; generation; discrimination; NETWORK;
D O I
10.1109/TIP.2019.2946975
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (Re-ID) aims at matching person images captured in non-overlapping camera views. To represent person appearance, low-level visual features are sensitive to environmental changes, while high-level semantic attributes, such as "short-hair" or "long-hair", are relatively stable. Hence, researches have started to design semantic attributes to reduce the visual ambiguity. However, to train a prediction model for semantic attributes, it requires plenty of annotations, which are hard to obtain in practical large-scale applications. To alleviate the reliance on annotation efforts, we propose to incrementally generate Deep Hidden Attribute (DHA) based on baseline deep network for newly uncovered annotations. In particular, we propose an auto-encoder model that can be plugged into any deep network to mine latent information in an unsupervised manner. To optimize the effectiveness of DHA, we reform the auto-encoder model with additional orthogonal generation module, along with identity-preserving and sparsity constraints. 1) Orthogonally generating: In order to make DHAs different from each other, Singular Vector Decomposition (SVD) is introduced to generate DHAs orthogonally. 2) Identity-preserving constraint: The generated DHAs should be distinct for telling different persons, so we associate DHAs with person identities. 3) Sparsity constraint: To enhance the discriminability of DHAs, we also introduce the sparsity constraint to restrict the number of effective DHAs for each person. Experiments conducted on public datasets have validated the effectiveness of the proposed network. On two large-scale datasets, i.e., Market-1501 and DukeMTMC-reID, the proposed method outperforms the state-of-the-art methods.
引用
收藏
页码:2013 / 2025
页数:13
相关论文
共 50 条
  • [1] Person Re-identification by Attributes
    Layne, Ryan
    Hospedales, Timothy
    Gong, Shaogang
    PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [2] Re-ranking Person Re-identification using Attributes Learning
    Nabila Mansouri
    Sourour Ammar
    Yousri Kessentini
    Neural Computing and Applications, 2021, 33 : 12827 - 12843
  • [3] Re-ranking Person Re-identification using Attributes Learning
    Mansouri, Nabila
    Ammar, Sourour
    Kessentini, Yousri
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (19): : 12827 - 12843
  • [4] Improving person re-identification by attribute and identity learning
    Lin, Yutian
    Zheng, Liang
    Zheng, Zhedong
    Wu, Yu
    Hu, Zhilan
    Yan, Chenggang
    Yang, Yi
    PATTERN RECOGNITION, 2019, 95 : 151 - 161
  • [5] Transferring Attributes for Person Re-Identification
    Schumann, Arne
    Stiefelhagen, Rainer
    2015 12TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2015,
  • [6] Towards Person Identification and Re-identification with Attributes
    Layne, Ryan
    Hospedales, Timothy M.
    Gong, Shaogang
    COMPUTER VISION - ECCV 2012: WORKSHOPS AND DEMONSTRATIONS, PT I, 2012, 7583 : 402 - 412
  • [7] Multi-task Network Learning Representation Features of Attributes and Identity for Person Re-identification
    Wang, Junqian
    Lyu, Mengsi
    BIOMETRIC RECOGNITION, CCBR 2018, 2018, 10996 : 689 - 699
  • [8] Discriminative Dictionary Learning Sparse Coding for Person Re-Identification
    Sheng, Hao
    Zhang, Beichen
    Huang, Yan
    Zheng, Yanwei
    Xiong, Zhang
    2016 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2016, : 1338 - 1343
  • [9] Identity Adaptation for Person Re-Identification
    Ke, Qiuhong
    Bennamoun, Mohammed
    Rahmani, Hossein
    An, Senjian
    Sohel, Ferdous
    Boussaid, Farid
    IEEE ACCESS, 2018, 6 : 48147 - 48155
  • [10] Attributes-Assisted Joint Contrastive Learning for Person Re-Identification
    Wu, Qingru
    Zhou, Zhiheng
    Niu, Chang
    Liu, Xiaosheng
    Li, Bo
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (14): : 24672 - 24684