Disentangled body features for clothing change person re-identification

被引:4
|
作者
Ding, Yongkang [1 ]
Wu, Yinghao [1 ]
Wang, Anqi [1 ]
Gong, Tiantian [1 ]
Zhang, Liyan [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Person re-identification; Clothes-changing scenarios; Vision transformer; Semantic segmentation; Disentangled features;
D O I
10.1007/s11042-024-18440-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of computer vision and deep learning technology, person re-identification(ReID) has attracted widespread attention as an important research area. Most current ReID methods primarily focus on short-term re-identification. In the scenario of pedestrian clothing changes, traditional ReID methods face some challenges due to significant changes in pedestrian appearance. Therefore, this paper proposes a clothes-changing person re-identification(CC-ReID) method, namely SViT-ReID, based on a Vision Transformer and incorporating semantic information. This method integrates semantic segmentation maps to more accurately extract features and representations of pedestrian instances in complex scenes, enabling the model to learn some clues unrelated to clothing. Specifically, we extract clothing-unrelated features (such as the face, arms, legs, and feet) from pedestrian parsing tasks' obtained features. These features are then fused with global features to emphasize the importance of these body features. In addition, the complete semantic features derived from pedestrian parsing are fused with global features. These fused features undergo shuffle and grouping operations to generate local features, which are computed in parallel with global features, thereby enhancing the model's robustness and accuracy. Experimental evaluations on two real-world benchmarks show the proposed SViT-ReID achieves state-of-the-art performance. Extensive ablation studies and visualizations illustrate the effectiveness of our method. Our method achieves a Top-1 accuracy of 55.2% and 43.4% on the PRCC and LTCC datasets, respectively.
引用
收藏
页码:69693 / 69714
页数:22
相关论文
共 50 条
  • [41] Body Feature Filter for Occluded Person Re-Identification
    Fu, Tianyun
    Hu, Jianming
    Pei, Xin
    INTERNATIONAL CONFERENCE ON TRANSPORTATION AND DEVELOPMENT 2022: APPLICATION OF EMERGING TECHNOLOGIES, 2022, : 113 - 122
  • [42] Person re-identification with features-based clustering and deep features
    Muhammad Fayyaz
    Mussarat Yasmin
    Muhammad Sharif
    Jamal Hussain Shah
    Mudassar Raza
    Tassawar Iqbal
    Neural Computing and Applications, 2020, 32 : 10519 - 10540
  • [43] Disentangled Representations for Short-Term and Long-Term Person Re-Identification
    Eom, Chanho
    Lee, Wonkyung
    Lee, Geon
    Ham, Bumsub
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 8975 - 8991
  • [44] Person re-identification with features-based clustering and deep features
    Fayyaz, Muhammad
    Yasmin, Mussarat
    Sharif, Muhammad
    Shah, Jamal Hussain
    Raza, Mudassar
    Iqbal, Tassawar
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (14): : 10519 - 10540
  • [45] Person Re-identification using soft-biometric features: body silhouette and clothing texture in a multi-camera video surveillance environment
    Carrillo-Medina, Jose
    Chango-Caisabanda, David
    Cuyo-Chiluisa, Victor
    Galarza-Medina, Eddie
    2022 THIRD INTERNATIONAL CONFERENCE ON INFORMATION SYSTEMS AND SOFTWARE TECHNOLOGIES, ICI2ST, 2022, : 36 - 43
  • [46] A COMPACT COLOR DESCRIPTOR FOR PERSON RE-IDENTIFICATION WITH CLOTHING SELECTION FROM A WARDROBE
    Takahashi, Yusuke
    Miyano, Hiroyoshi
    2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2015,
  • [47] Meta Clothing Status Calibration for Long-Term Person Re-Identification
    Huang, Yan
    Wu, Qiang
    Zhang, Zhang
    Shan, Caifeng
    Zhong, Yi
    Wang, Liang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 2334 - 2346
  • [48] Deep-Person: Learning discriminative deep features for person Re-Identification
    Bai, Xiang
    Yang, Mingkun
    Huang, Tengteng
    Dou, Zhiyong
    Yu, Rui
    Xu, Yongchao
    PATTERN RECOGNITION, 2020, 98
  • [49] Improved Algorithm for Person Re-Identification Based on Global Features
    Zhang Tao
    Yi Zhengming
    Li Xuan
    Sun Xing
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (24)
  • [50] Local Heterogeneous Features for Person Re-Identification in Harsh Environments
    Zhang, Haijia
    Si, Tongzhen
    Zhang, Zhong
    Zhang, Ronghua
    Ma, Hao
    Liu, Shuang
    IEEE ACCESS, 2020, 8 : 83685 - 83692