Disentangled body features for clothing change person re-identification

被引:4
|
作者
Ding, Yongkang [1 ]
Wu, Yinghao [1 ]
Wang, Anqi [1 ]
Gong, Tiantian [1 ]
Zhang, Liyan [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Person re-identification; Clothes-changing scenarios; Vision transformer; Semantic segmentation; Disentangled features;
D O I
10.1007/s11042-024-18440-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of computer vision and deep learning technology, person re-identification(ReID) has attracted widespread attention as an important research area. Most current ReID methods primarily focus on short-term re-identification. In the scenario of pedestrian clothing changes, traditional ReID methods face some challenges due to significant changes in pedestrian appearance. Therefore, this paper proposes a clothes-changing person re-identification(CC-ReID) method, namely SViT-ReID, based on a Vision Transformer and incorporating semantic information. This method integrates semantic segmentation maps to more accurately extract features and representations of pedestrian instances in complex scenes, enabling the model to learn some clues unrelated to clothing. Specifically, we extract clothing-unrelated features (such as the face, arms, legs, and feet) from pedestrian parsing tasks' obtained features. These features are then fused with global features to emphasize the importance of these body features. In addition, the complete semantic features derived from pedestrian parsing are fused with global features. These fused features undergo shuffle and grouping operations to generate local features, which are computed in parallel with global features, thereby enhancing the model's robustness and accuracy. Experimental evaluations on two real-world benchmarks show the proposed SViT-ReID achieves state-of-the-art performance. Extensive ablation studies and visualizations illustrate the effectiveness of our method. Our method achieves a Top-1 accuracy of 55.2% and 43.4% on the PRCC and LTCC datasets, respectively.
引用
收藏
页码:69693 / 69714
页数:22
相关论文
共 50 条
  • [1] Learning Disentangled Features for Person Re-identification under Clothes Changing
    Chan, Patrick P. K.
    Hu, Xiaoman
    Song, Haorui
    Peng, Peng
    Chen, Keke
    Yeung, Daniel S.
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [2] Clothing-change person re-identification based on fusion of RGB modality and gait features
    Tu, Hongbin
    Liu, Chao
    Peng, Yuanyuan
    Xiong, Haibo
    Wang, Haotian
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2367 - 2376
  • [3] Clothing-change person re-identification based on fusion of RGB modality and gait features
    Hongbin Tu
    Chao Liu
    Yuanyuan Peng
    Haibo Xiong
    Haotian Wang
    Signal, Image and Video Processing, 2024, 18 : 2367 - 2376
  • [4] Learning Shape Representations for Person Re-Identification under Clothing Change
    Li, Yu-Jhe
    Weng, Xinshuo
    Kitani, Kris M.
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2431 - 2440
  • [5] Person Re-Identification by Contour Sketch Under Moderate Clothing Change
    Yang, Qize
    Wu, Ancong
    Zheng, Wei-Shi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (06) : 2029 - 2046
  • [6] A Cross-Period Network for Clothing Change Person Re-Identification
    Zheng, Shuxin
    Liang, Sai
    Meng, Chunyun
    Zhang, Zhongguo
    Luan, Li
    IEEE ACCESS, 2024, 12 : 53517 - 53532
  • [7] Learning Disentangled Representation for Robust Person Re-identification
    Eom, Chanho
    Ham, Bumsub
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [8] Disentangled Sample Guidance Learning for Unsupervised Person Re-Identification
    Ji, Haoxuanye
    Wang, Le
    Zhou, Sanping
    Tang, Wei
    Hua, Gang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5144 - 5158
  • [9] Evaluating Features for Person Re-Identification
    Wang, Jiabao
    Li, Hang
    Li, Yang
    Xu, Yulong
    Miao, Zhuang
    2016 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2016, : 214 - 219
  • [10] Deep Features for Person Re-identification
    Wang, Shuang
    Shang, Yanfeng
    Wang, Jian
    Mei, Lin
    Hu, Chuanping
    2015 11TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG), 2015, : 244 - 247