Disentangled body features for clothing change person re-identification

被引:4
|
作者
Ding, Yongkang [1 ]
Wu, Yinghao [1 ]
Wang, Anqi [1 ]
Gong, Tiantian [1 ]
Zhang, Liyan [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Person re-identification; Clothes-changing scenarios; Vision transformer; Semantic segmentation; Disentangled features;
D O I
10.1007/s11042-024-18440-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of computer vision and deep learning technology, person re-identification(ReID) has attracted widespread attention as an important research area. Most current ReID methods primarily focus on short-term re-identification. In the scenario of pedestrian clothing changes, traditional ReID methods face some challenges due to significant changes in pedestrian appearance. Therefore, this paper proposes a clothes-changing person re-identification(CC-ReID) method, namely SViT-ReID, based on a Vision Transformer and incorporating semantic information. This method integrates semantic segmentation maps to more accurately extract features and representations of pedestrian instances in complex scenes, enabling the model to learn some clues unrelated to clothing. Specifically, we extract clothing-unrelated features (such as the face, arms, legs, and feet) from pedestrian parsing tasks' obtained features. These features are then fused with global features to emphasize the importance of these body features. In addition, the complete semantic features derived from pedestrian parsing are fused with global features. These fused features undergo shuffle and grouping operations to generate local features, which are computed in parallel with global features, thereby enhancing the model's robustness and accuracy. Experimental evaluations on two real-world benchmarks show the proposed SViT-ReID achieves state-of-the-art performance. Extensive ablation studies and visualizations illustrate the effectiveness of our method. Our method achieves a Top-1 accuracy of 55.2% and 43.4% on the PRCC and LTCC datasets, respectively.
引用
收藏
页码:69693 / 69714
页数:22
相关论文
共 50 条
  • [21] A Person Re-Identification Method Incorporating Multigrain Features and Human Body Knowledge
    Wang, Jiayang
    Wan, Zheng
    Wang, Chao
    Du, Wenwen
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [22] Dualistic Disentangled Meta-Learning Model for Generalizable Person Re-Identification
    Sun, Jia
    Li, Yanfeng
    Chen, Luyifu
    Chen, Houjin
    Wang, Minjun
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 1106 - 1118
  • [23] Learning Disentangled Representation Implicitly Via Transformer for Occluded Person Re-Identification
    Jia, Mengxi
    Cheng, Xinhua
    Lu, Shijian
    Zhang, Jian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1294 - 1305
  • [24] PERSON RE-IDENTIFICATION USING MULTIPLE FEATURES FUSION
    Han, Kang
    Wan, Wanggen
    Chen, Guoliang
    Hou, Li
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2016, : 409 - 413
  • [25] Clothing Status Awareness for Long-Term Person Re-Identification
    Huang, Yan
    Wu, Qiang
    Xu, JingSong
    Zhong, Yi
    Zhang, ZhaoXiang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 11875 - 11884
  • [26] Clothing-invariant contrastive learning for unsupervised person re-identification
    Pang, Zhiqi
    Zhao, Lingling
    Wang, Chunyu
    NEURAL NETWORKS, 2024, 178
  • [27] Evaluation of Basic Visual Features for Person Re-identification
    Leng, Qingming
    Ye, Mang
    Liang, Chao
    PROCEEDINGS OF 2015 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2015), 2015, : 1466 - 1469
  • [28] Person Re-identification with Deep Features and Transfer Learning
    Wang, Shengke
    Wu, Shan
    Duan, Lianghua
    Yu, Changyin
    Sun, Yujuan
    Dong, Junyu
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE) AND IEEE/IFIP INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (EUC), VOL 1, 2017, : 704 - 707
  • [29] Person Re-identification with Data-Driven Features
    Li, Xiang
    Gao, Jinyu
    Chang, Xiaobin
    Mai, Yuting
    Zheng, Wei-Shi
    BIOMETRIC RECOGNITION (CCBR 2014), 2014, 8833 : 506 - 513
  • [30] Deep features for person re-identification on metric learning
    Wu, Wanyin
    Tao, Dapeng
    Li, Hao
    Yang, Zhao
    Cheng, Jun
    PATTERN RECOGNITION, 2021, 110