PGDS: Pose-Guidance Deep Supervision for Mitigating Clothes-Changing in Person Re-Identification

被引:0
|
作者
Quoc-Huy Trinh [1 ]
Nhat-Tan Bui [1 ]
Dinh-Hieu Hoang [1 ]
Phuoc-Thao Vo Thi [2 ]
Hai-Dang Nguyen [2 ]
Debesh Jha [3 ]
Ulas Bagci [4 ]
Ngan Le [1 ]
Minh-Triet Tran [1 ]
机构
[1] Vietnam Natl Univ, Univ Sci, Ho Chi Minh City, Vietnam
[2] Vietnam Natl Univ, John von Neumann Inst, Ho Chi Minh City, Vietnam
[3] Univ Arkansas, AICV Lab, Fayetteville, AR 72701 USA
[4] Northwestern Univ, Chicago, IL 60611 USA
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE, AVSS 2024 | 2024年
关键词
D O I
10.1109/AVSS61716.2024.10672607
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person Re-Identification (Re-ID) task seeks to enhance the tracking of multiple individuals by surveillance cameras. It supports multimodal tasks, including text-based person retrieval and human matching. One of the most significant challenges faced in Re-ID is clothes-changing, where the same person may appear in different outfits. While previous methods have made notable progress in maintaining clothing data consistency and handling clothing change data, they still rely excessively on clothing information, which can limit performance due to the dynamic nature of human appearances. To mitigate this challenge, we propose the Pose-Guidance Deep Supervision (PGDS), an effective framework for learning pose guidance within the Re-ID task. It consists of three modules: a human encoder, a pose encoder, and a Pose-to-Human Projection module (PHP). Our framework guides the human encoder, i.e., the main re-identification model, with pose information from the pose encoder through multiple layers via the knowledge transfer mechanism from the PHP module, helping the human encoder learn body parts information without increasing computation resources in the inference stage. Through extensive experiments, our method surpasses the performance of current state-of-the-art methods, demonstrating its robustness and effectiveness for real-world applications. Our code is available at https:// github. com/huyquoctrinh/PGDS.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Pose Transferrable Person Re-Identification
    Liu, Jinxian
    Ni, Bingbing
    Yan, Yichao
    Zhou, Peng
    Cheng, Shuo
    Hu, Jianguo
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4099 - 4108
  • [22] Person re-identification by pose priors
    Bak, Slawomir
    Martins, Filipe
    Bremond, Francois
    IMAGE PROCESSING: ALGORITHMS AND SYSTEMS XIII, 2015, 9399
  • [23] COCAS: A Large-Scale Clothes Changing Person Dataset for Re-identification
    Yu, Shijie
    Li, Shihua
    Chen, Dapeng
    Zhao, Rui
    Yan, Junjie
    Qiao, Yu
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3397 - 3406
  • [24] A benchmark for clothes variation in person re-identification
    Wang, Kai
    Ma, Zhi
    Chen, Shiyan
    Yang, Jinni
    Zhou, Keke
    Li, Tao
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2020, 35 (12) : 1881 - 1898
  • [25] Pose-driven Deep Convolutional Model for Person Re-identification
    Su, Chi
    Li, Jianing
    Zhang, Shiliang
    Xing, Junliang
    Gao, Wen
    Tian, Qi
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3980 - 3989
  • [26] Pose Variation Adaptation for Person Re-identification
    Zhang, Lei
    Jiang, Na
    Xu, Yue
    Diao, Qishuai
    Zhou, Zhong
    Wu, Wei
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 6996 - 7003
  • [27] Attention Deep Model With Multi-Scale Deep Supervision for Person Re-Identification
    Wu, Di
    Wang, Chao
    Wu, Yong
    Wang, Qi-Cong
    Huang, De-Shuang
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2021, 5 (01): : 70 - 78
  • [28] Pose-Guided Attention Learning for Cloth-Changing Person Re-Identification
    Liu, Xiangzeng
    Liu, Kunpeng
    Guo, Jianfeng
    Zhao, Peipei
    Quan, Yining
    Miao, Qiguang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5490 - 5498
  • [29] Deep Features for Person Re-identification
    Wang, Shuang
    Shang, Yanfeng
    Wang, Jian
    Mei, Lin
    Hu, Chuanping
    2015 11TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG), 2015, : 244 - 247
  • [30] Pose Guided Gated Fusion for Person Re-identification
    Bhuiyan, Amran
    Liu, Yang
    Siva, Parthipan
    Javan, Mehrsan
    Ben Ayed, Ismail
    Granger, Eric
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2664 - 2673