PGDS: Pose-Guidance Deep Supervision for Mitigating Clothes-Changing in Person Re-Identification

被引:0
|
作者
Quoc-Huy Trinh [1 ]
Nhat-Tan Bui [1 ]
Dinh-Hieu Hoang [1 ]
Phuoc-Thao Vo Thi [2 ]
Hai-Dang Nguyen [2 ]
Debesh Jha [3 ]
Ulas Bagci [4 ]
Ngan Le [1 ]
Minh-Triet Tran [1 ]
机构
[1] Vietnam Natl Univ, Univ Sci, Ho Chi Minh City, Vietnam
[2] Vietnam Natl Univ, John von Neumann Inst, Ho Chi Minh City, Vietnam
[3] Univ Arkansas, AICV Lab, Fayetteville, AR 72701 USA
[4] Northwestern Univ, Chicago, IL 60611 USA
关键词
D O I
10.1109/AVSS61716.2024.10672607
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person Re-Identification (Re-ID) task seeks to enhance the tracking of multiple individuals by surveillance cameras. It supports multimodal tasks, including text-based person retrieval and human matching. One of the most significant challenges faced in Re-ID is clothes-changing, where the same person may appear in different outfits. While previous methods have made notable progress in maintaining clothing data consistency and handling clothing change data, they still rely excessively on clothing information, which can limit performance due to the dynamic nature of human appearances. To mitigate this challenge, we propose the Pose-Guidance Deep Supervision (PGDS), an effective framework for learning pose guidance within the Re-ID task. It consists of three modules: a human encoder, a pose encoder, and a Pose-to-Human Projection module (PHP). Our framework guides the human encoder, i.e., the main re-identification model, with pose information from the pose encoder through multiple layers via the knowledge transfer mechanism from the PHP module, helping the human encoder learn body parts information without increasing computation resources in the inference stage. Through extensive experiments, our method surpasses the performance of current state-of-the-art methods, demonstrating its robustness and effectiveness for real-world applications. Our code is available at https:// github. com/huyquoctrinh/PGDS.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Clothes-Changing Person Re-identification with RGB Modality Only
    Gu, Xinqian
    Chang, Hong
    Ma, Bingpeng
    Bai, Shutao
    Shan, Shiguang
    Chen, Xilin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 1050 - 1059
  • [2] Improvement of the Clothes-Changing Person Re-identification with Multiple Loss Functions
    Ding, Yongkang
    Mao, Rui
    Zhu, Hanyue
    Zhang, Liyan
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1503 - 1508
  • [3] Multidimensional Semantic Disentanglement Network for Clothes-Changing Person Re-Identification
    Ding, Yongkang
    Wang, Anqi
    Zhang, Liyan
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 1025 - 1033
  • [4] Clothes-Changing Image Generation Based on Attention for Person Re-identification
    Tang, Cheng
    Guo, Jie
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 2009 - 2013
  • [5] Appearance-Pose Joint Coordinates Information Collaboration Model for clothes-changing person re-identification
    Bi, Xiaojun
    Wang, Hao
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 241
  • [6] Clothes-Changing Person Re-Identification Using Color and Texture Invariant Representation
    Wang, Huiyan
    Ying, Ming
    Jiang, Huan
    Shen, Qiufang
    Li, Fashuai
    Li, Xiaolan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (01) : 323 - 336
  • [7] COCAS plus : Large-Scale Clothes-Changing Person Re-Identification With Clothes Templates
    Li, Shihua
    Chen, Haobin
    Yu, Shijie
    He, Zhiqun
    Zhu, Feng
    Zhao, Rui
    Chen, Jie
    Qiao, Yu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (04) : 1839 - 1853
  • [8] A visible-infrared clothes-changing dataset for person re-identification in natural scene
    Wei, Xianbin
    Song, Kechen
    Yang, Wenkang
    Yan, Yunhui
    Meng, Qinggang
    NEUROCOMPUTING, 2024, 569
  • [9] Clothes-Eraser: clothing-aware controllable disentanglement for clothes-changing person re-identification
    Ding, Yongkang
    Mao, Rui
    Du, Guodong
    Zhang, Liyan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (05) : 4337 - 4348
  • [10] Clothes-Changing Person Re-Identification via Universal Framework With Association and Forgetting Learning
    Liu, Yuxuan
    Ge, Hongwei
    Wang, Zhen
    Hou, Yaqing
    Zhao, Mingde
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4294 - 4307