When Person Re-identification Meets Changing Clothes

被引:73
|
作者
Wan, Fangbin [1 ,4 ]
Wu, Yang [2 ,6 ]
Qian, Xuelin [3 ,4 ]
Chen, Yixiong [1 ,4 ]
Fu, Yanwei [1 ,4 ,5 ]
机构
[1] Fudan Univ, Sch Data Sci, Shanghai, Peoples R China
[2] Kyoto Univ, Kyoto, Japan
[3] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[4] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
[5] Fudan Univ, MOE Frontiers Ctr Brain Sci, Shanghai, Peoples R China
[6] Kyoto Univ, Grad Sch Informat, Dept Intelligenai Sci & Technol, Kyoto, Japan
关键词
D O I
10.1109/CVPRW50498.2020.00423
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (ReID) is now an active research topic for AI-based video surveillance applications such as specific person search, but the practical issue that the target person(s) may change clothes (clothes inconsistency problem) has been overlooked for long. For the first time, this paper systematically studies this problem. We first overcome the difficulty of lack of suitable dataset, by collecting a small yet representative real dataset for testing whilst building a large realistic synthetic dataset for training and deeper studies. Facilitated by our new datasets, we are able to conduct various interesting new experiments for studying the influence of clothes inconsistency. We find that changing clothes makes ReID a much harder problem in the sense of bringing difficulties to learning effective representations and also challenges the generalization ability of previous ReID models to identify persons with unseen (new) clothes. Representative existing ReID models are adopted to show informative results on such a challenging setting, and we also provide some preliminary efforts on improving the robustness of existing models on handling the clothes inconsistency issue in the data. We believe that this study can be inspiring and helpful for encouraging more researches in this direction. The dataset is available on the project website: https://wanfb.github.io/dataset.html. [GRAPHICS] .
引用
收藏
页码:3620 / 3628
页数:9
相关论文
共 50 条
  • [1] Clothes-Changing Person Re-identification with RGB Modality Only
    Gu, Xinqian
    Chang, Hong
    Ma, Bingpeng
    Bai, Shutao
    Shan, Shiguang
    Chen, Xilin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 1050 - 1059
  • [2] Learning Disentangled Features for Person Re-identification under Clothes Changing
    Chan, Patrick P. K.
    Hu, Xiaoman
    Song, Haorui
    Peng, Peng
    Chen, Keke
    Yeung, Daniel S.
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [3] Improvement of the Clothes-Changing Person Re-identification with Multiple Loss Functions
    Ding, Yongkang
    Mao, Rui
    Zhu, Hanyue
    Zhang, Liyan
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1503 - 1508
  • [4] Multidimensional Semantic Disentanglement Network for Clothes-Changing Person Re-Identification
    Ding, Yongkang
    Wang, Anqi
    Zhang, Liyan
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 1025 - 1033
  • [5] Clothes-Changing Image Generation Based on Attention for Person Re-identification
    Tang, Cheng
    Guo, Jie
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 2009 - 2013
  • [6] COCAS: A Large-Scale Clothes Changing Person Dataset for Re-identification
    Yu, Shijie
    Li, Shihua
    Chen, Dapeng
    Zhao, Rui
    Yan, Junjie
    Qiao, Yu
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3397 - 3406
  • [7] A benchmark for clothes variation in person re-identification
    Wang, Kai
    Ma, Zhi
    Chen, Shiyan
    Yang, Jinni
    Zhou, Keke
    Li, Tao
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2020, 35 (12) : 1881 - 1898
  • [8] COCAS plus : Large-Scale Clothes-Changing Person Re-Identification With Clothes Templates
    Li, Shihua
    Chen, Haobin
    Yu, Shijie
    He, Zhiqun
    Zhu, Feng
    Zhao, Rui
    Chen, Jie
    Qiao, Yu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (04) : 1839 - 1853
  • [9] Clothes-Changing Person Re-Identification Using Color and Texture Invariant Representation
    Wang, Huiyan
    Ying, Ming
    Jiang, Huan
    Shen, Qiufang
    Li, Fashuai
    Li, Xiaolan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (01) : 323 - 336
  • [10] Clothes-Eraser: clothing-aware controllable disentanglement for clothes-changing person re-identification
    Ding, Yongkang
    Mao, Rui
    Du, Guodong
    Zhang, Liyan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (05) : 4337 - 4348