Pose Transferrable Person Re-Identification

被引:284
|
作者
Liu, Jinxian [1 ]
Ni, Bingbing [1 ]
Yan, Yichao [1 ]
Zhou, Peng [1 ]
Cheng, Shuo [1 ]
Hu, Jianguo [2 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai Key Lab Digital Media Proc & Transmiss, Shanghai 200240, Peoples R China
[2] Minivision, Nanjing, Jiangsu, Peoples R China
基金
美国国家科学基金会;
关键词
D O I
10.1109/CVPR.2018.00431
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (ReID) is an important task in the field of intelligent security. A key challenge is how to capture human pose variations, while existing benchmarks (i.e., Market] 501, DukeMTMC-reID, CUHK03, etc.) do NOT provide sufficient pose coverage to train a robust ReID system. To address this issue, we propose a pose transferrable person ReID framework which utilizes pose transferred sample augmentations (i.e., with ID supervision) to enhance ReID model training. On one hand, novel training samples with rich pose variations are generated via transferring pose instances from MARS dataset, and they are added into the target dataset to facilitate robust training. On the other hand, in addition to the conventional discriminator of GAN (i.e., to distinguish between REAL/FAKE samples), we propose a novel guider sub-network which encourages the generated sample (i.e., with novel pose) towards better satisfying the ReID loss (i.e., cross-entropy ReID loss, triplet ReID loss). In the meantime, an alternative optimization procedure is proposed to train the proposed Generator-Guider-Discriminator network. Experimental results on Market-1501, DukeMTMC-reID and CUHK03 show that our method achieves great performance improvement, and outperforms most state-of-the-art methods without elaborate designing the ReID model.
引用
收藏
页码:4099 / 4108
页数:10
相关论文
共 50 条
  • [41] Pose-Guided Attention Learning for Cloth-Changing Person Re-Identification
    Liu, Xiangzeng
    Liu, Kunpeng
    Guo, Jianfeng
    Zhao, Peipei
    Quan, Yining
    Miao, Qiguang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5490 - 5498
  • [42] Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification
    Zheng, Kecheng
    Lan, Cuiling
    Zeng, Wenjun
    Liu, Jiawei
    Zhang, Zhizheng
    Zha, Zheng-Jun
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4537 - 4545
  • [43] PGMANet:Pose-Guided Mixed Attention Network for Occluded Person Re-Identification
    Zhai, You
    Han, Xianfeng
    Ma, Wenzhuo
    Gou, Xinye
    Xiao, Guoqiang
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [44] Person re-identification via deep compound eye network and pose repair module
    Gu, Hongjian
    Zou, Wenxuan
    Cheng, Keyang
    Wu, Bin
    Ghafoor, Humaira Abdul
    Zhan, Yongzhao
    IET COMPUTER VISION, 2024, 18 (06) : 826 - 841
  • [45] Person re-identification based on pose angle estimation and multi-feature extraction
    Andavar, Suruliandi
    Elango, Poongothai
    IET BIOMETRICS, 2018, 7 (04) : 365 - 370
  • [46] Video-based Person Re-identification Method Based on GAN and Pose Estimation
    Liu Y.-M.
    Jiang J.-G.
    Qi M.-B.
    Liu H.
    Zhou H.-J.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (03): : 576 - 584
  • [47] Task-Specific Neural Networks for Pose Estimation in Person Re-identification Task
    Lv, Kai
    Sheng, Hao
    Zheng, Yanwei
    Xiong, Zhang
    Li, Wei
    Ke, Wei
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT I, 2018, 10735 : 792 - 801
  • [48] Pose-guided spatiotemporal alignment for video-based person Re-identification
    Gao, Changxin
    Chen, Yang
    Yu, Jin-Gang
    Sang, Nong
    INFORMATION SCIENCES, 2020, 527 : 176 - 190
  • [49] PAFM: pose-drive attention fusion mechanism for occluded person re-identification
    Jing Yang
    Canlong Zhang
    Yanping Tang
    Zhixin Li
    Neural Computing and Applications, 2022, 34 : 8241 - 8252
  • [50] PAFM: pose-drive attention fusion mechanism for occluded person re-identification
    Yang, Jing
    Zhang, Canlong
    Tang, Yanping
    Li, Zhixin
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (10): : 8241 - 8252