Leaning compact and representative features for cross-modality person re-identification

被引:12
|
作者
Gao, Guangwei [1 ,2 ]
Shao, Hao [1 ]
Wu, Fei [1 ]
Yang, Meng [3 ]
Yu, Yi [2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Inst Adv Technol, Nanjing, Peoples R China
[2] Natl Inst Informat, Digital Content & Media Sci Res Div, Tokyo, Japan
[3] Sun Yat Sen Univ, Key Lab Machine Intelligence & Adv Comp, Minist Educ, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Person re-identification; Cross-modality; Angular triplet loss; Knowledge distillation loss;
D O I
10.1007/s11280-022-01014-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper pays close attention to the cross-modality visible-infrared person re-identification (VI Re-ID) task, which aims to match pedestrian samples between visible and infrared modes. In order to reduce the modality-discrepancy between samples from different cameras, most existing works usually use constraints based on Euclidean metric. Because of the Euclidean based distance metric strategy cannot effectively measure the internal angles between the embedded vectors, the existing solutions cannot learn the angularly discriminative feature embedding. Since the most important factor affecting the classification task based on embedding vector is whether there is an angularly discriminative feature space, in this paper, we present a new loss function called Enumerate Angular Triplet (EAT) loss. Also, motivated by the knowledge distillation, to narrow down the features between different modalities before feature embedding, we further present a novel Cross-Modality Knowledge Distillation (CMKD) loss. Benefit from the above two considerations, the embedded features are discriminative enough in a way to tackle modality-discrepancy problem. The experimental results on RegDB and SYSU-MM01 datasets have demonstrated that the proposed method is superior to the other most advanced methods in terms of impressive performance. Code is available at https://github.com/IVIPLab/LCCRF.
引用
收藏
页码:1649 / 1666
页数:18
相关论文
共 50 条
  • [1] Leaning compact and representative features for cross-modality person re-identification
    Guangwei Gao
    Hao Shao
    Fei Wu
    Meng Yang
    Yi Yu
    [J]. World Wide Web, 2022, 25 : 1649 - 1666
  • [2] Modality interactive attention for cross-modality person re-identification
    Zou, Zilin
    Chen, Ying
    [J]. IMAGE AND VISION COMPUTING, 2024, 148
  • [3] Rethinking Shared Features and Re-ranking for Cross-Modality Person Re-identification
    Jiang, Na
    Wang, Zhaofa
    Xu, Peng
    Wu, Xinyue
    Zhang, Lei
    [J]. MULTIMEDIA MODELING, MMM 2022, PT II, 2022, 13142 : 305 - 317
  • [4] Self-attention Cross-modality Fusion Network for Cross-modality Person Re-identification
    Du, Peng
    Song, Yong-Hong
    Zhang, Xin-Yao
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (06): : 1457 - 1468
  • [5] Channel decoupling network for cross-modality person re-identification
    Chen, Jingying
    Chen, Chang
    Tan, Lei
    Peng, Shixin
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (09) : 14091 - 14105
  • [6] Dynamic feature weakening for cross-modality person re-identification*
    Lu, Jian
    Chen, Mengdie
    Wang, Hangying
    Pang, Feifei
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2023, 109
  • [7] RGB-Infrared Cross-Modality Person Re-Identification
    Wu, Ancong
    Zheng, Wei-Shi
    Yu, Hong-Xing
    Gong, Shaogang
    Lai, Jianhuang
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 5390 - 5399
  • [8] Cross-Modality Person Re-Identification with Generative Adversarial Training
    Dai, Pingyang
    Ji, Rongrong
    Wang, Haibin
    Wu, Qiong
    Huang, Yuyu
    [J]. PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 677 - 683
  • [9] Distance based Training for Cross-Modality Person Re-Identification
    Tekeli, Nihat
    Can, Ahmet Burak
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 4540 - 4549
  • [10] Revisiting Dropout Regularization for Cross-Modality Person Re-Identification
    Rachmadi, Reza Fuad
    Nugroho, Supeno Mardi Susiki
    Purnama, I. Ketut Eddy
    [J]. IEEE ACCESS, 2022, 10 : 102195 - 102209