PAII: A Pose Alignment Network with Information Interaction for Person Re-identification

被引:0
|
作者
Lyu, Chunyan [1 ]
Xu, Tong [1 ]
Ning, Wu [1 ]
Cheng, Qi [1 ]
Wang, Kejun [1 ,2 ]
Wang, Chenhui [3 ]
机构
[1] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
[2] Beijing Inst Technol Zhuhai, Sch Informat Technol, Zhuhai, Peoples R China
[3] Univ Calif Los Angeles, Dept Stat, Los Angeles, CA 90095 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Semantic alignment; Information interaction; Pose estimation; ATTENTION;
D O I
10.1007/s11061-077-10947-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important part of intelligent surveillance systems, person re-identification (re-ID) has a wide range of application prospects in smart cities. However, due to occlusion, viewpoint variation, and background shift, the misalignment problem always decreases the re-ID systems' effects. To solve this problem, a pose alignment network with information interaction (PAII) is proposed. This approach consists of three cascaded modules. First, guided by a pretrained pose estimator, the backbone with a dual attention block is used to obtain local features corresponding to different pose keypoints along with the global feature. Then, a pose alignment module is constructed to group these local features into different parts and fuse them with a hyperparameter lambda, which provides the possibility to achieve semantic alignment. Finally, since different semantic features are extracted, an information interaction module consisting of graph attention layers is made to conduct message passing between different semantic features. All semantic features and the global feature are used to calculate the loss functions. Our approach considers multi-scale representations and information interaction of semantic features, which makes it more robust to misalignment problems. Thus, the proposed PAII method achieves better performance than most existing methods on multiple popular re-ID datasets.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Pose transfer generation with semantic parsing attention network for person re-identification
    Liu, Meichen
    Wang, Kejun
    Ji, Ruihang
    Ge, Shuzhi Sam
    Chen, Jing
    KNOWLEDGE-BASED SYSTEMS, 2021, 223
  • [32] An improved interaction-and-aggregation network for person re-identification
    Huanjie Tao
    Wenjie Bao
    Qianyue Duan
    Zhenwu Hu
    Jianfeng An
    Chao Xie
    Multimedia Tools and Applications, 2023, 82 : 44053 - 44069
  • [33] Pose Guided Gated Fusion for Person Re-identification
    Bhuiyan, Amran
    Liu, Yang
    Siva, Parthipan
    Javan, Mehrsan
    Ben Ayed, Ismail
    Granger, Eric
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2664 - 2673
  • [34] Fine-grained alignment network and local attention network for person re-identification
    Zhou, Dongming
    Zhang, Canlong
    Tang, Yanping
    Li, Zhixin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (30) : 43267 - 43281
  • [35] Fine-grained alignment network and local attention network for person re-identification
    Dongming Zhou
    Canlong Zhang
    Yanping Tang
    Zhixin Li
    Multimedia Tools and Applications, 2022, 81 : 43267 - 43281
  • [36] HOReID: Deep High-Order Mapping Enhances Pose Alignment for Person Re-Identification
    Wang, Pingyu
    Zhao, Zhicheng
    Su, Fei
    Zu, Xingyu
    Boulgouris, Nikolaos, V
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2908 - 2922
  • [37] Grafted network for person re-identification
    Wang, Jiabao
    Li, Yang
    Jiao, Shanshan
    Miao, Zhuang
    Zhang, Rui
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 80
  • [38] Person Re-Identification by Siamese Network
    Shebiah, R. Newlin
    Arivazhagan, S.
    Amrith, S. G.
    Adarsh, S.
    INTELIGENCIA ARTIFICIAL-IBEROAMERICAL JOURNAL OF ARTIFICIAL INTELLIGENCE, 2023, 26 (71): : 25 - 33
  • [39] Relation Network for Person Re-Identification
    Park, Hyunjong
    Ham, Bumsub
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11839 - 11847
  • [40] Person re-identification based on multi-level and generated alignment network
    Chong, Yanwen
    Zhang, Chen
    Feng, Wenqiang
    Pan, Shaoming
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2022, 50 (04): : 64 - 70