PAII: A Pose Alignment Network with Information Interaction for Person Re-identification

被引:0
|
作者
Lyu, Chunyan [1 ]
Xu, Tong [1 ]
Ning, Wu [1 ]
Cheng, Qi [1 ]
Wang, Kejun [1 ,2 ]
Wang, Chenhui [3 ]
机构
[1] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
[2] Beijing Inst Technol Zhuhai, Sch Informat Technol, Zhuhai, Peoples R China
[3] Univ Calif Los Angeles, Dept Stat, Los Angeles, CA 90095 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Semantic alignment; Information interaction; Pose estimation; ATTENTION;
D O I
10.1007/s11061-077-10947-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important part of intelligent surveillance systems, person re-identification (re-ID) has a wide range of application prospects in smart cities. However, due to occlusion, viewpoint variation, and background shift, the misalignment problem always decreases the re-ID systems' effects. To solve this problem, a pose alignment network with information interaction (PAII) is proposed. This approach consists of three cascaded modules. First, guided by a pretrained pose estimator, the backbone with a dual attention block is used to obtain local features corresponding to different pose keypoints along with the global feature. Then, a pose alignment module is constructed to group these local features into different parts and fuse them with a hyperparameter lambda, which provides the possibility to achieve semantic alignment. Finally, since different semantic features are extracted, an information interaction module consisting of graph attention layers is made to conduct message passing between different semantic features. All semantic features and the global feature are used to calculate the loss functions. Our approach considers multi-scale representations and information interaction of semantic features, which makes it more robust to misalignment problems. Thus, the proposed PAII method achieves better performance than most existing methods on multiple popular re-ID datasets.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Interaction-and-Aggregation Network for Person Re-identification
    Hou, Ruibing
    Ma, Bingpeng
    Chang, Hong
    Gu, Xinqian
    Shan, Shiguang
    Chen, Xilin
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9309 - 9318
  • [22] Pose Variation Adaptation for Person Re-identification
    Zhang, Lei
    Jiang, Na
    Xu, Yue
    Diao, Qishuai
    Zhou, Zhong
    Wu, Wei
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 6996 - 7003
  • [23] Pose-guided spatiotemporal alignment for video-based person Re-identification
    Gao, Changxin
    Chen, Yang
    Yu, Jin-Gang
    Sang, Nong
    INFORMATION SCIENCES, 2020, 527 : 176 - 190
  • [24] A multi-branch attention and alignment network for person re-identification
    Lyu, Chunyan
    Ning, Wu
    Wang, Chenhui
    Wang, Kejun
    APPLIED INTELLIGENCE, 2022, 52 (10) : 10845 - 10866
  • [25] A multi-branch attention and alignment network for person re-identification
    Chunyan Lyu
    Wu Ning
    Chenhui Wang
    Kejun Wang
    Applied Intelligence, 2022, 52 : 10845 - 10866
  • [26] Pedestrian Alignment Network for Large-scale Person Re-Identification
    Zheng, Zhedong
    Zheng, Liang
    Yang, Yi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (10) : 3037 - 3045
  • [27] Partial Person Re-identification with Alignment and Hallucination
    Iodice, Sara
    Mikolajczyk, Krystian
    COMPUTER VISION - ACCV 2018, PT VI, 2019, 11366 : 101 - 116
  • [28] Person re-identification with part prediction alignment
    Li, Zhiyong
    Lv, Jingyi
    Chen, Ying
    Yuan, Jin
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 205
  • [29] An improved interaction-and-aggregation network for person re-identification
    Tao, Huanjie
    Bao, Wenjie
    Duan, Qianyue
    Hu, Zhenwu
    An, Jianfeng
    Xie, Chao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (28) : 44053 - 44069
  • [30] Multi-granularity Pose Fusion Network with Views for Person Re-identification
    Liu, Yong
    Li, Yiming
    Song, Andy
    Shang, Lin
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,