A Strong and Robust Skeleton-Based Gait Recognition Method with Gait Periodicity Priors

被引:19
|
作者
Li, Na [1 ]
Zhao, Xinbo [1 ]
机构
[1] Northwestern Polytech Univ, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Sch Comp Sci & Engn, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Skeleton; Gait recognition; Legged locomotion; Indexes; Robustness; Convolution; pace; periodicity; skeleton;
D O I
10.1109/TMM.2022.3154609
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Gait recognition aims to identify people by their walking patterns. Normal human walking is a periodic movement, however, existing gait recognition methods rarely make use of gait periodicity. In this paper, we propose the gait Periodicity-inspired Temporal feature Pyramid aggregator (PTP), which introduces gait periodicity priors into gait feature extraction, resulting in a strong and robust skeleton-based gait recognition method called CycleGait. Specifically, inspired by gait periodicity, PTP adopts multiple parallel temporal convolution operators with pyramid temporal kernel sizes to extract temporal gait features. Then, PTP cooperates with the spatial Graph Convolutional Network (GCN) to form the GCN-PTP network. CycleGait uses this network to extract spatio-temporal gait features from a sequence of skeleton coordinates. In addition, to improve CycleGait's robustness and performance, we feed more gait samples with various gait cycles into CycleGait with the plug-and-play Irregular Pace Converter (IPC), which can automatically convert normal pace into irregular and reasonable paces. Extensive experiments conducted on the CASIA-B dataset and OG RGB+D dataset show that CycleGait has excellent performance in various complex scenarios, namely, cross-view and cross-walking conditions, and becomes one of the best SOTA methods, which not only outperforms the best preexisting gait recognition methods by a large margin but also exhibits a significant level of robustness.
引用
下载
收藏
页码:3046 / 3058
页数:13
相关论文
共 50 条
  • [21] Skeleton-based abnormal gait recognition with spatio-temporal attention enhanced gait-structural graph convolutional networks
    Tian, Haoyu
    Ma, Xin
    Wu, Hanbo
    Li, Yibin
    NEUROCOMPUTING, 2022, 473 : 116 - 126
  • [22] Learning view-invariant features using stacked autoencoder for skeleton-based gait recognition
    Hasan, Md Mahedi
    Mustafa, Hossen Asiful
    IET COMPUTER VISION, 2021, 15 (07) : 527 - 545
  • [23] Data augmentation for depression detection using skeleton-based gait information
    Yang, Jingjing
    Lu, Haifeng
    Li, Chengming
    Hu, Xiping
    Hu, Bin
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2022, 60 (09) : 2665 - 2679
  • [24] Multi-stream part-fused graph convolutional networks for skeleton-based gait recognition
    Wang, Likai
    Chen, Jinyan
    Chen, Zhenghang
    Liu, Yuxin
    Yang, Haolin
    CONNECTION SCIENCE, 2022, 34 (01) : 652 - 669
  • [25] Data augmentation for depression detection using skeleton-based gait information
    Jingjing Yang
    Haifeng Lu
    Chengming Li
    Xiping Hu
    Bin Hu
    Medical & Biological Engineering & Computing, 2022, 60 : 2665 - 2679
  • [26] Pose Encoding for Robust Skeleton-Based Action Recognition
    Demisse, Girum G.
    Papadopoulos, Konstantinos
    Aouada, Djamila
    Ottersten, Bjorn
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 301 - 307
  • [27] A partition approach for robust gait recognition based on gait template fusion
    Wang, Kejun
    Liu, Liangliang
    Ding, Xinnan
    Yu, Kaiqiang
    Hu, Gang
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2021, 22 (05) : 709 - 719
  • [28] Skeleton based gait recognition for long and baggy clothes
    Alharbi, Abrar
    Alharbi, Fahad
    Kamioka, Eiji
    2018 INTERNATIONAL JOINT CONFERENCE ON METALLURGICAL AND MATERIALS ENGINEERING (JCMME 2018), 2019, 277
  • [29] Gait Recognition Using Skeleton Data
    Prathap, C.
    Sakkara, Sumanth
    2015 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2015, : 2302 - 2306
  • [30] Robust CNN-based Gait Verification and Identification using Skeleton Gait Energy Image
    Yao, Lingxiang
    Kusakunniran, Worapan
    Wu, Qiang
    Zhang, Jian
    Tang, Zhenmin
    2018 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2018, : 297 - 303