A Strong and Robust Skeleton-Based Gait Recognition Method with Gait Periodicity Priors

被引:19
|
作者
Li, Na [1 ]
Zhao, Xinbo [1 ]
机构
[1] Northwestern Polytech Univ, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Sch Comp Sci & Engn, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Skeleton; Gait recognition; Legged locomotion; Indexes; Robustness; Convolution; pace; periodicity; skeleton;
D O I
10.1109/TMM.2022.3154609
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Gait recognition aims to identify people by their walking patterns. Normal human walking is a periodic movement, however, existing gait recognition methods rarely make use of gait periodicity. In this paper, we propose the gait Periodicity-inspired Temporal feature Pyramid aggregator (PTP), which introduces gait periodicity priors into gait feature extraction, resulting in a strong and robust skeleton-based gait recognition method called CycleGait. Specifically, inspired by gait periodicity, PTP adopts multiple parallel temporal convolution operators with pyramid temporal kernel sizes to extract temporal gait features. Then, PTP cooperates with the spatial Graph Convolutional Network (GCN) to form the GCN-PTP network. CycleGait uses this network to extract spatio-temporal gait features from a sequence of skeleton coordinates. In addition, to improve CycleGait's robustness and performance, we feed more gait samples with various gait cycles into CycleGait with the plug-and-play Irregular Pace Converter (IPC), which can automatically convert normal pace into irregular and reasonable paces. Extensive experiments conducted on the CASIA-B dataset and OG RGB+D dataset show that CycleGait has excellent performance in various complex scenarios, namely, cross-view and cross-walking conditions, and becomes one of the best SOTA methods, which not only outperforms the best preexisting gait recognition methods by a large margin but also exhibits a significant level of robustness.
引用
收藏
页码:3046 / 3058
页数:13
相关论文
共 50 条
  • [1] Gait-D: Skeleton-based gait feature decomposition for gait recognition
    Gao, Shuo
    Yun, Jing
    Zhao, Yumeng
    Liu, Limin
    [J]. IET COMPUTER VISION, 2022, 16 (02) : 111 - 125
  • [2] Skeleton-based abnormal gait recognition: a survey
    Tian H.-Y.
    Ma X.
    Li Y.-B.
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2022, 52 (04): : 725 - 737
  • [3] Skeleton-Based Gait Recognition via Robust Frame-Level Matching
    Choi, Seokeon
    Kim, Jonghee
    Kim, Wonjun
    Kim, Changick
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2019, 14 (10) : 2577 - 2592
  • [4] Towards a Deeper Understanding of Skeleton-based Gait Recognition
    Teepe, Torben
    Gilg, Johannes
    Herzog, Fabian
    Hoermann, Stefan
    Rigoll, Gerhard
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1568 - 1576
  • [5] Spatial transformer network on skeleton-based gait recognition
    Zhang, Cun
    Chen, Xing-Peng
    Han, Guo-Qiang
    Liu, Xiang-Jie
    [J]. EXPERT SYSTEMS, 2023, 40 (06)
  • [6] GAITGRAPH: GRAPH CONVOLUTIONAL NETWORK FOR SKELETON-BASED GAIT RECOGNITION
    Teepe, Torben
    Khan, Ali
    Gilg, Johannes
    Herzog, Fabian
    Hoermann, Stefan
    Rigoll, Gerhard
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2314 - 2318
  • [7] Skeleton-Based Abnormal Gait Detection
    Trong-Nguyen Nguyen
    Huu-Hung Huynh
    Meunier, Jean
    [J]. SENSORS, 2016, 16 (11):
  • [8] Frame-level refinement networks for skeleton-based gait recognition
    Wang, Likai
    Chen, Jinyan
    Liu, Yuxin
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 222
  • [9] Gaitdlf: global and local fusion for skeleton-based gait recognition in the wild
    Wei, Siwei
    Liu, Weijie
    Wei, Feifei
    Wang, Chunzhi
    Xiong, Neal N.
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (12): : 17606 - 17632
  • [10] JRPM: Joints Relationship Pyramid Mapping for Skeleton-based Gait Recognition
    Li, Na
    Zhao, Xinbo
    [J]. 2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 187 - 191