Spatial transformer network on skeleton-based gait recognition

Skeleton-based gait recognition models suffer from the robustness problem, as the rank-1 accuracy varies from 90% in normal walking cases to 70% in walking with coats cases. In this work, we propose a state-of-the-art robust skeleton-based gait recognition model called Gait-TR, which is based on the combination of spatial transformer frameworks and temporal convolutional networks. Gait-TR achieves substantial improvements over other skeleton-based gait models with higher accuracy and better robustness on the well-known gait dataset CASIA-B. Particularly in walking with coats cases, Gait-TR gets a similar to 90% accuracy rate. This result is higher than the best result of silhouette-based models, which usually have higher accuracy than the skeleton-based gait recognition models. Moreover, our experiment on CASIA-B shows that the spatial transformer network can extract gait features from the human skeleton better than the widely used graph convolutional network.