Pedestrian trajectory prediction algorithm based on graph convolutional network

被引:0
|
作者
Wang T. [1 ]
Liu Y. [1 ]
Guo J. [2 ]
Jin W. [2 ]
机构
[1] School of Microelectronics, Tianjin University, Tianjin
[2] School of Electrical and Information Engineering, Tianjin University, Tianjin
关键词
Graph convolutional network; Interaction model; Long short-term memory; Mutual information; Trajectory prediction;
D O I
10.11918/202006051
中图分类号
学科分类号
摘要
To solve the problem that the pedestrian interaction model is difficult to be effectively constructed in the pedestrian trajectory prediction task, a trajectory prediction algorithm based on graph convolutional network (TP-GCN) was proposed to establish pedestrian interaction and predict future trajectories of pedestrians. First, the long short-term memory was used to extract the trajectory motion features of the trajectory sequences of pedestrians. Then, the pedestrians were considered as the nodes on the graph, and adjacency matrix was built to represent the created interactions. Next, the connection weights between unrelated nodes were screened out according to the blind zone. For trajectory motion features, the graph convolutional network was applied to extract the interactions between the trajectories and increase the extraction of the interaction in each trajectory, and the interaction was then encoded as trajectory interaction features by using long short-term memory. Furthermore, the weights of the graph convolutional network were optimized by the Deep Graph Info method to ensure that the motion pattern of individual accords with those of all the pedestrians in the scene. Finally, the trajectory motion features and trajectory interaction features were decoded using long short-term memory to complete the trajectory prediction. According to the experiment on the public datasets ETH and UCY, the proposed algorithm could make the predictions of pedestrian habits close to the real trajectories based on the interaction model between pedestrians, and the overall prediction accuracy was high. In addition, the ablation experiment and the visualization of the predicted trajectory also verified the effectiveness and interpretability of the algorithm. Copyright ©2021 Journal of Harbin Institute of Technology.All rights reserved.
引用
下载
收藏
页码:53 / 60
页数:7
相关论文
共 20 条
  • [1] HUDNELL M, PRICE T, FRAHM J M., Robust aleatoric modeling for future vehicle localization, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), (2019)
  • [2] SADEGHIAN A, KOSARAJU V, SADEGHIAN A, Et al., SoPhie: an attentive GAN for predicting paths compliant to social and physical constraints, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2019)
  • [3] CHOI W, SAVARESE S., A unified framework for multi-target tracking and collective activity recognition, European Conference on Computer Vision, (2012)
  • [4] PELLEGRINI S, ESS A, SCHINDLER K, Et al., You'll never walk alone: modeling social behavior for multi-target tracking, 2009 IEEE 12th International Conference on Computer Vision, (2009)
  • [5] ALAHI A, GOEL K, RAMANATHAN V, Et al., Social LSTM: human trajectory prediction in crowded spaces, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2016)
  • [6] HOCHREITER S, SCHMIDHUBER J., Long short-term memory, Neural Computation, 9, 8, (1997)
  • [7] GUPTA A, JOHNSON J, LI Feifei, Et al., Social GAN: socially acceptable trajectories with generative adversarial networks, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2018)
  • [8] HASAN I, SETTI F, TSESMELIS T, Et al., MX-LSTM: mixing tracklets and vislets to jointly forecast trajectories and head poses, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2018)
  • [9] ZHANG Zhiyuan, DIAO Yinghua, Pedestrian trajectory prediction model with social features and attention, Journal of Xidian University, 47, 1, (2020)
  • [10] AMIRIAN J, HAYET J B, PETTRE J., Social ways: learning multi-modal distributions of pedestrian trajectories with GANs, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), (2019)