Pedestrian trajectory prediction with convolutional neural networks

被引:53
|
作者
Zamboni, Simone [1 ]
Kefato, Zekarias Tilahun [1 ]
Girdzijauskas, Sarunas [1 ]
Noren, Christoffer [2 ]
Dal Col, Laura [2 ]
机构
[1] KTH Div Software & Comp Syst, Stockholm, Sweden
[2] Autonomous Transport Syst Scania CV AB, Sodertalje, Sweden
关键词
Trajectory prediction; Pedestrian prediction; Convolutional neural networks; ATTENTION; MODEL;
D O I
10.1016/j.patcog.2021.108252
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Predicting the future trajectories of pedestrians is a challenging problem that has a range of application, from crowd surveillance to autonomous driving. In literature, methods to approach pedestrian trajectory prediction have evolved, transitioning from physics-based models to data-driven models based on recurrent neural networks. In this work, we propose a new approach to pedestrian trajectory prediction, with the introduction of a novel 2D convolutional model. This new model outperforms recurrent models, and it achieves state-of-the-art results on the ETH and TrajNet datasets. We also present an effective system to represent pedestrian positions and powerful data augmentation techniques, such as the addition of Gaussian noise and the use of random rotations, which can be applied to any model. As an additional exploratory analysis, we present experimental results on the inclusion of occupancy methods to model social information, which empirically show that these methods are ineffective in capturing social interaction. (c) 2021 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Unsupervised pedestrian trajectory prediction with graph neural networks
    Wang, Mingkun
    Shi, Dianxi
    Guan, Naiyang
    Zhang, Tao
    Wang, Liujing
    Li, Ruoxiang
    [J]. 2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 832 - 839
  • [2] Interacting Vehicle Trajectory Prediction with Convolutional Recurrent Neural Networks
    Mukherjee, Saptarshi
    Wang, Sen
    Wallace, Andrew
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 4336 - 4342
  • [3] DSTCNN: Deformable spatial-temporal convolutional neural network for pedestrian trajectory prediction
    Chen, Wangxing
    Sang, Haifeng
    Wang, Jinyu
    Zhao, Zishan
    [J]. INFORMATION SCIENCES, 2024, 666
  • [4] Pedestrian detection with convolutional neural networks
    Szarvas, M
    Yoshizawa, A
    Yamamoto, M
    Ogata, J
    [J]. 2005 IEEE INTELLIGENT VEHICLES SYMPOSIUM PROCEEDINGS, 2005, : 224 - 229
  • [5] Social graph convolutional LSTM for pedestrian trajectory prediction
    Zhou, Yutao
    Wu, Huayi
    Cheng, Hongquan
    Qi, Kunlun
    Hu, Kai
    Kang, Chaogui
    Zheng, Jie
    [J]. IET INTELLIGENT TRANSPORT SYSTEMS, 2021, 15 (03) : 396 - 405
  • [6] Multiple Trajectory Prediction with Deep Temporal and Spatial Convolutional Neural Networks
    Strohbeck, Jan
    Belagiannis, Vasileios
    Mueller, Johannes
    Schreiber, Marcel
    Herrmann, Martin
    Wolf, Daniel
    Buchholz, Michael
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 1992 - 1998
  • [7] Pedestrian Trajectory Prediction Based on Tree Method using Graph Neural Networks
    Sighencea, Bogdan Ilie
    [J]. 2022 24TH INTERNATIONAL SYMPOSIUM ON SYMBOLIC AND NUMERIC ALGORITHMS FOR SCIENTIFIC COMPUTING, SYNASC, 2022, : 245 - 249
  • [8] Multimodal Model Prediction of Pedestrian Trajectories Based on Graph Convolutional Neural Networks
    Song, JiHong
    Zhao, Yang
    [J]. 2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 271 - 275
  • [9] Convolutional Neural Network for Trajectory Prediction
    Nikhil, Nishant
    Morris, Brendan Tran
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT III, 2019, 11131 : 186 - 196
  • [10] Multi-information-based convolutional neural network with attention mechanism for pedestrian trajectory prediction
    Wang, Ruiping
    Cui, Yong
    Song, Xiao
    Chen, Kai
    Fang, Hong
    [J]. IMAGE AND VISION COMPUTING, 2021, 107