Pedestrian Trajectory Prediction Method Based on Multi-information Fusion Network

被引:0
|
作者
Gao, Song [1 ,2 ]
Zhou, Jianglin [2 ]
Gao, Bolin [1 ,3 ]
Lu, Jian [2 ]
Wang, He [2 ]
Xu, Yueyun [2 ]
机构
[1] School of Vehicles and Mobility, Tsinghua University, Beijing,10000, China
[2] National Innovation Center of Intelligent and Connected Vehicles, Beijing,102600, China
[3] China
来源
Qiche Gongcheng/Automotive Engineering | 2024年 / 46卷 / 11期
关键词
Data fusion - Magnetic levitation vehicles - Time difference of arrival;
D O I
10.19562/j.chinasae.qcgc.2024.11.004
中图分类号
学科分类号
摘要
With the continuous development of autonomous driving technology,accurately predicting the future trajectories of pedestrians has become a critical element in ensuring system safety and reliability. However, most existing studies on pedestrian trajectory prediction rely on fixed camera perspectives,which limits the compre⁃ hensive observation of pedestrian movement and thus makes them unsuitable for direct application to pedestrian tra⁃ jectory prediction under the ego-vehicle perspective in autonomous vehicles. To solve the problem,in this paper a pedestrian trajectory prediction method under the ego-vehicle perspective based on the Multi-Pedestrian Information Fusion Network(MPIFN)is proposed,which achieves accurate prediction of pedestrians' future trajectories by inte⁃ grating social information,local environmental information,and temporal information of pedestrians. In this paper, a Local Environmental Information Extraction Module that combines deformable convolution with traditional convo⁃ lutional and pooling operations is constructed,aiming to more effectively extract local information from complex en⁃ vironment. By dynamically adjusting the position of convolutional kernels,this module enhances the model’s adapt⁃ ability to irregular and complex shapes. Meanwhile,the pedestrian spatiotemporal information extraction module and multimodal feature fusion module are developed to facilitate comprehensive integration of social and environ⁃ mental information. The experimental results show that the proposed method achieves advanced performance on two ego-vehicle driving datasets,JAAD and PSI. Specifically,on the JAAD dataset,the Center Final Mean Squared Er⁃ ror(CF_MSE)is 4 063,and the Center Mean Squared Error(C_MSE)is 829. On the PSI dataset,the Average Root Mean Square Error(ARB)and Final Root Mean Square Error(FRB)also achieve outstanding performance with values of 18.08/29.21/44.98 and 25.27/54.62/93.09 for prediction horizons of 0.5 s,1.0 s,and 1.5 s,respec⁃ tively. © 2024 SAE-China. All rights reserved.
引用
收藏
页码:1973 / 1982
相关论文
共 50 条
  • [41] The Temperature Field Measurement of Billet Based on Multi-Information Fusion
    Ma Jiaocheng
    Liu Jun
    Yang Qiang
    Chen Liangyu
    MATERIALS TRANSACTIONS, 2014, 55 (08) : 1319 - 1323
  • [42] Multi-information fusion based on dual attention and text embedding network for local citation recommendation
    Shanshan Wang
    Xiaohong Li
    Jin Yao
    Ben You
    Advances in Computational Intelligence, 2023, 3 (4):
  • [43] MiFDeU: Multi-information fusion network based on dual-encoder for pelvic bones segmentation
    Ju, Fujiao
    Wu, Yichu
    Dong, Mingjie
    Zhao, Jingxin
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 147
  • [44] Aided Navigation System Research Based on Multi-information Fusion
    Zhang, Xiao-Hui
    Liu, Qing
    Li, Mu
    ADVANCED MECHANICAL DESIGN, PTS 1-3, 2012, 479-481 : 207 - 212
  • [45] Identification of tools with failure barcode based on multi-information fusion
    Wang, Jia-Jing
    Zhang, Zhu-Sheng
    He, Wei-Ping
    Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2014, 48 (12): : 1675 - 1680
  • [46] Multi-information fusion based localization algorithm for Mars rover
    Jiang, Xiudiang
    Li, Shuang
    Tao, Ting
    Wang, Bingheng
    ADVANCES IN AIRCRAFT AND SPACECRAFT SCIENCE, 2014, 1 (04): : 455 - 469
  • [47] Research on automatic parking system based on multi-information fusion
    Zhang, Chuan-Wei
    Zeng, Hong-Jun
    Yang, Meng-Yue
    Wen, Jian-Ping
    Yang, Man-Zhi
    Journal of Computers (Taiwan), 2020, 31 (05): : 14 - 29
  • [48] Pedestrian trajectory prediction method based on automatic driving
    Huang M.
    Wang J.
    Journal of Intelligent and Fuzzy Systems, 2024, 46 (04): : 9291 - 9310
  • [49] Pedestrian Crossing Intention Prediction Method Based on Multi-Feature Fusion
    Ma, Jun
    Rong, Wenhui
    WORLD ELECTRIC VEHICLE JOURNAL, 2022, 13 (08):
  • [50] WTTFNet: A Weather-Time-Trajectory Fusion Network for Pedestrian Trajectory Prediction in Urban Complex
    Chun Wu, Ho
    Hoi Shan Lau, Esther
    Chun Ho Yuen, Paul
    Hung, Kevin
    Kwok Tai Chui, John
    Kwok Fai Lui, Andrew
    IEEE ACCESS, 2024, 12 : 126611 - 126623