Pedestrian Trajectory Prediction Method Based on Multi-information Fusion Network

被引:0
|
作者
Gao, Song [1 ,2 ]
Zhou, Jianglin [2 ]
Gao, Bolin [1 ,3 ]
Lu, Jian [2 ]
Wang, He [2 ]
Xu, Yueyun [2 ]
机构
[1] School of Vehicles and Mobility, Tsinghua University, Beijing,10000, China
[2] National Innovation Center of Intelligent and Connected Vehicles, Beijing,102600, China
[3] China
来源
Qiche Gongcheng/Automotive Engineering | 2024年 / 46卷 / 11期
关键词
Data fusion - Magnetic levitation vehicles - Time difference of arrival;
D O I
10.19562/j.chinasae.qcgc.2024.11.004
中图分类号
学科分类号
摘要
With the continuous development of autonomous driving technology,accurately predicting the future trajectories of pedestrians has become a critical element in ensuring system safety and reliability. However, most existing studies on pedestrian trajectory prediction rely on fixed camera perspectives,which limits the compre⁃ hensive observation of pedestrian movement and thus makes them unsuitable for direct application to pedestrian tra⁃ jectory prediction under the ego-vehicle perspective in autonomous vehicles. To solve the problem,in this paper a pedestrian trajectory prediction method under the ego-vehicle perspective based on the Multi-Pedestrian Information Fusion Network(MPIFN)is proposed,which achieves accurate prediction of pedestrians' future trajectories by inte⁃ grating social information,local environmental information,and temporal information of pedestrians. In this paper, a Local Environmental Information Extraction Module that combines deformable convolution with traditional convo⁃ lutional and pooling operations is constructed,aiming to more effectively extract local information from complex en⁃ vironment. By dynamically adjusting the position of convolutional kernels,this module enhances the model’s adapt⁃ ability to irregular and complex shapes. Meanwhile,the pedestrian spatiotemporal information extraction module and multimodal feature fusion module are developed to facilitate comprehensive integration of social and environ⁃ mental information. The experimental results show that the proposed method achieves advanced performance on two ego-vehicle driving datasets,JAAD and PSI. Specifically,on the JAAD dataset,the Center Final Mean Squared Er⁃ ror(CF_MSE)is 4 063,and the Center Mean Squared Error(C_MSE)is 829. On the PSI dataset,the Average Root Mean Square Error(ARB)and Final Root Mean Square Error(FRB)also achieve outstanding performance with values of 18.08/29.21/44.98 and 25.27/54.62/93.09 for prediction horizons of 0.5 s,1.0 s,and 1.5 s,respec⁃ tively. © 2024 SAE-China. All rights reserved.
引用
收藏
页码:1973 / 1982
相关论文
共 50 条
  • [31] Multi-Camera Trajectory Forecasting: Pedestrian Trajectory Prediction in a Network of Cameras
    Styles, Olly
    Guha, Tanaya
    Sanchez, Victor
    Kot, Alex
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 4379 - 4382
  • [32] A Multi-information Fusion Positioning Method Based on GPS/BDS/visual/WLAN/barometric
    Lai Qifeng
    Wei Dongyan
    Zhang Xiaoguang
    PROCEEDINGS OF THE 28TH INTERNATIONAL TECHNICAL MEETING OF THE SATELLITE DIVISION OF THE INSTITUTE OF NAVIGATION (ION GNSS+ 2015), 2015, : 2527 - 2536
  • [33] Monocular weakly supervised depth and pose estimation method based on multi-information fusion
    Zhang, Zhimin
    Qiao, Jianzhong
    Lin, Shukuan
    KUWAIT JOURNAL OF SCIENCE, 2022, 49 (03)
  • [34] Surface Wave Inversion Using a Multi-Information Fusion Neural Network
    Chen, Xinhua
    Xia, Jianghai
    Feng, Jie
    Pang, Jingyin
    Zhang, Hao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [35] An Efficient RGB-D Scene Recognition Method Based on Multi-Information Fusion
    Gong, Wenjuan
    Zhang, Bin
    Li, Xin
    IEEE ACCESS, 2020, 8 : 212351 - 212360
  • [36] A Real-Time Gait Phase Recognition Method Based on Multi-Information Fusion
    Zhang, Yue-Peng
    Cao, Guang-Zhong
    Ling, Zi-Qin
    He, Bin-Bin
    Cheng, Hao-Ran
    Li, Wen-Zhou
    Cao, Sheng-Bin
    2021 18TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR), 2021, : 249 - 255
  • [37] Prediction of water inrush division by the fitting of multi-information method
    Weixin, Yi
    Enying, Wang
    JOURNAL OF CHINA UNIVERSITY OF GEOSCIENCES, 2007, 18 : 136 - 138
  • [38] Multi Attention Generative Adversarial Network for Pedestrian Trajectory Prediction Based on Spatial Gridding
    An, Huihui
    Liu, Miao
    Wang, Xiaolan
    Zhang, Weiwei
    Gong, Jun
    AUTOMOTIVE INNOVATION, 2024, 7 (03) : 443 - 455
  • [39] Classification and localization of gastric cancer using Multi-Information Fusion Network
    Enigo, Varghese Sicily Felix
    Shanmuganathan, Rajashree
    Venkatapathy, Sneha
    Rahaman, Sahir
    ROMANIAN JOURNAL OF INFORMATION TECHNOLOGY AND AUTOMATIC CONTROL-REVISTA ROMANA DE INFORMATICA SI AUTOMATICA, 2023, 33 (04): : 109 - 120
  • [40] MIFNet: Multi-Information Fusion Network for Sea-Land Segmentation
    Pan, Zhihong
    Dou, Hao
    Mao, Jiaxing
    Dai, Min
    Tian, Jinwen
    ICAIP 2018: 2018 THE 2ND INTERNATIONAL CONFERENCE ON ADVANCES IN IMAGE PROCESSING, 2018, : 24 - 29