Two-stream LSTM Network with Hybrid Attention for Vehicle Trajectory Prediction

被引:2
|
作者
Li, Chao [1 ]
Liu, Zhanwen [1 ]
Zhang, Jiaying [1 ]
Wang, Yang [2 ]
Ding, Fan [3 ]
Zhao, Xiangmo [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[2] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230026, Peoples R China
[3] Southeast Univ, Sch Transportat, Nanjing 210018, Peoples R China
基金
中国国家自然科学基金;
关键词
MODEL; FRAMEWORK; LANE;
D O I
10.1109/ITSC55140.2022.9922135
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Trajectory prediction aims to estimate future location by exploring driving behavior and historical trajectory, which is essential for driving decision-making and local motion planning of smart vehicles. However, affected by the multiple complex interaction in the traffic scene, predicting future trajectory precisely is a challenging task. Most existing models simply fuse the inter-vehicle interaction with the vehicle motion state and use the fusion vector for temporal modeling, which affects the extraction of information temporal dependency. Furthermore, the loss of important historical hidden state in recursive loops makes the long-term prediction performance of the sequence model not ideal. To address this issue, this paper proposes the Two-stream LSTM Network with hybrid attention mechanism (TH-Net). Specifically, we construct Two-stream LSTM structure (TS-LSTM) to build independent information transmission links for inter-vehicle interaction and vehicle motion state while maintaining their coupling relationship. In addition, Hybrid Attention Mechanism (H-AM) is proposed to explore the importance of hidden state from the dimensions of time and feature, and guides TH-Net to selectively reuse it. Experiments on the public dataset HighD demonstrate that TH-Net remarkably outperforms the state-of-the-art methods in long-term prediction performance.
引用
收藏
页码:1927 / 1934
页数:8
相关论文
共 50 条
  • [1] TWO-STREAM HYBRID ATTENTION NETWORK FOR MULTIMODAL CLASSIFICATION
    Chen, Qipin
    Shi, Zhenyu
    Zuo, Zhen
    Fu, Jinmiao
    Sun, Yi
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 359 - 363
  • [2] Hybrid-Attention Enhanced Two-Stream Fusion Network for Video Venue Prediction
    Zhang, Yanchao
    Min, Weiqing
    Nie, Liqiang
    Jiang, Shuqiang
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 2917 - 2929
  • [3] LSTM-based graph attention network for vehicle trajectory prediction
    Wang, Jiaqin
    Liu, Kai
    Li, Hantao
    [J]. COMPUTER NETWORKS, 2024, 248
  • [4] Spatiotemporal two-stream LSTM network for unsupervised video summarization
    Min Hu
    Ruimin Hu
    Zhongyuan Wang
    Zixiang Xiong
    Rui Zhong
    [J]. Multimedia Tools and Applications, 2022, 81 : 40489 - 40510
  • [5] Spatiotemporal two-stream LSTM network for unsupervised video summarization
    Hu, Min
    Hu, Ruimin
    Wang, Zhongyuan
    Xiong, Zixiang
    Zhong, Rui
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (28) : 40489 - 40510
  • [6] Bi-LSTM-Based Two-Stream Network for Machine Remaining Useful Life Prediction
    Jin, Ruibing
    Chen, Zhenghua
    Wu, Keyu
    Wu, Min
    Li, Xiaoli
    Yan, Ruqiang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [7] Hybrid attention based vehicle trajectory prediction
    Wang, Lingyang
    Jiang, Wenping
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2023, 238 (08) : 2281 - 2291
  • [8] Human action recognition using two-stream attention based LSTM networks
    Dai, Cheng
    Liu, Xingang
    Lai, Jinfeng
    [J]. APPLIED SOFT COMPUTING, 2020, 86
  • [9] Intention-convolution and hybrid-attention network for vehicle trajectory prediction
    Li, Chao
    Liu, Zhanwen
    Lin, Shan
    Wang, Yang
    Zhao, Xiangmo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 236
  • [10] Structured Two-Stream Attention Network for Video Question Answering
    Gao, Lianli
    Zeng, Pengpeng
    Song, Jingkuan
    Li, Yuan-Fang
    Liu, Wu
    Mei, Tao
    Shen, Heng Tao
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 6391 - 6398