Social Self-Attention Generative Adversarial Networks for Human Trajectory Prediction

被引:2
|
作者
Yang C. [1 ]
Pan H. [1 ]
Sun W. [1 ]
Gao H. [1 ]
机构
[1] Harbin Institute of Technology, Research Institute of Intelligent Control and Systems, Harbin
来源
关键词
Generative adversarial networks (GANs); self-attention; social interactions; trajectory prediction;
D O I
10.1109/TAI.2023.3299899
中图分类号
学科分类号
摘要
Predicting accurate human future trajectories is of critical importance for self-driving vehicles if they are to navigate complex scenarios. Trajectories of humans are not only dependent on the humans themselves, but also the interactions with surrounding agents. Previous works mainly model interactions among agents by using a diversity of polymerization methods that integrate various learned agent states hit or miss. In this article, we propose social self-attention generative adversarial networks (Social SAGAN), which generate socially acceptable multimodal trajectory predictions. Social SAGAN incorporates a generator that predicts future trajectories of pedestrians, a discriminator that classifies trajectory predictions as real or fake, and a social self-attention mechanism that selectively refines the most interactive information and helps the overall model to capture what to pay attention to. Through extensive experiments, we demonstrate that our model achieves competitive prediction accuracy and computational complexity compared with previous state-of-the-art methods on all trajectory forecasting benchmarks. © 2020 IEEE.
引用
收藏
页码:1805 / 1815
页数:10
相关论文
共 50 条
  • [41] Maneuver Conditioned Vehicle Trajectory Prediction Using Self-Attention
    Huang, Junan
    Huang, Zhiqiu
    Shen, Guohua
    Wang, Jinyong
    Yin, Xiaohua
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2023, 22 (02)
  • [42] A froth image segmentation method via generative adversarial networks with multi-scale self-attention mechanism
    Yuze Zhong
    Zhaohui Tang
    Hu Zhang
    Yongfang Xie
    Xiaoliang Gao
    Multimedia Tools and Applications, 2024, 83 : 19663 - 19682
  • [43] Missing Data Repairs for Traffic Flow With Self-Attention Generative Adversarial Imputation Net
    Zhang, Weibin
    Zhang, Pulin
    Yu, Yinghao
    Li, Xiying
    Biancardo, Salvatore Antonio
    Zhang, Junyi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 7919 - 7930
  • [44] Multi-scale self-attention generative adversarial network for pathology image restoration
    Liang, Meiyan
    Zhang, Qiannan
    Wang, Guogang
    Xu, Na
    Wang, Lin
    Liu, Haishun
    Zhang, Cunlin
    VISUAL COMPUTER, 2023, 39 (09): : 4305 - 4321
  • [45] Attribute Network Representation Learning Based on Generative Adversarial Network and Self-attention Mechanism
    Li, Shanshan
    Tang, Meiling
    Dong, Yingnan
    International Journal of Network Security, 2024, 26 (01) : 51 - 58
  • [46] Application of Self-Attention Generative Adversarial Network for Electromagnetic Imaging in Half-Space
    Chiu, Chien-Ching
    Lee, Yang-Han
    Chen, Po-Hsiang
    Shih, Ying-Chen
    Hao, Jiang
    SENSORS, 2024, 24 (07)
  • [47] Improved self-attention generative adversarial adaptation network-based melanoma classification
    Gowthami, S.
    Harikumar, R.
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (03) : 4113 - 4122
  • [48] BaMSGAN: Self-Attention Generative Adversarial Network with Blur and Memory for Anime Face Generation
    Li, Xu
    Li, Bowei
    Fang, Minghao
    Huang, Rui
    Huang, Xiaoran
    MATHEMATICS, 2023, 11 (20)
  • [49] Multi-scale self-attention generative adversarial network for pathology image restoration
    Meiyan Liang
    Qiannan Zhang
    Guogang Wang
    Na Xu
    Lin Wang
    Haishun Liu
    Cunlin Zhang
    The Visual Computer, 2023, 39 : 4305 - 4321
  • [50] Vehicle Trajectory Prediction based on Social Generative Adversarial Network for Self-Driving Car Applications
    Kang, Li-Wei
    Hsu, Chih-Chung
    Wang, I-Shan
    Liu, Ting-Lei
    Chen, Shih-Yu
    Chang, Chuan-Yu
    2020 INTERNATIONAL SYMPOSIUM ON COMPUTER, CONSUMER AND CONTROL (IS3C 2020), 2021, : 489 - 492