Co-attention trajectory prediction by mining heterogeneous interactive relationships

被引:0
|
作者
Zhang, Lei [1 ,2 ]
Liu, Jie [1 ,2 ]
Liu, Bailong [1 ,2 ]
Zhu, Shaojie [1 ,2 ]
An, Jiyong [1 ,2 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci, Xuzhou 221116, Jiangsu, Peoples R China
[2] China Univ Min & Technol, Engn Res Ctr Mine Digitalizat, Minist Educ, Xuzhou 221116, Jiangsu, Peoples R China
关键词
Heterogeneous information network; Semantic trajectory; Multi-modal; Meta-path; MODEL; NETWORKS; SYSTEM; ROUTE;
D O I
10.1007/s11042-022-13942-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the multi-modal spatio-temporal semantic trajectory prediction, if we can make full use of its multi-modal characteristics and heterogeneous interaction, the prediction accuracy can be significantly improved. However, the existing methods have some thorny problems. Firstly, the process of constructing an effective and semantically rich heterogeneous information interaction scene is very complex. Secondly, it is difficult to obtain interaction path instances with high quality, high relevance and high reliability. Finally, how to introduce path instances into trajectory prediction is also a difficulty. This paper proposes a common attention prediction method based on heterogeneous information network (HBCAPM). Firstly, the heterogeneous information network is constructed to make effective use of the multi-modal features in the trajectory and the heterogeneous interaction between features. Secondly, HBCAPM mines multi-source heterogeneous nodes and interaction patterns in heterogeneous information networks. Then, a path generation algorithm based on matrix decomposition and rankwalk is designed to obtain high-quality path instances. Finally, a collaborative semantic enhancement mechanism based on attention mechanism is designed to obtain the collaborative semantics of users, destinations and meta-paths. In addition, a large number of experiments on two real data sets show that HBCAPM significantly improves the effectiveness of various evaluation criteria. Compared with the latest method we discussed, the prediction accuracy is improved by 1.28% and the average distance error is reduced by 65.5 m.
引用
收藏
页码:15345 / 15370
页数:26
相关论文
共 50 条
  • [1] Co-attention trajectory prediction by mining heterogeneous interactive relationships
    Lei Zhang
    Jie Liu
    Bailong Liu
    Shaojie Zhu
    Jiyong An
    Multimedia Tools and Applications, 2023, 82 : 15345 - 15370
  • [2] CAMP: Co-Attention Memory Networks for Diagnosis Prediction in Healthcare
    Gao, Jingyue
    Wang, Xiting
    Wang, Yasha
    Yang, Zhao
    Gao, Junyi
    Wang, Jiangtao
    Tang, Wen
    Xie, Xing
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1036 - 1041
  • [3] IMPROVING FACIAL ATTRACTIVENESS PREDICTION VIA CO-ATTENTION LEARNING
    Shi, Shengjie
    Gao, Fei
    Meng, Xuantong
    Xu, Xingxin
    Zhu, Jingjie
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 4045 - 4049
  • [4] Co-saliency detection with two-stage co-attention mining and individual calibration
    Tan, Zhenshan
    Gu, Xiaodong
    Cheng, Qingrong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [5] Multimodal Fusion with Co-attention Mechanism
    Li, Pei
    Li, Xinde
    PROCEEDINGS OF 2020 23RD INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2020), 2020, : 607 - 614
  • [6] Co-Attention for Conditioned Image Matching
    Wiles, Olivia
    Ehrhardt, Sebastien
    Zisserman, Andrew
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15915 - 15924
  • [7] Drug target interaction prediction via multi-task co-attention
    Weng, Yuyou
    Liu, Xinyi
    Li, Hui
    Lin, Chen
    Liang, Yun
    INTERNATIONAL JOURNAL OF DATA MINING AND BIOINFORMATICS, 2020, 24 (02) : 160 - 176
  • [8] HHATP: A Lightweight Heterogeneous Hierarchical Attention Model for Trajectory Prediction
    Lai, Zeyu
    Zhu, Xingliang
    Yang, Chunmeng
    Kong, Bin
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT X, 2025, 15040 : 118 - 131
  • [9] Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images
    Chen, Richard J.
    Lu, Ming Y.
    Weng, Wei-Hung
    Chen, Tiffany Y.
    Williamson, Drew F. K.
    Manz, Trevor
    Shady, Maha
    Mahmood, Faisal
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3995 - 4005
  • [10] Interactive Vehicle Trajectory Prediction for Highways Based on a Graph Attention Mechanism
    Song, Zhenyu
    Qian, Yubin
    WORLD ELECTRIC VEHICLE JOURNAL, 2024, 15 (03):