Co-attention trajectory prediction by mining heterogeneous interactive relationships

被引:0
|
作者
Zhang, Lei [1 ,2 ]
Liu, Jie [1 ,2 ]
Liu, Bailong [1 ,2 ]
Zhu, Shaojie [1 ,2 ]
An, Jiyong [1 ,2 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci, Xuzhou 221116, Jiangsu, Peoples R China
[2] China Univ Min & Technol, Engn Res Ctr Mine Digitalizat, Minist Educ, Xuzhou 221116, Jiangsu, Peoples R China
关键词
Heterogeneous information network; Semantic trajectory; Multi-modal; Meta-path; MODEL; NETWORKS; SYSTEM; ROUTE;
D O I
10.1007/s11042-022-13942-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the multi-modal spatio-temporal semantic trajectory prediction, if we can make full use of its multi-modal characteristics and heterogeneous interaction, the prediction accuracy can be significantly improved. However, the existing methods have some thorny problems. Firstly, the process of constructing an effective and semantically rich heterogeneous information interaction scene is very complex. Secondly, it is difficult to obtain interaction path instances with high quality, high relevance and high reliability. Finally, how to introduce path instances into trajectory prediction is also a difficulty. This paper proposes a common attention prediction method based on heterogeneous information network (HBCAPM). Firstly, the heterogeneous information network is constructed to make effective use of the multi-modal features in the trajectory and the heterogeneous interaction between features. Secondly, HBCAPM mines multi-source heterogeneous nodes and interaction patterns in heterogeneous information networks. Then, a path generation algorithm based on matrix decomposition and rankwalk is designed to obtain high-quality path instances. Finally, a collaborative semantic enhancement mechanism based on attention mechanism is designed to obtain the collaborative semantics of users, destinations and meta-paths. In addition, a large number of experiments on two real data sets show that HBCAPM significantly improves the effectiveness of various evaluation criteria. Compared with the latest method we discussed, the prediction accuracy is improved by 1.28% and the average distance error is reduced by 65.5 m.
引用
收藏
页码:15345 / 15370
页数:26
相关论文
共 50 条
  • [31] Fast Convergence of DETR with Spatially Modulated Co-Attention
    Gao, Peng
    Zheng, Minghang
    Wang, Xiaogang
    Dai, Jifeng
    Li, Hongsheng
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3601 - 3610
  • [32] An efficient co-Attention Neural Network for Social Recommendation
    Li, Munan
    Tei, Kenji
    Fukazawa, Yoshiaki
    2019 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE (WI 2019), 2019, : 34 - 42
  • [33] Co-attention and Contrastive Learning Driven Knowledge Tracing
    Zheng, Ning
    Shan, Zhilong
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT V, ECML PKDD 2024, 2024, 14945 : 177 - 194
  • [34] Co-Saliency Detection With Co-Attention Fully Convolutional Network
    Gao, Guangshuai
    Zhao, Wenting
    Liu, Qingjie
    Wang, Yunhong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (03) : 877 - 889
  • [35] Adaptive Graph Co-Attention Networks for Traffic Forecasting
    Li, Boyu
    Guo, Ting
    Wang, Yang
    Gandomi, Amir H.
    Chen, Fang
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT I, 2021, 12712 : 263 - 276
  • [36] A Static and Dynamic Co-attention Network for Social Recommendation
    Bian, Fan
    Yan, Lingyu
    Gao, Rong
    Zheng, Kunpeng
    Zhang, Yucheng
    Yang, Jie
    PROCEEDINGS OF THE THE 11TH IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS (IDAACS'2021), VOL 1, 2021, : 196 - 201
  • [37] Survival Prediction via Hierarchical Multimodal Co-Attention Transformer: A Computational Histology-Radiology Solution
    Li, Zhe
    Jiang, Yuming
    Lu, Mengkang
    Li, Ruijiang
    Xia, Yong
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (09) : 2678 - 2689
  • [38] Joint Gated Co-Attention Based Multi-Modal Networks for Subregion House Price Prediction
    Wang, Pengkun
    Ge, Chuancai
    Zhou, Zhengyang
    Wang, Xu
    Li, Yuantao
    Wang, Yang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 1667 - 1680
  • [39] Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Prediction
    Xu, Yingxue
    Chen, Hao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21184 - 21194
  • [40] Dual self-attention with co-attention networks for visual question answering
    Liu, Yun
    Zhang, Xiaoming
    Zhang, Qianyun
    Li, Chaozhuo
    Huang, Feiran
    Tang, Xianghong
    Li, Zhoujun
    PATTERN RECOGNITION, 2021, 117 (117)