AST-MTL: An Attention-Based Multi-Task Learning Strategy for Traffic Forecasting

被引:8
|
作者
Buroni, Giovanni [1 ]
Lebichot, Bertrand [2 ]
Bontempi, Gianluca [1 ]
机构
[1] Machine Learning Grp, ULB 1050, Brussels, Belgium
[2] Univ Luxembourg, Interdisciplinary Ctr Secur Reliabil & Trust SNT, L-1359 Luxembourg, Luxembourg
关键词
Forecasting; Predictive models; Roads; Task analysis; Neural networks; Transportation; Nonhomogeneous media; Deep learning; multi-task learning; graph mining; traffic prediction; NETWORK; PREDICTION;
D O I
10.1109/ACCESS.2021.3083412
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Road traffic forecasting is crucial in Intelligent Transportation Systems (ITS). To achieve accurate results, it is necessary to model the dynamic nature and the complex non-linear dependencies governing traffic. The goal is particularly challenging when the prediction involves more than just one traffic variable. This paper proposes a novel multi-task learning model, called AST-MTL, to perform multi-horizon predictions of the traffic flow and speed at the road network scale. The strategy combines a multilayer fully-connected neural network (FNN) and a multi-head attention mechanism to learn related tasks while improving generalization performance. The model also includes the graph convolutional network (GCNs) and the gated recurrent unit network (GRUs) to extract the spatial and temporal features of traffic conditions. Our experiments employ new sets of GPS data, called OBU data, to perform traffic prediction in the freeway and urban contexts. The experimental results prove our model can effectively perform multi-horizon traffic forecasting for different types of roads and outperform state-of-the-art models.
引用
收藏
页码:77359 / 77370
页数:12
相关论文
共 50 条
  • [1] Attention-Based Multi-Task Learning in Pharmacovigilance
    Zhang, Shinan
    Dev, Shantanu
    Voyles, Joseph
    Rao, Anand S.
    [J]. PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 2324 - 2328
  • [2] Attention-based Multi-task Learning for Sensor Analytics
    Chen, Yujing
    Rangwala, Huzefa
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2187 - 2196
  • [3] MTL-LSTM: Multi-Task Learning-based LSTM for Urban Traffic Flow Forecasting
    Karimzadeh, Mostafa
    Schwegler, Samuel Martin
    Zhao, Zhongliang
    Braun, Torsten
    Sargento, Susana
    [J]. IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 564 - 569
  • [4] Multi-Task Reinforcement Learning With Attention-Based Mixture of Experts
    Cheng, Guangran
    Dong, Lu
    Cai, Wenzhe
    Sun, Changyin
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3811 - 3818
  • [5] Attention-based LSTM with Multi-task Learning for Distant Speech Recognition
    Zhang, Yu
    Zhang, Pengyuan
    Yan, Yonghong
    [J]. 18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 3857 - 3861
  • [6] ATTENTION-BASED MULTI-TASK LEARNING FOR FINE-GRAINED IMAGE CLASSIFICATION
    Liu, Dichao
    Wang, Yu
    Mase, Kenji
    Kato, Jien
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1499 - 1503
  • [7] ADST: Forecasting Metro Flow Using Attention-Based Deep Spatial-Temporal Networks with Multi-Task Learning
    Jia, Hongwei
    Luo, Haiyong
    Wang, Hao
    Zhao, Fang
    Ke, Qixue
    Wu, Mingyao
    Zhao, Yunyun
    [J]. SENSORS, 2020, 20 (16) : 1 - 23
  • [8] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Ren, Lu
    Xu, Bo
    Lin, Hongfei
    Yang, Liang
    [J]. SOFT COMPUTING, 2021, 25 (22) : 14109 - 14118
  • [9] Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation
    Chen, Shuai
    Bortsova, Gerda
    Juarez, Antonio Garcia-Uceda
    van Tulder, Gijs
    de Bruijne, Marleen
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 : 457 - 465
  • [10] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Lu Ren
    Bo Xu
    Hongfei Lin
    Liang Yang
    [J]. Soft Computing, 2021, 25 : 14109 - 14118