Prediction of Time Series Data Based on Transformer with Soft Dynamic Time Wrapping

被引:2
|
作者
Ho, Kuo-Hao [1 ]
Huang, Pei-Shu [1 ]
Wu, I-Chen [1 ,2 ]
Wang, Feng-Jian [1 ]
机构
[1] Natl Chiao Tung Univ, Dept Comp Sci, Hsinchu, Taiwan
[2] Pervas Artificial Intelligence Res PAIR Labs, Hsinchu, Taiwan
关键词
D O I
10.1109/icce-taiwan49838.2020.9258155
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It is a challenge to predict the long-term future data from time series data. This paper proposes to use a Transformer with soft dynamic time wrapping for early stopping criteria, called a soft-DTW Transformer. Our experiment in an open-source dataset HouseTwenty shows that the average prediction error rate with soft-DTW Transformer is 27.79%, greatly reduced from 45.70% for using SVR, a common time series method.
引用
收藏
页数:2
相关论文
共 50 条
  • [1] A Transformer-Based Model for Time Series Prediction of Remote Sensing Data
    Niu, Xintian
    Liu, Yige Ng
    Ma, Ming
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 : 188 - 200
  • [2] A Transformer-Based Industrial Time Series Prediction Model With Multivariate Dynamic Embedding
    Wang, Chenze
    Wang, Han
    Zhang, Xiaohan
    Liu, Qing
    Liu, Min
    Xu, Gaowei
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025, 21 (02) : 1813 - 1822
  • [3] InTrans: Fast Incremental Transformer for Time Series Data Prediction
    Bou, Savong
    Amagasa, Toshiyuki
    Kitagawa, Hiroyuki
    DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2022, PT II, 2022, 13427 : 47 - 61
  • [4] Time Series Forest Fire Prediction Based on Improved Transformer
    Miao, Xinyu
    Li, Jian
    Mu, Yunjie
    He, Cheng
    Ma, Yunfei
    Chen, Jie
    Wei, Wentao
    Gao, Demin
    FORESTS, 2023, 14 (08):
  • [5] Enhancing peak prediction in residential load forecasting with soft dynamic time wrapping loss functions
    Chen, Yuyao
    Obrecht, Christian
    Kuznik, Frederic
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2024, 31 (03) : 327 - 340
  • [6] Dynamic Time Wrapping based Gesture Recognition
    Masood, Saad
    Qureshi, Majid Parvez
    Shah, M. Bilal
    Ashraf, Salman
    Halim, Zahid
    Abbas, Ghulam
    2014 INTERNATIONAL CONFERENCE ON ROBOTICS AND EMERGING ALLIED TECHNOLOGIES IN ENGINEERING (ICREATE), 2014, : 205 - 210
  • [7] Transformer Fault Prediction Based on Time Series and Support Vector Machine
    Huang X.
    Jiang W.
    Zhu Y.
    Tian Y.
    Gaodianya Jishu/High Voltage Engineering, 2020, 46 (07): : 2530 - 2538
  • [8] CGTS: A Transformer framework for time series prediction based on feature extraction
    Ma, Yunpeng
    Yu, Qing
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 91 - 96
  • [9] Agent based prediction of seismic time series data
    Azam, Faisal
    Mohsin, Sajjad
    10TH INTERNATIONAL CONFERENCE ON FRONTIERS OF INFORMATION TECHNOLOGY (FIT 2012), 2012, : 269 - 274
  • [10] Time series prediction based on data compression methods
    A. S. Lysyak
    B. Ya. Ryabko
    Problems of Information Transmission, 2016, 52 : 92 - 99