Revolutionizing Time Series Data Preprocessing with a Novel Cycling Layer in Self-Attention Mechanisms †

被引:0
|
作者
Chen, Jiyan [1 ]
Yang, Zijiang [1 ]
机构
[1] School of Information Technology, York University, North York,ON,M3J 1P3, Canada
来源
Applied Sciences (Switzerland) | 2024年 / 14卷 / 19期
关键词
Compendex;
D O I
10.3390/app14198922
中图分类号
学科分类号
摘要
Adversarial machine learning - Contrastive Learning - Self-supervised learning - Unsupervised learning
引用
收藏
相关论文
共 50 条
  • [1] Time Series Anomaly Detection in Vehicle Sensors Using Self-Attention Mechanisms
    Zhang, Ze
    Yao, Yue
    Hutabarat, Windo
    Farnsworth, Michael
    Tiwari, Divya
    Tiwari, Ashutosh
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 15964 - 15976
  • [2] A TIME-RESTRICTED SELF-ATTENTION LAYER FOR ASR
    Povey, Daniel
    Hadian, Hossein
    Ghahremani, Pegah
    Li, Ke
    Khudanpur, Sanjeev
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 5874 - 5878
  • [3] Time series classification of remote sensing data based on temporal self-attention mechanism
    Zhang W.
    Tang P.
    Zhang Z.
    [J]. National Remote Sensing Bulletin, 2023, 27 (08) : 1914 - 1924
  • [4] Bridging Self-Attention and Time Series Decomposition for Periodic Forecasting
    Jiang, Song
    Syed, Tahin
    Zhu, Xuan
    Levy, Joshua
    Aronchik, Boris
    Sun, Yizhou
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 3202 - 3211
  • [5] Self-attention for raw optical Satellite Time Series Classification
    Russwurm, Marc
    Koerner, Marco
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 169 : 421 - 435
  • [6] Multimodal Fusion of Optimized GRU-LSTM with Self-Attention Layer for Hydrological Time Series Forecasting
    Kilinc, Huseyin Cagan
    Apak, Sina
    Ozkan, Furkan
    Ergin, Mahmut Esad
    Yurtsever, Adem
    [J]. WATER RESOURCES MANAGEMENT, 2024, : 6045 - 6062
  • [7] DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting
    Huang, Siteng
    Wang, Donglin
    Wu, Xuehan
    Tang, Ao
    [J]. PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 2129 - 2132
  • [8] An improved self-attention for long-sequence time-series data forecasting with missing values
    Zhang, Zhi-cheng
    Wang, Yong
    Peng, Jian-jian
    Duan, Jun-ting
    [J]. NEURAL COMPUTING & APPLICATIONS, 2024, 36 (08): : 3921 - 3940
  • [9] An improved self-attention for long-sequence time-series data forecasting with missing values
    Zhi-cheng Zhang
    Yong Wang
    Jian-jian Peng
    Jun-ting Duan
    [J]. Neural Computing and Applications, 2024, 36 (8) : 3921 - 3940
  • [10] ALAE: self-attention reconstruction network for multivariate time series anomaly identification
    Jiang, Kai
    Liu, Hui
    Ruan, Huaijun
    Zhao, Jia
    Lin, Yuxiu
    [J]. SOFT COMPUTING, 2023, 27 (15) : 10509 - 10519