InverseTime: A Self-Supervised Technique for Semi-Supervised Classification of Time Series

被引:0
|
作者
Goyo, Manuel Alejandro [1 ]
Nanculef, Ricardo [1 ]
Valle, Carlos [2 ]
机构
[1] Univ Tecn Federico Santa Maria, Dept Informat, Valparaiso 2390123, Chile
[2] Univ Playa Ancha, Dept Data Sci & Informat, Valparaiso 2360072, Chile
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Time series classification (TSC); semi-supervised classification; self-supervised classification model; self-supervised and semi-supervised learning; deep learning for time series;
D O I
10.1109/ACCESS.2024.3486669
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time series classification (TSC) is a fundamental and challenging problem in machine learning. Deep learning models typically achieve remarkable performance in this task but are constrained by the need for vast amounts of labeled data to generalize effectively. In this paper, we present InverseTime, a method that addresses this limitation by incorporating a novel self-supervised pretext task into the training objective. In this task, the training time series are first considered both in their original chronological order and in their reversed state. Then, the model is trained to recognize if time inversion was or was not applied to the input case. We found that this simple task actually provides a supervisory signal that significantly aids model training when explicit category labels are scarce, enabling semi-supervised TSC. Through comprehensive experiments on twelve diverse time-series datasets, spanning different domains, we demonstrate that our method consistently outperforms prior approaches, including various consistency regularization methods. These results show that self-supervision is a promising approach to circumvent the annotation bottleneck in time series applications.
引用
收藏
页码:165081 / 165093
页数:13
相关论文
共 50 条
  • [1] Self-supervised Learning for Semi-supervised Time Series Classification
    Jawed, Shayan
    Grabocka, Josif
    Schmidt-Thieme, Lars
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 : 499 - 511
  • [2] Semi-supervised Time Series Classification Model with Self-supervised Learning
    Xi, Liang
    Yun, Zichao
    Liu, Han
    Wang, Ruidong
    Huang, Xunhua
    Fan, Haoyi
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 116
  • [3] Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification
    Eldele, Emadeldeen
    Ragab, Mohamed
    Chen, Zhenghua
    Wu, Min
    Kwoh, Chee-Keong
    Li, Xiaoli
    Guan, Cuntai
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15604 - 15618
  • [4] Self-Supervised Wasserstein Pseudo-Labeling for Semi-Supervised Image Classification
    Taherkhani, Fariborz
    Dabouei, Ali
    Soleymani, Sobhan
    Dawson, Jeremy
    Nasrabadi, Nasser M.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12262 - 12272
  • [5] Self-Supervised Assisted Semi-Supervised Residual Network for Hyperspectral Image Classification
    Song, Liangliang
    Feng, Zhixi
    Yang, Shuyuan
    Zhang, Xinyu
    Jiao, Licheng
    REMOTE SENSING, 2022, 14 (13)
  • [7] Self-supervised Bernoulli Autoencoders for Semi-supervised Hashing
    Nanculef, Ricardo
    Mena, Francisco
    Macaluso, Antonio
    Lodi, Stefano
    Sartori, Claudio
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2021, 2021, 12702 : 258 - 268
  • [8] Semi-Supervised and Self-Supervised Classification with Multi-View Graph Neural Networks
    Yuan, Jinliang
    Yu, Hualei
    Cao, Meng
    Xu, Ming
    Xie, Junyuan
    Wang, Chongjun
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2466 - 2476
  • [9] Self-supervised Mean Teacher for Semi-supervised Chest X-Ray Classification
    Liu, Fengbei
    Tian, Yu
    Cordeiro, Filipe R.
    Belagiannis, Vasileios
    Reid, Ian
    Carneiro, Gustavo
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 426 - 436
  • [10] Deep Semi-supervised Learning for Time Series Classification
    Goschenhofer, Jann
    Hvingelby, Rasmus
    Ruegamer, David
    Thomas, Janek
    Wagner, Moritz
    Bischl, Bernd
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 422 - 428