Three-Stage Sampling Algorithm for Highly Imbalanced Multi-Classification Time Series Datasets

被引:1
|
作者
Wang, Haoming [1 ]
机构
[1] Guangdong Univ Educ, Sch Math, Dept Stat & Financial Math, 351,Xingang Middle Rd, Guangzhou 510303, Peoples R China
来源
SYMMETRY-BASEL | 2023年 / 15卷 / 10期
关键词
imbalanced data; data preprocessing; sampling; Tomek links; DTW; SMOTE;
D O I
10.3390/sym15101849
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
To alleviate the data imbalance problem caused by subjective and objective factors, scholars have developed different data-preprocessing algorithms, among which undersampling algorithms are widely used because of their fast and efficient performance. However, when the number of samples of some categories in a multi-classification dataset is too small to be processed via sampling or the number of minority class samples is only one or two, the traditional undersampling algorithms will be less effective. In this study, we select nine multi-classification time series datasets with extremely few samples as research objects, fully consider the characteristics of time series data, and use a three-stage algorithm to alleviate the data imbalance problem. In stage one, random oversampling with disturbance items is used to increase the number of sample points; in stage two, on the basis of the latter operation, SMOTE (synthetic minority oversampling technique) oversampling is employed; in stage three, the dynamic time-warping distance is used to calculate the distance between sample points, identify the sample points of Tomek links at the boundary, and clean up the boundary noise. This study proposes a new sampling algorithm. In the nine multi-classification time series datasets with extremely few samples, the new sampling algorithm is compared with four classic undersampling algorithms, namely, ENN (edited nearest neighbours), NCR (neighborhood cleaning rule), OSS (one-side selection), and RENN (repeated edited nearest neighbors), based on the macro accuracy, recall rate, and F1-score evaluation indicators. The results are as follows: of the nine datasets selected, for the dataset with the most categories and the fewest minority class samples, FiftyWords, the accuracy of the new sampling algorithm was 0.7156, far beyond that of ENN, RENN, OSS, and NCR; its recall rate was also better than that of the four undersampling algorithms used for comparison, corresponding to 0.7261; and its F1-score was 200.71%, 188.74%, 155.29%, and 85.61% better than that of ENN, RENN, OSS, and NCR, respectively. For the other eight datasets, this new sampling algorithm also showed good indicator scores. The new algorithm proposed in this study can effectively alleviate the data imbalance problem of multi-classification time series datasets with many categories and few minority class samples and, at the same time, clean up the boundary noise data between classes.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] A novel three-stage multi-population evolutionary algorithm for constrained multi-objective optimization problems
    Shi, Chenli
    Wang, Ziqi
    Jin, Xiaohang
    Xu, Zhengguo
    Wang, Zhangsheng
    Shen, Peng
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (01) : 655 - 675
  • [22] A novel three-stage multi-population evolutionary algorithm for constrained multi-objective optimization problems
    Chenli Shi
    Ziqi Wang
    Xiaohang Jin
    Zhengguo Xu
    Zhangsheng Wang
    Peng Shen
    Complex & Intelligent Systems, 2024, 10 : 655 - 675
  • [23] A Multi-measure Nearest Neighbor Algorithm for Time Series Classification
    Fabris, Fabio
    Drago, Idilio
    Varejao, Flavio M.
    ADVANCES IN ARTIFICIAL INTELLIGENCE - IBERAMIA 2008, PROCEEDINGS, 2008, 5290 : 153 - 162
  • [24] Analog-Circuit Fault Diagnosis Using Three-stage Preprocessing and Time Series Data Mining
    He, Weisong
    Xiang, Hongmei
    Tang, Jingyuan
    IEEE CIRCUITS AND SYSTEMS INTERNATIONAL CONFERENCE ON TESTING AND DIAGNOSIS, 2009, : 208 - +
  • [25] A Three-Stage Surrogate Model Assisted Multi-Objective Genetic Algorithm for Computationally Expensive Problems
    Jiang, Puyu
    Zhou, Qi
    Liu, Jun
    Cheng, Yuansheng
    2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 1680 - 1687
  • [26] Three-stage multi-objective feature selection with distributed ensemble machine and deep learning for processing of complex and large datasets
    Babu V.D.
    Malathi K.
    Measurement: Sensors, 2023, 28
  • [27] Breast cancer detection and classification in mammogram using a three-stage deep learning framework based on PAA algorithm
    Jiang, Jiale
    Peng, Junchuan
    Hu, Chuting
    Jian, Wenjing
    Wang, Xianming
    Liu, Weixiang
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2022, 134
  • [28] Forecasting of municipal solid waste multi-classification by using time-series deep learning depending on the living standard
    Ahmed, Ahmed Khaled Abdella
    Ibraheem, Amira Mofreh
    Abd-Ellah, Mahmoud Khaled
    RESULTS IN ENGINEERING, 2022, 16
  • [29] A New Maintenance Optimization Model Based on Three-Stage Time Delay for Series Intelligent System with Intermediate Buffer
    Lv, Xiaolei
    Liu, Qinming
    Li, Zhinan
    Dong, Yifan
    Xia, Tangbin
    Chen, Xiang
    Shock and Vibration, 2021, 2021
  • [30] A New Maintenance Optimization Model Based on Three-Stage Time Delay for Series Intelligent System with Intermediate Buffer
    Lv, Xiaolei
    Liu, Qinming
    Li, Zhinan
    Dong, Yifan
    Xia, Tangbin
    Chen, Xiang
    SHOCK AND VIBRATION, 2021, 2021