Anomaly detection for high-dimensional data using a novel autoencoder-support vector machine

被引:0
|
作者
Jiang, Zhuo [1 ,2 ]
Huang, Xiao [3 ]
Wang, Rongbin [1 ]
机构
[1] Chongqing Expressway Grp Co Ltd, Chongqing, Peoples R China
[2] Chongqing Univ, Sch Big Data & Software Engn, Chongqing, Peoples R China
[3] Southwest Univ, Coll Software, Coll Comp & Informat Sci, Chongqing, Peoples R China
关键词
Anomaly detection; Chebyshev's theorem; high-dimensional data; OUTLIER DETECTION; SVM;
D O I
10.3233/JIFS-231735
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at anomaly detection upon a high-dimensional space, this paper proposed a novel autoencoder-support vector machine. The key thought is that using the autoencoder extracts the features from high-dimensional data, and then the support vector machine achieves the separation of abnormal features and normal features. To increase the precision of identifying anomalies, Chebyshev's theorem was used to estimate the upper of the number of abnormal features. Meanwhile, the dot product operation was implemented in order to strengthen the learning of the model for class labels. Experiment results show that the detected accuracy of the proposed method is 0.766 when the data dimensionality is 5408, and also wins over competitors in detected performance for the considered cases. We also demonstrate that the strengthened learning of class labels can improve the ability of the model to detect anomalies. In terms of noise resistance and overcoming the curse of dimensionality, the former can carry out more efforts than the latter.
引用
收藏
页码:9457 / 9469
页数:13
相关论文
共 50 条
  • [1] Anomaly detection for blueberry data using sparse autoencoder-support vector machine
    Wei, Dianwen
    Zheng, Jian
    Qu, Hongchun
    [J]. PEERJ COMPUTER SCIENCE, 2023, 9
  • [2] Anomaly detection for blueberry data using sparse autoencoder-support vector machine
    Wei, Dianwen
    Zheng, Jian
    Qu, Hongchun
    [J]. PeerJ Computer Science, 2023, 9 : 1 - 20
  • [3] High-Dimensional and Wide-Scale Anomaly Detection Using Enhancing Support Vector Machine
    Gumus, Ibrahim
    Sirin, Yahya
    [J]. 2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [4] Efficient Anomaly Detection for High-Dimensional Sensing Data With One-Class Support Vector Machine
    Qiao, Yan
    Wu, Kui
    Jin, Peng
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) : 404 - 417
  • [5] Contextual anomaly detection for high-dimensional data using Dirichlet process variational autoencoder
    Kim, Hyojoong
    Kim, Heeyoung
    [J]. IISE TRANSACTIONS, 2023, 55 (05) : 433 - 444
  • [6] AutoEncoder regularization using Support Vector Data Description for Anomaly Detection
    Ravi, Ambareesh
    Karray, Fakhri
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1842 - 1848
  • [7] Robust support vector machine for high-dimensional imbalanced data
    Nakayama, Yugo
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2021, 50 (05) : 1524 - 1540
  • [8] Anomaly Detection in High-Dimensional Data
    Talagala, Priyanga Dilini
    Hyndman, Rob J.
    Smith-Miles, Kate
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2021, 30 (02) : 360 - 374
  • [9] Detection of outliers in high-dimensional data using nu-support vector regression
    Mohammed Rashid, Abdullah
    Midi, Habshah
    Dhhan, Waleed
    Arasan, Jayanthi
    [J]. JOURNAL OF APPLIED STATISTICS, 2022, 49 (10) : 2550 - 2569
  • [10] A novel robust kernel for classifying high-dimensional data using Support Vector Machines
    Hussain, Syed Fawad
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2019, 131 : 116 - 131