Spectral ranking and unsupervised feature selection for point, collective, and contextual anomaly detection

被引:0
|
作者
Haofan Zhang
Ke Nian
Thomas F. Coleman
Yuying Li
机构
[1] University of Waterloo,Cheriton School of Computer Science
[2] University of Waterloo,Combinatorics and Optimization
关键词
Unsupervised learning; Fraud detection; Rare class ranking; Similarity measure; Kernels; Spectral clustering; One-class SVM;
D O I
暂无
中图分类号
学科分类号
摘要
Unsupervised anomaly detection algorithm is typically suitable only to a specific type of anomaly, among point anomaly, collective anomaly, and contextual anomaly. A mismatch between the intended anomaly type of an algorithm and the actual type in the data can lead to poor performance. In this paper, utilizing Hilbert–Schmidt independence criterion (HSIC), we propose an unsupervised backward elimination feature selection algorithm BAHSIC-AD to identify a subset of features with the strongest interdependence for anomaly detection. Using BAHSIC-AD, we compare the effectiveness of a recent Spectral Ranking for Anomalies (SRA) algorithm with other popular anomaly detection methods on a few synthetic datasets and real-world datasets. Furthermore, we demonstrate that SRA, combined with BAHSIC-AD, can be a generally applicable method for detecting point, collective, and contextual anomalies.
引用
收藏
页码:57 / 75
页数:18
相关论文
共 50 条
  • [41] CoWrap: An Approach of Feature Selection for Network Anomaly Detection
    Ghosh, Anonnya
    Ibrahim, Hussain Mohammed
    Mohammad, Wasif
    Nova, Farhana Chowdhury
    Hasan, Amit
    Rab, Raqeebir
    [J]. ADVANCED INFORMATION NETWORKING AND APPLICATIONS, AINA-2022, VOL 2, 2022, 450 : 547 - 559
  • [42] A Latent Feature Autoencoder via Adversarial Training for Unsupervised Anomaly Detection
    Tang, Wei
    Li, Jun
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 2718 - 2723
  • [43] Community Feature Selection for Anomaly Detection in Attributed Graphs
    Alfonso Prado-Romero, Mario
    Gago-Alonso, Andres
    [J]. PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2016, 2017, 10125 : 109 - 116
  • [44] Feature Selection for Anomaly Detection in Call Center Data
    Iheme, Leonardo O.
    Ozan, Sukru
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND ELECTRONICS ENGINEERING (ELECO 2019), 2019, : 926 - 929
  • [45] Discriminative and Uncorrelated Feature Selection With Constrained Spectral Analysis in Unsupervised Learning
    Li, Xuelong
    Zhang, Han
    Zhang, Rui
    Nie, Feiping
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (01) : 2139 - 2149
  • [46] Local and Global Structure Preservation for Robust Unsupervised Spectral Feature Selection
    Zhu, Xiaofeng
    Zhang, Shichao
    Hu, Rongyao
    Zhu, Yonghua
    Song, Jingkuan
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (03) : 517 - 529
  • [47] Unsupervised Spectral Feature Selection With Dynamic Hyper-Graph Learning
    Zhu, Xiaofeng
    Zhang, Shichao
    Zhu, Yonghua
    Zhu, Pengfei
    Gao, Yue
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (06) : 3016 - 3028
  • [48] Unsupervised Feature Selection via Nonnegative Spectral Analysis and Redundancy Control
    Li, Zechao
    Tang, Jinhui
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) : 5343 - 5355
  • [49] Unsupervised spectral feature selection with l1-norm graph
    Wang, Xiaodong
    Zhang, Xu
    Zeng, Zhiqiang
    Wu, Qun
    Zhang, Jian
    [J]. NEUROCOMPUTING, 2016, 200 : 47 - 54
  • [50] Robust Joint Graph Sparse Coding for Unsupervised Spectral Feature Selection
    Zhu, Xiaofeng
    Li, Xuelong
    Zhang, Shichao
    Ju, Chunhua
    Wu, Xindong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (06) : 1263 - 1275