Spectral ranking and unsupervised feature selection for point, collective, and contextual anomaly detection

被引:0
|
作者
Haofan Zhang
Ke Nian
Thomas F. Coleman
Yuying Li
机构
[1] University of Waterloo,Cheriton School of Computer Science
[2] University of Waterloo,Combinatorics and Optimization
关键词
Unsupervised learning; Fraud detection; Rare class ranking; Similarity measure; Kernels; Spectral clustering; One-class SVM;
D O I
暂无
中图分类号
学科分类号
摘要
Unsupervised anomaly detection algorithm is typically suitable only to a specific type of anomaly, among point anomaly, collective anomaly, and contextual anomaly. A mismatch between the intended anomaly type of an algorithm and the actual type in the data can lead to poor performance. In this paper, utilizing Hilbert–Schmidt independence criterion (HSIC), we propose an unsupervised backward elimination feature selection algorithm BAHSIC-AD to identify a subset of features with the strongest interdependence for anomaly detection. Using BAHSIC-AD, we compare the effectiveness of a recent Spectral Ranking for Anomalies (SRA) algorithm with other popular anomaly detection methods on a few synthetic datasets and real-world datasets. Furthermore, we demonstrate that SRA, combined with BAHSIC-AD, can be a generally applicable method for detecting point, collective, and contextual anomalies.
引用
收藏
页码:57 / 75
页数:18
相关论文
共 50 条
  • [1] Spectral ranking and unsupervised feature selection for point, collective, and contextual anomaly detection
    Zhang, Haofan
    Nian, Ke
    Coleman, Thomas F.
    Li, Yuying
    [J]. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2020, 9 (01) : 57 - 75
  • [2] Unsupervised spectral mapping and feature selection for hyperspectral anomaly detection
    Xie, Weiying
    Li, Yunsong
    Lei, Jie
    Yang, Jian
    Li, Jiaojiao
    Jia, Xiuping
    Li, Zhen
    [J]. NEURAL NETWORKS, 2020, 132 : 144 - 154
  • [3] Ranking-based Feature Selection for Anomaly Detection in Sensor Networks
    Li, Rui
    Zhao, Jizhong
    Liu, Kebin
    He, Yuan
    [J]. AD HOC & SENSOR WIRELESS NETWORKS, 2013, 19 (1-2) : 119 - 139
  • [4] Expect the Unexpected: Unsupervised Feature Selection for Automated Sensor Anomaly Detection
    Teh, Hui Yie
    Wang, Kevin I-Kai
    Kempa-Liehr, Andreas W.
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (16) : 18033 - 18046
  • [5] UNSUPERVISED FEATURE RANKING AND SELECTION BASED ON AUTOENCODERS
    Sharifipour, Sasan
    Fayyazi, Hossein
    Sabokrou, Mohammad
    Adeli, Ehsan
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3172 - 3176
  • [6] Unsupervised Contextual Anomaly Detection for Database Systems
    Li, Sainan
    Yin, Qilei
    Li, Guoliang
    Li, Qi
    Liu, Zhuotao
    Zhu, Jinwei
    [J]. PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 788 - 802
  • [7] An approach for unsupervised contextual anomaly detection and characterization
    Boukela, Lynda
    Zhang, Gongxuan
    Yacoub, Meziane
    Bouzefrane, Samia
    Ahmadi, Sajjad Bagheri Baba
    [J]. INTELLIGENT DATA ANALYSIS, 2022, 26 (05) : 1185 - 1209
  • [8] Network Anomaly Detection Using Unsupervised Feature Selection and Density Peak Clustering
    Ni, Xiejun
    He, Daojing
    Chan, Sammy
    Ahmad, Farooq
    [J]. APPLIED CRYPTOGRAPHY AND NETWORK SECURITY, ACNS 2016, 2016, 9696 : 212 - 227
  • [9] On Algorithms Selection for Unsupervised Anomaly Detection
    Zoppi, Tommaso
    Ceccarelli, Andrea
    Bondavalli, Andrea
    [J]. 2018 IEEE 23RD PACIFIC RIM INTERNATIONAL SYMPOSIUM ON DEPENDABLE COMPUTING (PRDC), 2018, : 279 - 288
  • [10] A hybrid method of unsupervised feature selection based on ranking
    Li, Yun
    Lu, Bao-Liang
    Wu, Zhong-Fu
    [J]. 18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2006, : 687 - +