Adaptive Anomaly Detection with Kernel Eigenspace Splitting and Merging

被引:15
|
作者
O'Reilly, Colin [1 ]
Gluhak, Alexander [2 ]
Imran, Muhammad Ali [1 ]
机构
[1] Univ Surrey, Ctr Commun Syst Res, Guildford GU2 7XH, Surrey, England
[2] Intel Labs Europe, London, England
基金
英国工程与自然科学研究理事会;
关键词
Adaptive; non-stationary; anomaly detection; outlier detection; kernel principal component analysis; kernel methods; COMPONENT ANALYSIS; SUPPORT; PCA;
D O I
10.1109/TKDE.2014.2324594
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Kernel principal component analysis and the reconstruction error is an effective anomaly detection technique for non-linear data sets. In an environment where a phenomenon is generating data that is non-stationary, anomaly detection requires a recomputation of the kernel eigenspace in order to represent the current data distribution. Recomputation is a computationally complex operation and reducing computational complexity is therefore a key challenge. In this paper, we propose an algorithm that is able to accurately remove data from a kernel eigenspace without performing a batch recomputation. Coupled with a kernel eigenspace update, we demonstrate that our technique is able to remove and add data to a kernel eigenspace more accurately than existing techniques. An adaptive version determines an appropriately sized sliding window of data and when a model update is necessary. Experimental evaluations on both synthetic and real-world data sets demonstrate the superior performance of the proposed approach in comparison to alternative incremental KPCA approaches and alternative anomaly detection techniques.
引用
收藏
页码:3 / 16
页数:14
相关论文
共 50 条
  • [1] Merging and splitting eigenspace models
    Hall, P
    Marshall, D
    Martin, R
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (09) : 1042 - 1049
  • [2] Kernel eigenspace separation transform for subspace anomaly detection in hypprspectral imagery
    Goldberg, H.
    Kwon, H.
    Nasrabadi, N. M.
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2007, 4 (04) : 581 - 585
  • [3] Fault Tolerant Anomaly Detection Using Adaptive Splitting and Merging Algorithm (AD-SMA)
    Gayathri, R.
    Thiyagarajan, B.
    Swathi, B.
    Parameshwari, V
    Manimegalai, D.
    Kumar, K. Prem
    ICARCSET'15: PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON ADVANCED RESEARCH IN COMPUTER SCIENCE ENGINEERING & TECHNOLOGY (ICARCSET - 2015), 2015,
  • [4] Adaptive Kernel Quantile Regression for Anomaly Detection
    Moriguchi, Hiroyuki
    Takeuchi, Ichiro
    Karasuyama, Masayuki
    Horikawa, Shin-ichi
    Ohta, Yoshikatsu
    Kodama, Tetsuji
    Naruse, Hiroshi
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2009, 13 (03) : 230 - 236
  • [5] An Adaptive Kernel Method for Anomaly Detection in Hyperspectral Imagery
    Mei, Feng
    Zhao, Chunhui
    Hu, Hanjun
    Sun, Yan
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL I, PROCEEDINGS, 2008, : 874 - +
  • [6] Eigenspace merging for model updating
    Franco, A
    Lumini, A
    Maio, D
    16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL II, PROCEEDINGS, 2002, : 156 - 159
  • [7] Adaptive kernel density-based anomaly detection for nonlinear systems
    Zhang, Liangwei
    Lin, Jing
    Karim, Ramin
    KNOWLEDGE-BASED SYSTEMS, 2018, 139 : 50 - 63
  • [8] Anomaly Detection With Kernel Preserving Embedding
    Liu, Huawen
    Li, Enhui
    Liu, Xinwang
    Su, Kaile
    Zhang, Shichao
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2021, 15 (05)
  • [9] DETECTION OF FLUX EMERGENCE, SPLITTING, MERGING, AND CANCELLATION OF NETWORK FIELD. I. SPLITTING AND MERGING
    Iida, Y.
    Hagenaar, H. J.
    Yokoyama, T.
    ASTROPHYSICAL JOURNAL, 2012, 752 (02):
  • [10] Adaptive Kernel Kalman Filter for Magnetic Anomaly Detection-based Metallic Target Tracking
    Sun, Mengwei
    Hodgskin-Brown, Richard
    Davies, Mike E.
    Proudler, Ian K.
    Hopgood, James R.
    2023 SENSOR SIGNAL PROCESSING FOR DEFENCE CONFERENCE, SSPD, 2023, : 1 - 5