A fuzzy detection approach to high-dimensional anomalies

被引:0
|
作者
Zheng, Jian [1 ]
Ruan, Nanshan [2 ]
Wei, Pingping [3 ]
Li, Lin [4 ]
Zhang, Jingyue [5 ]
机构
[1] Chongqing Technol & Business Univ, Sch Artificial Intelligence, Chongqing 400067, Peoples R China
[2] Geely Univ China, Sch Intelligent Networking & New Energy Vehicles, Chengdu 641423, Peoples R China
[3] Yunnan Technol & Business Univ, Sch Intelligent Sci & Engn, Kunming 651701, Yunnan, Peoples R China
[4] Chongqing Three Gorges Univ, Coll Math & Stat, Chongqing 404100, Peoples R China
[5] Chongqing Polytech Inst, Coll Big Data, Chongqing 401320, Peoples R China
关键词
Anomaly detection; Density fuzzy; High dimensionality; SUPPORT VECTOR MACHINE;
D O I
10.1007/s00530-024-01343-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Rare anomalies allow to be hidden in any subspace upon a high-dimensional space so that high-dimensional dimensional of the data brings a lot of trouble for anomalous detectors. To mine high-dimensional anomalies, this paper proposes a novel hypersphere with density fuzzy. On the one hand, the major contributors are chosen by using the fuzzy and a density estimator to quantify the contributions created by unknown instances, and then the hypersphere trained by the major contributors achieves anomalous identification. On the other hand, an inner product kernel is also derived to assist that the hypersphere pays more attention to local regions containing anomalies. Experimental results on ten UCI datasets show that the proposed model wins over the opponents on the three ultra-high dimensional datasets and most high-dimensional datasets in mining anomalies. Results also indicate that these models with fuzzy perform better than those without fuzzy, meanwhile, there is no significant difference between detected results. We demonstrate that calculating data density or attending data local regions can alleviate negative effects caused by high dimensionality on anomalous detection results to a certain extent. Additionally, the effort created by fuzzy to resist the curse of dimensionality do not rely on specific scenarios and specific detectors, while the assistance afforded by kernels to resist high dimensionality is dependent of detector structures.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Genetic-Fuzzy Classification Approach to Improve High-Dimensional Intrusion Detection System
    Gaied, Imen
    Jemili, Farah
    Korbaa, Ouajdi
    [J]. INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS (ISDA 2016), 2017, 557 : 319 - 329
  • [2] A deep hypersphere approach to high-dimensional anomaly detection
    Zheng, Jian
    Qu, Hongchun
    Li, Zhaoni
    Li, Lin
    Tang, Xiaoming
    [J]. APPLIED SOFT COMPUTING, 2022, 125
  • [3] A Spectral Clustering Approach for the Classification of Waveform Anomalies in High-Dimensional Brain Signals
    Stamoulis, Catherine
    [J]. 42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 50 - 53
  • [4] High-Dimensional Fuzzy Inference Systems
    Xue, Guangdong
    Wang, Jian
    Zhang, Kai
    Pal, Nikhil R.
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (01): : 507 - 519
  • [5] Node Detection Using High-Dimensional Fuzzy Parcellation Applied to the Insular Cortex
    Vercelli, Ugo
    Diano, Matteo
    Costa, Tommaso
    Nani, Andrea
    Duca, Sergio
    Geminiani, Giuliano
    Vercelli, Alessandro
    Cauda, Franco
    [J]. NEURAL PLASTICITY, 2016, 2016
  • [6] Detection of abnormal traffic video images based on high-dimensional Fuzzy Geometry
    Huang L.
    Li Z.
    Wang B.
    [J]. Automatic Control and Computer Sciences, 2017, 51 (3) : 149 - 158
  • [7] A High-Dimensional Outlier Detection Approach Based on Local Coulomb Force
    Zhu, Pengyun
    Zhang, Chaowei
    Li, Xiaofeng
    Zhang, Jifu
    Qin, Xiao
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (06) : 5506 - 5520
  • [8] MODELLING HIGH-DIMENSIONAL SYSTEMS WITH FUZZY RULES
    Remache, Cherif
    Maamri, Ramdane
    Sahnoun, Zaidi
    [J]. 2013 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTER AND COMPUTATION (ICECCO), 2013, : 330 - 333
  • [9] Fuzzy Approach for Detection of Anomalies in Time Series
    Kiersztyn, Adam
    Karczmarek, Pawel
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2019, PT II, 2019, 11509 : 397 - 406
  • [10] High-Dimensional Data Modeling Techniques for Detection of Chemical Plumes and Anomalies in Hyperspectral Images and Movies
    Wang, Yi
    Chen, Guangliang
    Maggioni, Mauro
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2016, 9 (09) : 4316 - 4324