An Optimized Pruning-based Outlier Detecting algorithm

被引:0
|
作者
Wang, Jinghua [1 ]
Zhao, Xinxiang [1 ]
Jin, Peng [1 ]
Zhang, Guoyan [1 ]
机构
[1] Cent China Normal Univ, Acad Comp Sci, Wuhan, Hubei, Peoples R China
关键词
Data mining; Outlier detection; Pruning; Clustering;
D O I
10.4028/www.scientific.net/AMM.411-414.1076
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
An Optimized Pruning-based Outlier Detecting algorithm is proposed based on the density-based outlier detecting algorithm (LOF algorithm). The calculation accuracy and the time complexity of LOP algorithm are not ideal, so two steps are taken to reduce the amount of calculation and improve the calculation accuracy for LOF algorithm. Firstly, using cluster pruning technique to preprocess data set, at the same time filtering the non-outliers based on the differences of cluster models to avoid the error pruning of outliers located at the edge of clusters, different cluster models are output by inputing multiple parameters in the DBSCAN algorithm. Secondly,optimize the query process of the neighborhood (epsilon - neighbor and k- neighbor). After pruning, local outlier factors are calculated only for the data objects out of clusters. Experimental results show that the algorithm proposed in this paper can improve the outlier detection accuracy, reduce the time complexity and realize the effective local outlier detection.
引用
收藏
页码:1076 / 1080
页数:5
相关论文
共 50 条
  • [31] An Outlier Detection Method Based on Cluster Pruning
    Pamula, Rajendra
    Deka, Jatindra Kumar
    Nandi, Sukumar
    2014 2ND INTERNATIONAL CONFERENCE ON BUSINESS AND INFORMATION MANAGEMENT (ICBIM), 2014,
  • [32] Balancing Privacy and Utility in Split Learning: An Adversarial Channel Pruning-Based Approach
    Alhindi, Afnan
    Al-Ahmadi, Saad
    Ben Ismail, Mohamed Maher
    IEEE ACCESS, 2025, 13 : 10094 - 10110
  • [33] Margin-Based Pareto Ensemble Pruning: An Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles
    Hu, Ruihan
    Zhou, Songbin
    Liu, Yisen
    Tang, Zhiri
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2019, 2019
  • [34] Using filter pruning-based deep learning algorithm for the real-time fruit freshness detection with edge processors
    Mao, DianHui
    Zhang, DengHui
    Sun, Hao
    Wu, JianWei
    Chen, JunHua
    JOURNAL OF FOOD MEASUREMENT AND CHARACTERIZATION, 2024, 18 (02) : 1574 - 1591
  • [35] Using filter pruning-based deep learning algorithm for the real-time fruit freshness detection with edge processors
    DianHui Mao
    DengHui Zhang
    Hao Sun
    JianWei Wu
    JunHua Chen
    Journal of Food Measurement and Characterization, 2024, 18 : 1574 - 1591
  • [36] Iterative Pruning-based Model Compression for Pose Estimation on Resource-constrained Devices
    Choi, Sunghyun
    Choi, Wonje
    Lee, Youngseok
    Woo, Honguk
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, ICMVA 2022, 2022, : 110 - 115
  • [37] Using channel pruning-based YOLOv5 deep learning algorithm for accurately counting fish fry in real time
    Xu, Huanliang
    Chen, Xi
    Wu, Yuqiang
    Liao, Bowen
    Liu, Longshen
    Zhai, Zhaoyu
    AQUACULTURE INTERNATIONAL, 2024, 32 (07) : 9179 - 9200
  • [38] A sequential outlier detecting method using a clustering algorithm
    Seo, Han Son
    Yoon, Min
    KOREAN JOURNAL OF APPLIED STATISTICS, 2016, 29 (04) : 699 - 706
  • [39] An Optimized Outlier Detection Algorithm for Jury-Based Grading of Engineering Design Projects
    Thompson, Mary Kathryn
    Espensen, Christina
    Clemmensen, Line Harder
    INTERNATIONAL JOURNAL OF ENGINEERING EDUCATION, 2016, 32 (01) : 172 - 184
  • [40] Iterative magnitude pruning-based light-version of AlexNet for skin cancer classification
    Medhat, Sara
    Abdel-Galil, Hala
    Aboutabl, Amal Elsayed
    Saleh, Hassan
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (03): : 1413 - 1428