Multi-stage Mixed Attribute Outlier Detection Algorithm Based on Neighborhood Density Difference

被引:0
|
作者
Du, Haizhou [1 ]
Fang, Wei [1 ]
Liu, Qing [1 ]
Yang, Zhenchen [2 ]
Wang, Xiaofeng [3 ]
机构
[1] Shanghai Univ Elect Power, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] Shanghai Elect Power Xinda New Energy Technol Co, Shanghai, Peoples R China
[3] State Grid Hangzhou Xiaoshan Power Supply Co, Hangzhou, Peoples R China
关键词
Outlier detection; Mixed attribute; Neighborhood density difference;
D O I
10.1109/BIGCOM.2019.00031
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of big data, an increasing number of mixed attribute dataset has become ubiquitous. It is also extremely important for decision analysis in the processing of a mixed attribute dataset. The existing outlier detection algorithm does not process a mixed attribute dataset and some special objects, because of too high computational time complexity and unsatisfactory detection results. In this paper, we present a multi-stage mixed attribute outlier detection algorithm. Firstly, with data set being divided, the neighborhood information was constructed based on the heterogeneous similarity metric to generate the core point. Then, the primitive clusters can be formed on the basis of the definition. Finally, a neighborhood density difference metric-based outlier detection algorithm was designed to construct neighborhood outlier factor (NOF). Extensive experimental results show the advantages of the proposed method, which could improve the outlier detection accuracy and reduce the time complexity on mixed attributed.
引用
收藏
页码:160 / 168
页数:9
相关论文
共 50 条
  • [31] Circle detection algorithm based on neighborhood density clustering
    Li, Ziliang
    Wang, Tao
    Zhang, Jinzhu
    Bai, Jianxin
    Shi, Wei
    Huang, Qingxue
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (05)
  • [32] A practical outlier detection approach for mixed-attribute data
    Bouguessa, Mohamed
    EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (22) : 8637 - 8649
  • [33] Attribute-weighted outlier detection for mixed data based on parallel mutual information
    Li, Junli
    Liu, Zhanfeng
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 236
  • [34] Anomaly based multi-stage attack detection method
    Ma, Wei
    Hou, Yunyun
    Jin, Mingyu
    Jian, Pengpeng
    PLOS ONE, 2024, 19 (03): : 1 - 20
  • [35] Multi-stage Contour Based Detection of Deformable Objects
    Ravishankar, Saiprasad
    Jain, Arpit
    Mittal, Anurag
    COMPUTER VISION - ECCV 2008, PT I, PROCEEDINGS, 2008, 5302 : 483 - 496
  • [36] Multi-object tracking algorithm based on multi-stage association
    Huo X.
    Gai S.
    Hong R.
    Zhou W.
    Da F.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2023, 44 (11): : 205 - 214
  • [37] DP_DETECTION: An outlier detection algorithm based on density of big data
    Li, Xiaodi
    Deng, Ping
    Huang, Ming
    Li, Dingcheng
    Wang, Hongjun
    DATA SCIENCE AND KNOWLEDGE ENGINEERING FOR SENSING DECISION SUPPORT, 2018, 11 : 534 - 544
  • [38] Unique Neighborhood Set Parameter Independent Density-Based Clustering With Outlier Detection
    Rahman, Md Anisur
    Ang, Kenneth Li-Minn
    Seng, Kah Phooi
    IEEE ACCESS, 2018, 6 : 44707 - 44717
  • [39] APPROACHES TO MULTI-STAGE MULTI-ATTRIBUTE GROUP DECISION MAKING
    Xu, Zeshui
    INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING, 2011, 10 (01) : 121 - 146
  • [40] ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor
    Zhang Z.
    Liu W.
    Zhang Y.
    Deng Y.
    Wei M.
    Tongxin Xuebao/Journal on Communications, 2021, 42 (09): : 133 - 143