Multi-stage Mixed Attribute Outlier Detection Algorithm Based on Neighborhood Density Difference

被引:0
|
作者
Du, Haizhou [1 ]
Fang, Wei [1 ]
Liu, Qing [1 ]
Yang, Zhenchen [2 ]
Wang, Xiaofeng [3 ]
机构
[1] Shanghai Univ Elect Power, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] Shanghai Elect Power Xinda New Energy Technol Co, Shanghai, Peoples R China
[3] State Grid Hangzhou Xiaoshan Power Supply Co, Hangzhou, Peoples R China
关键词
Outlier detection; Mixed attribute; Neighborhood density difference;
D O I
10.1109/BIGCOM.2019.00031
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of big data, an increasing number of mixed attribute dataset has become ubiquitous. It is also extremely important for decision analysis in the processing of a mixed attribute dataset. The existing outlier detection algorithm does not process a mixed attribute dataset and some special objects, because of too high computational time complexity and unsatisfactory detection results. In this paper, we present a multi-stage mixed attribute outlier detection algorithm. Firstly, with data set being divided, the neighborhood information was constructed based on the heterogeneous similarity metric to generate the core point. Then, the primitive clusters can be formed on the basis of the definition. Finally, a neighborhood density difference metric-based outlier detection algorithm was designed to construct neighborhood outlier factor (NOF). Extensive experimental results show the advantages of the proposed method, which could improve the outlier detection accuracy and reduce the time complexity on mixed attributed.
引用
收藏
页码:160 / 168
页数:9
相关论文
共 50 条
  • [21] Outlier detection based on neighborhood chain
    Liang S.-Y.
    Han D.-Q.
    Kongzhi yu Juece/Control and Decision, 2019, 34 (07): : 1433 - 1440
  • [22] An Outlier Mining Algorithm Based on Attribute Entropy
    Zhou, Ming-Jian
    Tao, Jun-cai
    2011 2ND INTERNATIONAL CONFERENCE ON CHALLENGES IN ENVIRONMENTAL SCIENCE AND COMPUTER ENGINEERING (CESCE 2011), VOL 11, PT A, 2011, 11 : 132 - 138
  • [23] Application of a genetic algorithm to multi-stage detection in CDMA systems
    Ergun, C
    Hacioglu, K
    MELECON '98 - 9TH MEDITERRANEAN ELECTROTECHNICAL CONFERENCE, VOLS 1 AND 2, 1998, : 846 - 850
  • [24] A System of Video Shot Detection Using Multi-stage Algorithm
    Zhou Shunyong
    Xie Wenling
    2009 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND COMPUTER SCIENCE, VOL 1, PROCEEDINGS, 2009, : 558 - +
  • [25] A new multi-stage SPSO algorithm for vibration-based structural damage detection
    Sanjideh, Bahador Adel
    Hamzehkolaei, Azadeh Ghadimi
    Hosseinzadeh, Ali Zare
    Amiri, Gholamreza Ghodrati
    STRUCTURAL ENGINEERING AND MECHANICS, 2022, 84 (04) : 489 - 502
  • [26] A Relative Kernel-density Based Outlier Detection Algorithm
    Wahid, Abdul
    Rao, A. C. S.
    Deb, Koushik
    2018 12TH INTERNATIONAL CONFERENCE ON SOFTWARE, KNOWLEDGE, INFORMATION MANAGEMENT & APPLICATIONS (SKIMA), 2018, : 40 - +
  • [27] A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor
    Zhang, ZhongPing
    Li, Sen
    Liu, WeiXiong
    Wang, Ying
    Li, Daisy Xin
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2023, 19 (02)
  • [28] Density Based Outlier Mining Algorithm with Application to Intrusion Detection
    Yang, Peng
    Huang, Biao
    PACIIA: 2008 PACIFIC-ASIA WORKSHOP ON COMPUTATIONAL INTELLIGENCE AND INDUSTRIAL APPLICATION, VOLS 1-3, PROCEEDINGS, 2008, : 489 - 492
  • [29] Adaptive large neighborhood search algorithm for multi-stage weapon target assignment problem
    Chang, Xuening
    Shi, Jianmai
    Luo, Zhihao
    Liu, Yao
    COMPUTERS & INDUSTRIAL ENGINEERING, 2023, 181
  • [30] SDROF: outlier detection algorithm based on relative skewness density ratio outlier factor
    Zhang, Zhongping
    Wang, Kuo
    Dong, Jinyu
    Li, Sen
    APPLIED INTELLIGENCE, 2025, 55 (01)