UWFP-Outlier: an efficient frequent-pattern-based outlier detection method for uncertain weighted data streams

被引:6
|
作者
Cai, Saihua [1 ]
Li, Li [1 ]
Li, Qian [1 ]
Li, Sicong [1 ]
Hao, Shangbo [2 ]
Sun, Ruizhi [1 ,3 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, Beijing 100083, Peoples R China
[2] Inner Mongolia Power Grp Mengdian Informat & Tele, Hohhot, Peoples R China
[3] Minist Agr, Sci Res Base Integrated Technol Precis Agr Anim H, Beijing 100083, Peoples R China
关键词
Outlier detection; Weighted frequent pattern mining; Deviation indices; Uncertain weighted data streams; FRAMEWORK;
D O I
10.1007/s10489-020-01718-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose an efficient frequent-pattern-based outlier detection method, namely, UWFP-Outlier, for identifying the implicit outliers from uncertain weighted data streams. For reducing the time cost of the UWFP-Outlier method, in the weighted frequent pattern mining phase, we introduce the concepts of themaximal weightandmaximal probabilityto form a compact anti-monotonic property, thereby reducing the scale of potential extensible patterns. For accurately detecting the outliers, in the outlier detection phase, we design two deviation indices to measure the deviation degree of each transaction in the uncertain weighted data streams by considering more factors that may influence its deviation degree; then, the transactions which have large deviation degrees are judged as outliers. The experimental results indicate that the proposed UWFP-Outlier method can accurately detect the outliers from uncertain weighted data streams with a lower time cost.
引用
收藏
页码:3452 / 3470
页数:19
相关论文
共 50 条
  • [21] Data Streams Oriented Outlier Detection Method: A Fast Minimal Infrequent Pattern Mining
    Zhou, ZhongYu
    Pi, DeChang
    INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2021, 18 (06) : 864 - 870
  • [22] Distance-based Outlier Detection in Data Streams
    Tran, Luan
    Fan, Liyue
    Shahabi, Cyrus
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2016, 9 (12): : 1089 - 1100
  • [23] SVDD-based outlier detection on uncertain data
    Bo Liu
    Yanshan Xiao
    Longbing Cao
    Zhifeng Hao
    Feiqi Deng
    Knowledge and Information Systems, 2013, 34 : 597 - 618
  • [24] Distance-based outlier detection on uncertain data
    Yu, Hao
    Wang, Bin
    Xiao, Gang
    Yang, Xiaochun
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2010, 47 (03): : 474 - 484
  • [25] SVDD-based outlier detection on uncertain data
    Liu, Bo
    Xiao, Yanshan
    Cao, Longbing
    Hao, Zhifeng
    Deng, Feiqi
    KNOWLEDGE AND INFORMATION SYSTEMS, 2013, 34 (03) : 597 - 618
  • [26] Outlier detection on uncertain data based on local information
    Liu, Jing
    Deng, HuiFang
    KNOWLEDGE-BASED SYSTEMS, 2013, 51 : 60 - 71
  • [27] A unifying method for outlier and change detection from data streams
    Li, Zhi
    Ma, Hong
    Zhou, Yongdao
    2006 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY, PTS 1 AND 2, PROCEEDINGS, 2006, : 580 - 585
  • [28] An efficient method for autoencoder based outlier detection
    Abhaya, Abhaya
    Patra, Bidyut Kr.
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [29] DILOF: Effective and Memory Efficient Local Outlier Detection in Data Streams
    Na, Gyoung S.
    Kim, Donghyun
    Yu, Hwanjo
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1993 - 2002
  • [30] An Outlier Detection Algorithm for Data Streams Based on Fuzzy Clustering
    Su, Xiaoke
    Qin, Yuming
    Wan, Renxia
    PROGRESS IN INTELLIGENCE COMPUTATION AND APPLICATIONS, 2008, : 109 - 112