Continuous Outlier Monitoring on Uncertain Data Streams

被引:2
|
作者
曹科研
王国仁
韩东红
丁国辉
王爱侠
石凌旭
机构
[1] College of Information Science and Engineering,Northeastern University
[2] Key Laboratory of Medical Image Computing,Ministry of Education,Northeastern University
[3] College of Computer,Shenyang Aerospace University
[4] Department of Command Information System Engineering,Logistic Engineering University of People’s Liberation Army
基金
中国国家自然科学基金;
关键词
outlier detection; uncertain data stream; data mining; parameter variable query;
D O I
暂无
中图分类号
TP311.13 [];
学科分类号
1201 ;
摘要
Outlier detection on data streams is an important task in data mining. The challenges become even larger when considering uncertain data. This paper studies the problem of outlier detection on uncertain data streams. We propose Continuous Uncertain Outlier Detection(CUOD), which can quickly determine the nature of the uncertain elements by pruning to improve the efficiency. Furthermore, we propose a pruning approach — Probability Pruning for Continuous Uncertain Outlier Detection(PCUOD) to reduce the detection cost. It is an estimated outlier probability method which can effectively reduce the amount of calculations. The cost of PCUOD incremental algorithm can satisfy the demand of uncertain data streams. Finally, a new method for parameter variable queries to CUOD is proposed, enabling the concurrent execution of different queries. To the best of our knowledge, this paper is the first work to perform outlier detection on uncertain data streams which can handle parameter variable queries simultaneously. Our methods are verified using both real data and synthetic data. The results show that they are able to reduce the required storage and running time.
引用
收藏
页码:436 / 448
页数:13
相关论文
共 50 条
  • [21] Adaptive Threshold for Outlier Detection on Data Streams
    Clark, James P.
    Liu, Zhen
    Japkowicz, Nathalie
    [J]. 2018 IEEE 5TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2018, : 41 - 49
  • [22] A Survey of Outlier Detection Algorithms for Data Streams
    Tamboli, Jinita
    Shukla, Madhu
    [J]. PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 3535 - 3540
  • [23] Outlier and anomaly pattern detection on data streams
    Cheong Hee Park
    [J]. The Journal of Supercomputing, 2019, 75 : 6118 - 6128
  • [24] Outlier and anomaly pattern detection on data streams
    Park, Cheong Hee
    [J]. JOURNAL OF SUPERCOMPUTING, 2019, 75 (09): : 6118 - 6128
  • [25] Attribute Outlier Detection over Data Streams
    Cao, Hui
    Zhou, Yongluan
    Shou, Lidan
    Chen, Gang
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PT II, PROCEEDINGS, 2010, 5982 : 216 - +
  • [26] Trajectory Outlier Detection on Trajectory Data Streams
    Cao, Keyan
    Liu, Yefan
    Meng, Gongjie
    Liu, Haoli
    Miao, Anchen
    Xu, Jingke
    [J]. IEEE Access, 2020, 8 : 34187 - 34196
  • [27] Interactive Outlier Exploration in Big Data Streams
    Cao, Lei
    Wang, Qingyang
    Rundensteiner, Elke A.
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2014, 7 (13): : 1621 - 1624
  • [28] Trajectory Outlier Detection on Trajectory Data Streams
    Cao, Keyan
    Liu, Yefan
    Meng, Gongjie
    Liu, Haoli
    Miao, Anchen
    Xu, Jingke
    [J]. IEEE ACCESS, 2020, 8 : 34187 - 34196
  • [29] Incremental local outlier detection for data streams
    Pokrajac, Dragojub
    Lazarevic, Aleksandar
    Latecki, Longin Jan
    [J]. 2007 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, VOLS 1 AND 2, 2007, : 504 - 515
  • [30] Outlier detection over data streams: Survey
    Brahmi Z.
    Souiden I.
    [J]. International Journal of Business Intelligence and Data Mining, 2021, 19 (04) : 481 - 507