Continuous Outlier Monitoring on Uncertain Data Streams

被引:2
|
作者
曹科研
王国仁
韩东红
丁国辉
王爱侠
石凌旭
机构
[1] College of Information Science and Engineering,Northeastern University
[2] Key Laboratory of Medical Image Computing,Ministry of Education,Northeastern University
[3] College of Computer,Shenyang Aerospace University
[4] Department of Command Information System Engineering,Logistic Engineering University of People’s Liberation Army
基金
中国国家自然科学基金;
关键词
outlier detection; uncertain data stream; data mining; parameter variable query;
D O I
暂无
中图分类号
TP311.13 [];
学科分类号
1201 ;
摘要
Outlier detection on data streams is an important task in data mining. The challenges become even larger when considering uncertain data. This paper studies the problem of outlier detection on uncertain data streams. We propose Continuous Uncertain Outlier Detection(CUOD), which can quickly determine the nature of the uncertain elements by pruning to improve the efficiency. Furthermore, we propose a pruning approach — Probability Pruning for Continuous Uncertain Outlier Detection(PCUOD) to reduce the detection cost. It is an estimated outlier probability method which can effectively reduce the amount of calculations. The cost of PCUOD incremental algorithm can satisfy the demand of uncertain data streams. Finally, a new method for parameter variable queries to CUOD is proposed, enabling the concurrent execution of different queries. To the best of our knowledge, this paper is the first work to perform outlier detection on uncertain data streams which can handle parameter variable queries simultaneously. Our methods are verified using both real data and synthetic data. The results show that they are able to reduce the required storage and running time.
引用
收藏
页码:436 / 448
页数:13
相关论文
共 50 条
  • [11] Continuous ranking on uncertain streams
    Cheqing Jin
    Jingwei Zhang
    Aoying Zhou
    [J]. Frontiers of Computer Science, 2012, 6 : 686 - 699
  • [12] Continuous ranking on uncertain streams
    Jin, Cheqing
    Zhang, Jingwei
    Zhou, Aoying
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2012, 6 (06) : 686 - 699
  • [13] Continuous kernel-based outlier detection over distributed data streams
    Su, Liang
    Han, Weihong
    Zou, Peng
    Jia, Yan
    [J]. FRONTIERS OF HIGH PERFORMANCE COMPUTING AND NETWORKING - ISPA 2007 WORKSHOPS, 2007, 4743 : 305 - +
  • [14] An efficient approach for outlier detection from uncertain data streams based on maximal frequent patterns
    Cai, Saihua
    Li, Li
    Li, Sicong
    Sun, Ruizhi
    Yuan, Gang
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2020, 160
  • [15] Continuous Skyline Monitoring over Distributed Data Streams
    Lu, Hua
    Zhou, Yongluan
    Haustad, Jonas
    [J]. SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, 2010, 6187 : 565 - +
  • [16] Online Outlier Detection for Data Streams
    Sadik, Shiblee
    Gruenwald, Le
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL DATABASE ENGINEERING & APPLICATIONS SYMPOSIUM (IDEAS '11), 2011, : 88 - 96
  • [17] Continuous monitoring for changepoints in data streams using adaptive estimation
    Bodenham, Dean A.
    Adams, Niall M.
    [J]. STATISTICS AND COMPUTING, 2017, 27 (05) : 1257 - 1270
  • [18] Queueing Analysis of Continuous Queries for Uncertain Data Streams Over Sliding Windows
    Xiao, Guoqing
    Li, Kenli
    Zhou, Xu
    Li, Keqin
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2016, 30 (09)
  • [19] An Improved AFF Algorithm for Continuous Monitoring for Changepoints in Data Streams
    Zhao, Junlong
    An, Mengying
    Lu, Xiaoling
    Fan, Yiwei
    Liu, Menghang
    [J]. PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON COMPUTING AND PATTERN RECOGNITION (ICCPR 2018), 2018, : 7 - 13
  • [20] Continuous monitoring for changepoints in data streams using adaptive estimation
    Dean A. Bodenham
    Niall M. Adams
    [J]. Statistics and Computing, 2017, 27 : 1257 - 1270