Multi-parameter streaming outlier detection

被引:7
|
作者
Toliopoulos, Theodoros [1 ]
Gounaris, Anastasios [1 ]
机构
[1] Aristotle Univ Thessaloniki, Thessaloniki, Greece
关键词
distance-based outlier detection; Flink; streams;
D O I
10.1145/3350546.3352520
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Distance-based outlier detection techniques is a wide-spread methodology for anomaly detection. Despite their effectiveness, a main limitation is that they heavily rely on the dataset and the parameters chosen in order to establish the right status of each data point. These parameters typically include, but are not limited to, the neighborhood radius and threshold. In continuous streaming environments, the need for real-time analysis does not permit for an algorithm to be restarted multiple times with different parameters until the right combination is specified. This gives rise to the need for one technique that combines an arbitrary number of parameterizations with the use of minimal yet sufficient computer resources. In this work we both compare the state-of-the-art techniques for handling multiple queries in distance-based outlier detection algorithms and we propose a novel technique for multi-parameter distance-based outlier detection tailored to distributed continuous streaming environments, such as Spark and Flink.
引用
收藏
页码:208 / 216
页数:9
相关论文
共 50 条
  • [1] Parameter-free Streaming Distance-based Outlier Detection
    Giannoulidis, Apostolos
    Nikolaidis, Nikodimos
    Gounaris, Anastasios
    [J]. 2024 IEEE 40TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOP, ICDEW, 2024, : 102 - 106
  • [2] MULTI-PARAMETER RESOLVENTS
    SHONKWIL.R
    [J]. NOTICES OF THE AMERICAN MATHEMATICAL SOCIETY, 1972, 19 (07): : A794 - A794
  • [3] MULTI-PARAMETER ANALYSIS
    RANGER, CB
    [J]. INDUSTRIAL RESEARCH & DEVELOPMENT, 1979, 21 (09): : 134 - 137
  • [4] ON MULTI-PARAMETER THEORY
    VOLKMER, H
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1982, 86 (01) : 44 - 53
  • [5] Multi-parameter paraproducts
    Muscalu, Camil
    Pipher, Jill
    Tao, Terence
    Thiele, Christoph
    [J]. REVISTA MATEMATICA IBEROAMERICANA, 2006, 22 (03) : 963 - 976
  • [6] Outlier detection with streaming dyadic decomposition
    Gupta, Chetan
    Grossman, Robert
    [J]. ADVANCES IN DATA MINING: THEORETICAL ASPECTS AND APPLICATIONS, PROCEEDINGS, 2007, 4597 : 77 - +
  • [7] Aspirating Fire Detection System with High Sensitivity and Multi-parameter
    Liu Shixing
    Luo Xinxin
    Yao Wei
    Chen Changzheng
    Yin Kun
    Yi Maoxiang
    Hu Haibing
    Zhang Yongming
    [J]. 2014 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE, ELECTRONICS AND ELECTRICAL ENGINEERING (ISEEE), VOLS 1-3, 2014, : 399 - +
  • [8] Study of Multi-parameter in TDLAS Detection System Based on LabVIEW
    Ye, Weilin
    Liu, Weihao
    Xia, Zikun
    Xiao, Xupeng
    Xu, Xiaohuan
    Wu, Tao
    Wu, Fupei
    [J]. 2021 PHOTONICS & ELECTROMAGNETICS RESEARCH SYMPOSIUM (PIERS 2021), 2021, : 1170 - 1175
  • [9] Enhanced ACFM detection performance by multi-parameter synergy analysis
    Gao, Junqi
    Sun, Lingsi
    Zhao, Shuxiang
    Shen, Ying
    [J]. INSIGHT, 2020, 62 (02) : 81 - 85
  • [10] Multi-parameter optimization of a neutron backscattering landmine detection system
    Metwally, Walid A.
    [J]. APPLIED RADIATION AND ISOTOPES, 2015, 105 : 290 - 293