Multi-parameter streaming outlier detection

被引:7
|
作者
Toliopoulos, Theodoros [1 ]
Gounaris, Anastasios [1 ]
机构
[1] Aristotle Univ Thessaloniki, Thessaloniki, Greece
关键词
distance-based outlier detection; Flink; streams;
D O I
10.1145/3350546.3352520
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Distance-based outlier detection techniques is a wide-spread methodology for anomaly detection. Despite their effectiveness, a main limitation is that they heavily rely on the dataset and the parameters chosen in order to establish the right status of each data point. These parameters typically include, but are not limited to, the neighborhood radius and threshold. In continuous streaming environments, the need for real-time analysis does not permit for an algorithm to be restarted multiple times with different parameters until the right combination is specified. This gives rise to the need for one technique that combines an arbitrary number of parameterizations with the use of minimal yet sufficient computer resources. In this work we both compare the state-of-the-art techniques for handling multiple queries in distance-based outlier detection algorithms and we propose a novel technique for multi-parameter distance-based outlier detection tailored to distributed continuous streaming environments, such as Spark and Flink.
引用
收藏
页码:208 / 216
页数:9
相关论文
共 50 条
  • [32] Continuity of Multi-parameter Paraproduct
    Ding, Wei
    Xu, Zheyuan
    Zhu, YuePing
    [J]. JOURNAL OF GEOMETRIC ANALYSIS, 2024, 34 (08)
  • [33] Multi-Parameter Optimization of an Ejector
    N. Poladvandi
    A. H. Aghdam
    [J]. Journal of Applied Mechanics and Technical Physics, 2018, 59 : 687 - 692
  • [34] MULTI-PARAMETER GAUSSIAN PROCESS
    PARK, WJ
    [J]. ANNALS OF MATHEMATICAL STATISTICS, 1970, 41 (05): : 1582 - &
  • [35] Multi-parameter quantum metrology
    Szczykulska, Magdalena
    Baumgratz, Tillmann
    Datta, Animesh
    [J]. ADVANCES IN PHYSICS-X, 2016, 1 (04): : 621 - 639
  • [36] MULTI-PARAMETER EIGENVALUE PROBLEM
    BROWNE, PJ
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1972, 38 (03) : 553 - &
  • [37] Boundedness of multi-parameter pseudo-differential operators on multi-parameter local Hardy spaces
    Chen, Jiao
    Ding, Wei
    Lu, Guozhen
    [J]. FORUM MATHEMATICUM, 2020, 32 (04) : 919 - 936
  • [38] Outlier Detection in Streaming Data A research Perspective
    Chugh, Neeraj
    Chugh, Mitali
    Agarwal, Alok
    [J]. 2014 INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (PDGC), 2014, : 429 - 432
  • [39] An Integrated Detection Based on a Multi-Parameter Plasmonic Optical Fiber Sensor
    Xiao, Gongli
    Ou, Zetao
    Yang, Hongyan
    Xu, Yanping
    Chen, Jianyun
    Li, Haiou
    Li, Qi
    Zeng, Lizhen
    Den, Yanron
    Li, Jianqing
    [J]. SENSORS, 2021, 21 (03) : 1 - 14
  • [40] Outlier Detection for Streaming Task Assignment in Crowdsourcing
    Zhao, Yan
    Chen, Xuanhao
    Deng, Liwei
    Kieu, Tung
    Guo, Chenjuan
    Yang, Bin
    Zheng, Kai
    Jensen, Christian S.
    [J]. PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1933 - 1943