Proposal of Online Outlier Detection in Sensor Data Using Kernel Density Estimation

被引:5
|
作者
Haque, Md Atiqul [1 ]
Mineno, Hiroshi [1 ]
机构
[1] Shizuoka Univ, Grad Sch Integrated Sci & Technol, Hamamatsu, Shizuoka, Japan
关键词
outlier detection; statistical modeling technique; kernel density estimation; wireless sensor networks; data streaming;
D O I
10.1109/IIAI-AAI.2017.41
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sensors in different locations can generate streaming data, which can be analyzed in real-time to identify events of interest. Continuous outlier detection in data streams has important applications in fraud detection, network security, environmental monitoring and public health. In this paper, we propose a framework that computes in a distributed manner an approximation of multi-dimensional data distributions in order to enable complex applications in resource constrained sensor networks. Here we are targeting the problem of outlier detection. We demonstrate how our technique can be used to identify either distance based or density based outliers in a single pass over the data. Our approach takes into consideration various characteristics and features of streaming sensor data.
引用
收藏
页码:1051 / 1052
页数:2
相关论文
共 50 条
  • [1] Online Bad Data Detection Using Kernel Density Estimation
    Uddin, Muhammad Sharif
    Kuh, Anthony
    Weng, Yang
    Ilic, Marija
    [J]. 2015 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, 2015,
  • [2] Density kernel depth for outlier detection in functional data
    Hernandez, Nicolas
    Munoz, Alberto
    Martos, Gabriel
    [J]. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2023, 16 (04) : 481 - 488
  • [3] Density kernel depth for outlier detection in functional data
    Nicolás Hernández
    Alberto Muñoz
    Gabriel Martos
    [J]. International Journal of Data Science and Analytics, 2023, 16 : 481 - 488
  • [4] Online Outlier Detection of Energy Data Streams using Incremental and Kernel PCA Algorithms
    Deng, Jeremiah D.
    [J]. 2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2016, : 390 - 397
  • [5] Outlier Resilient Online Multivariate Change Point Detection Using Subsequence Divergence Estimation in Sensor Data Streams
    Dash, Ritwik
    Jenamani, Mamata
    [J]. IEEE Sensors Journal, 2024, 24 (23) : 39218 - 39229
  • [6] Outlier Detection Method of Environmental Streams Based on Kernel Density Estimation
    Wu, Pengfei
    Li, Guanghui
    Zhu, Hong
    Lu, Wenwei
    [J]. ADVANCES IN WIRELESS SENSOR NETWORKS, 2015, 501 : 467 - 480
  • [7] A New Outlier Detection Algorithm Based on Kernel Density Estimation for ITS
    Xu, Yiwen
    Xu, Ningbin
    Feng, Xinxin
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2016, : 258 - 262
  • [8] An Outlier Detection Algorithm based on KNN-kernel Density Estimation
    Wahid, Abdul
    Rao, Annavarapu Chandra Sekhara
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [9] Outlier detection with kernel density functions
    Latecki, Longin Jan
    Lazarevic, Aleksandar
    Pokrajac, Dragojub
    [J]. MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, PROCEEDINGS, 2007, 4571 : 61 - +
  • [10] Detection of copy number variations from NGS data by using an adaptive kernel density estimation-based outlier factor
    Haque, A. K. Alvi
    Xie, Kun
    Liu, Kang
    Zhao, Haiyong
    Yang, Xiaohui
    Yuan, Xiguo
    [J]. DIGITAL SIGNAL PROCESSING, 2022, 126