Non-parametric sequence-based learning approach for outlier detection in IoT

被引:31
|
作者
Nesa, Nashreen [1 ]
Ghosh, Tania [1 ]
Banerjee, Indrajit [1 ]
机构
[1] Indian Inst Engn Sci & Technol, Dept Informat Technol, Shibpur Howrah 711103, W Bengal, India
关键词
Outlier; Event; Error; IoT; Sequence; CLASSIFICATION; ALGORITHM;
D O I
10.1016/j.future.2017.11.021
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Although study on outlier detection techniques has long been an area of much research, few of those works relate to an Internet of Things (IoT) environment. In the last few years, with the advent of IoT and its numerous smart objects, data generated from sensors have increased exponentially. Since on the basis of these data many critical decisions are taken, it is therefore necessary to absolutely ensure its accuracy, correctness and integrity before any processing starts. Most algorithms in the past assumes outliers to be always an Error, that is caused by a malfunctioning sensor. However, this is not always true because an outlier could also be an important event that should not be neglected. This stresses the need to devise algorithms that is suited for an IoT environment which considers both Error, that is a result of faulty sensors or an Event, which is an indication of an abnormal phenomenon. This paper proposes a sequence based learning approach for outlier detection that works for both Error and Event. Simulations are performed on few benchmark datasets, a medical dataset and a real world dataset obtained through an experimental test bed. The results reveal exceptionally high accuracies with up to 99.65% for Error detection and 98.53% for Event detection. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:412 / 421
页数:10
相关论文
共 50 条
  • [1] Enhanced Non-parametric Sequence-based Learning Algorithm for Outlier Detection in the Internet of Things
    Edje, Abel Efetobor
    Abd Latiff, Shaffie Muhammad
    Chan, Howe Weng
    [J]. NEURAL PROCESSING LETTERS, 2021, 53 (03) : 1889 - 1919
  • [2] Enhanced Non-parametric Sequence-based Learning Algorithm for Outlier Detection in the Internet of Things
    Abel Efetobor Edje
    Shaffie Muhammad Abd Latiff
    Howe Weng Chan
    [J]. Neural Processing Letters, 2021, 53 : 1889 - 1919
  • [3] A parametric and non-parametric approach for high-accurate outlier detection
    Bah M.J.
    Wang H.
    [J]. Journal of Information Science and Engineering, 2020, 36 (02): : 441 - 465
  • [4] A Parametric and Non-Parametric Approach for High-Accurate Outlier Detection
    Bah, Mohamed Jaward
    Wang, Hongzhi
    [J]. JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2020, 36 (02) : 441 - 465
  • [5] Outlier detection in non-parametric profile monitoring
    Wang, Tao
    Wang, Yunlong
    Zang, Qingpei
    [J]. STATISTICS, 2022, 56 (04) : 805 - 822
  • [6] A Non-parametric Approach for Learning from Crowds
    Fu, Jiayi
    Zhong, Jinhong
    Liu, Yunfeng
    Wang, Zhenyu
    Tang, Ke
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 2228 - 2235
  • [7] A non-parametric approach to automatic change detection
    Bruzzone, L
    Cossu, R
    Prieto, DF
    [J]. IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING VI, 2001, 4170 : 133 - 140
  • [8] Novelty detection of rotating machinery using a non-parametric machine learning approach
    Angola, Enrique
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON PROGNOSTICS AND HEALTH MANAGEMENT (ICPHM), 2017, : 48 - 54
  • [9] Efficient non-parametric corner detection: An approach based on small eigenvalue
    Dinesh, R.
    Guru, D. S.
    [J]. FOURTH CANADIAN CONFERENCE ON COMPUTER AND ROBOT VISION, PROCEEDINGS, 2007, : 250 - +
  • [10] Machine Learning based Outlier Detection in IoT Greenhouse
    Abid, Aymen
    Cheikhrouhou, Omar
    Zaibi, Ghada
    Kachouri, Abdennaceur
    [J]. 2024 IEEE 27TH INTERNATIONAL SYMPOSIUM ON REAL-TIME DISTRIBUTED COMPUTING, ISORC 2024, 2024,