An efficient approach for outlier detection in big sensor data of health care

被引:24
|
作者
Saneja, Bharti [1 ]
Rani, Rinkle [1 ]
机构
[1] Thapar Univ, Patiala, Punjab, India
关键词
big data; correlation; outlier detection; prediction; wireless sensor networks; ANOMALY DETECTION;
D O I
10.1002/dac.3352
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, wireless sensor networks are pervasive and are generating tons of data every second. Performing outlier detection to detect faulty sensors from such a large amount of data becomes a challenging task. Most of the existing techniques for outlier detection in wireless sensor networks concentrate only on contents of the data source without considering correlation among different data attributes. Moreover, these methods are not scalable to big data. To address these 2 limitations, this paper proposes an outlier detection approach based on correlation and dynamic SMO (sequential minimal optimization) regression that is scalable to big data. Initially, correlation is used to find out strongly correlated attributes and then the point anomalous nodes are detected using dynamic SMO regression. For fast processing of big data, Hadoop MapReduce framework is used. The experimental analysis demonstrates that the proposed approach efficiently detects the point and contextual anomalies and reduces the number of false alarms. For experiments, real data of sensors used in body sensor networks are taken from Physionet database.
引用
下载
收藏
页数:10
相关论文
共 50 条
  • [11] A Hybrid Approach for Big Data Outlier Detection from Electric Power SCADA System
    Alves, W.
    Martins, D.
    Bezerra, U.
    Klautau, A.
    IEEE LATIN AMERICA TRANSACTIONS, 2017, 15 (01) : 57 - 64
  • [12] A Review of Local Outlier Factor Algorithms for Outlier Detection in Big Data Streams
    Alghushairy, Omar
    Alsini, Raed
    Soule, Terence
    Ma, Xiaogang
    BIG DATA AND COGNITIVE COMPUTING, 2021, 5 (01) : 1 - 24
  • [13] Big Data Outlier Detection Algorithm Based on Grid
    Guo Wei-Wei
    Liu Feng
    2018 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2018), 2018, : 274 - 277
  • [14] Implementation of Infrastructure for Streaming Outlier Detection in Big Data
    Hasani, Zirije
    RECENT ADVANCES IN INFORMATION SYSTEMS AND TECHNOLOGIES, VOL 2, 2017, 570 : 503 - 511
  • [15] Real Time Energy Efficient Approach to Outlier & Event Detection in Wireless Sensor Networks
    Shahid, N.
    Naqvi, I. H.
    Qaisar, S. B.
    2012 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS (IEEE ICCS 2012), 2012, : 162 - 166
  • [16] An Efficient Density-Based Local Outlier Detection Approach for Scattered Data
    Su, Shubin
    Xiao, Limin
    Ruan, Li
    Gu, Fei
    Li, Shupan
    Wang, Zhaokai
    Xu, Rongbin
    IEEE ACCESS, 2019, 7 : 1006 - 1020
  • [17] Efficient duplicate detection approach for high dimensional big data
    Zhu W.
    Yin J.
    Deng Y.
    Long S.
    Qiu S.
    Jisuanji Yanjiu yu Fazhan, 3 (559-570): : 559 - 570
  • [18] A Time Efficient Approach for Detecting Errors in Big Sensor Data on Cloud
    Yang, Chi
    Liu, Chang
    Zhang, Xuyun
    Nepal, Surya
    Chen, Jinjun
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2015, 26 (02) : 329 - 339
  • [19] Influential DMUs and outlier detection in data envelopment analysis with an application to health care
    Bahari, Ali Reza
    Emrouznejad, Ali
    ANNALS OF OPERATIONS RESEARCH, 2014, 223 (01) : 95 - 108
  • [20] Influential DMUs and outlier detection in data envelopment analysis with an application to health care
    Ali Reza Bahari
    Ali Emrouznejad
    Annals of Operations Research, 2014, 223 : 95 - 108