An efficient approach for outlier detection in big sensor data of health care

被引:24
|
作者
Saneja, Bharti [1 ]
Rani, Rinkle [1 ]
机构
[1] Thapar Univ, Patiala, Punjab, India
关键词
big data; correlation; outlier detection; prediction; wireless sensor networks; ANOMALY DETECTION;
D O I
10.1002/dac.3352
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, wireless sensor networks are pervasive and are generating tons of data every second. Performing outlier detection to detect faulty sensors from such a large amount of data becomes a challenging task. Most of the existing techniques for outlier detection in wireless sensor networks concentrate only on contents of the data source without considering correlation among different data attributes. Moreover, these methods are not scalable to big data. To address these 2 limitations, this paper proposes an outlier detection approach based on correlation and dynamic SMO (sequential minimal optimization) regression that is scalable to big data. Initially, correlation is used to find out strongly correlated attributes and then the point anomalous nodes are detected using dynamic SMO regression. For fast processing of big data, Hadoop MapReduce framework is used. The experimental analysis demonstrates that the proposed approach efficiently detects the point and contextual anomalies and reduces the number of false alarms. For experiments, real data of sensors used in body sensor networks are taken from Physionet database.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] A Hybrid Outlier Detection Method for Health Care Big Data
    Yan, Ke
    You, Xiaoming
    Ji, Xiaobo
    Yin, Guangqiang
    Yang, Fan
    [J]. PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCES ON BIG DATA AND CLOUD COMPUTING (BDCLOUD 2016) SOCIAL COMPUTING AND NETWORKING (SOCIALCOM 2016) SUSTAINABLE COMPUTING AND COMMUNICATIONS (SUSTAINCOM 2016) (BDCLOUD-SOCIALCOM-SUSTAINCOM 2016), 2016, : 157 - 162
  • [2] An Efficient Outlier Detection Approach for Streaming Sensor Data Based on Neighbor Difference and Clustering
    Cai, Saihua
    Chen, Jinfu
    Yin, Baoquan
    Sun, Ruizhi
    Zhang, Chi
    Chen, Haibo
    Chen, Jingyi
    Lin, Min
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
  • [3] A Hybrid Approach for Outlier Detection in Weather Sensor Data
    Saneja, Bharti
    Rani, Rinkle
    [J]. PROCEEDINGS OF THE 2018 IEEE 8TH INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC 2018), 2018, : 321 - 326
  • [4] An Efficient Approach for Outlier Detection with Imperfect Data Labels
    Liu, Bo
    Xiao, Yanshan
    Yu, Philip S.
    Hao, Zhifeng
    Cao, Longbing
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (07) : 1602 - 1616
  • [5] Outlier Detection Technique for IoT Sensor-Driven Big Data Systems
    Seo, Sunho
    Chung, Jong-Moon
    [J]. 2019 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2019, : 447 - 448
  • [6] An efficient algorithm for distributed density-based outlier detection on big data
    Bai, Mei
    Wang, Xite
    Xin, Junchang
    Wang, Guoren
    [J]. NEUROCOMPUTING, 2016, 181 : 19 - 28
  • [7] Distributed Local Outlier Detection in Big Data
    Yan, Yizhou
    Cao, Lei
    Kuhlman, Caitlin
    Rundensteiner, Elke
    [J]. KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 1225 - 1234
  • [8] Hephaistos: A fast and distributed outlier detection approach for big mixed attribute data
    Du, Haizhou
    Fang, Wei
    Wang, Yi
    [J]. INTELLIGENT DATA ANALYSIS, 2019, 23 (04) : 759 - 778
  • [9] Efficient Detection of Environmental Violators: A Big Data Approach
    Chang, Xiangyu
    Huang, Yinghui
    Li, Mei
    Bo, Xin
    Kumar, Subodha
    [J]. PRODUCTION AND OPERATIONS MANAGEMENT, 2021, 30 (05) : 1246 - 1270
  • [10] An Adaptive Outlier Detection and Processing Approach Towards Time Series Sensor Data
    Zhang, Minghu
    Li, Xin
    Wang, Lili
    [J]. IEEE ACCESS, 2019, 7 : 175192 - 175212