PROBABILISTIC REASONING FOR STREAMING ANOMALY DETECTION

被引:0
|
作者
Carter, Kevin M. [1 ]
Streilein, William W. [1 ]
机构
[1] MIT, Lincoln Lab, Lexington, MA 02420 USA
关键词
Anomaly detection; predictive models; time series analysis; statistical learning; information security; CHART;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In many applications it is necessary to determine whether an observation from an incoming high-volume data stream matches expectations or is anomalous. A common method for performing this task is to use an Exponentially Weighted Moving Average (EWMA), which smooths out the minor variations of the data stream. While EWMA is efficient at processing high-rate streams, it can be very volatile to abrupt transient changes in the data, losing utility for appropriately detecting anomalies. In this paper we present a probabilistic approach to EWMA which dynamically adapts the weighting based on the observation probability. This results in robustness to data anomalies yet quick adaptability to distributional data shifts.
引用
收藏
页码:377 / 380
页数:4
相关论文
共 50 条
  • [31] Network Anomaly Detection Based on Probabilistic Analysis
    Park, JinSoo
    Choi, Dong Hag
    Jeon, You-Boo
    Min, Se Dong
    Park, Doo-Soon
    ADVANCES IN COMPUTER SCIENCE AND UBIQUITOUS COMPUTING, 2017, 421 : 699 - 704
  • [32] Probabilistic Anomaly Detection for Wireless Sensor Networks
    Farruggia, Alfonso
    Lo Re, Giuseppe
    Ortolani, Marco
    AI(STAR)IA 2011: ARTIFICIAL INTELLIGENCE AROUND MAN AND BEYOND, 2011, 6934 : 438 - 444
  • [33] Streaming-Based Anomaly Detection in ITS Messages
    Moso, Juliet Chebet
    Cormier, Stephane
    de Runz, Cyril
    Fouchal, Hacene
    Wandeto, John Mwangi
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [34] Intuitionistic fuzzy reasoning method in traffic anomaly detection
    Air and Missile Defense College, Air Force Engineering University, Xi'an
    710051, China
    Dianzi Yu Xinxi Xuebao, 9 (2218-2224): : 2218 - 2224
  • [35] Adaptive Cluster Tendency Visualization and Anomaly Detection for Streaming Data
    Kumar, Dheeraj
    Bezdek, James C.
    Rajasegarar, Sutharshan
    Palaniswami, Marimuthu
    Leckie, Christopher
    Chan, Jeffrey
    Gubbi, Jayavardhana
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2016, 11 (02)
  • [36] Anomaly and Degradation Detection Using Subspace Tracking in Streaming Data
    Cha, Kyungduck
    Sadek, Carol
    Asgharzadeh, Zohreh
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3476 - 3481
  • [37] Anomaly Detection in Streaming Time Series Based on Bounding Boxes
    Sanchez, Heider
    Bustos, Benjamin
    SIMILARITY SEARCH AND APPLICATIONS, 2014, 8821 : 201 - 213
  • [38] Anomaly Detection and Classification in Streaming PMU Data in Smart Grids
    Amutha A.L.
    Annie Uthra R.
    Preetha Roselyn J.
    Golda Brunet R.
    Computer Systems Science and Engineering, 2023, 46 (03): : 3387 - 3401
  • [39] Anomaly Detection for Streaming Data from Wearable Sensor Network
    Wang, Peipei
    Han, Yutong
    Qin, Jing
    Wang, Bin
    Yang, Xiaochun
    2017 IEEE 15TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 15TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 3RD INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS(DASC/PICOM/DATACOM/CYBERSCI, 2017, : 263 - 268
  • [40] ANOMALY DETECTION AND IDENTIFICATION USING VISUAL TECHNIQUES IN STREAMING VIDEO
    Wanigaaratchi, T. A.
    Vidanagama, V. G. T. N.
    2020 11TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2020, : 45 - 51