Feedback-Aware Anomaly Detection Through Logs for Large-Scale Software Systems

被引:1
|
作者
HAN Jing [1 ]
JIA Tong [2 ]
WU Yifan [2 ]
HOU Chuanjia [2 ]
LI Ying [2 ]
机构
[1] ZTE Corporation
[2] Peking University
关键词
D O I
暂无
中图分类号
TP311.5 [软件工程];
学科分类号
081202 ; 0835 ;
摘要
One particular challenge for large-scale software systems is anomaly detection.System logs are a straightforward and common source of information for anomaly detection.Existing log-based anomaly detectors are unusable in real-world industrial systems due to high false-positive rates.In this paper,we incorporate human feedback to adjust the detection model structure to reduce false positives.We apply our approach to two industrial large-scale systems.Results have shown that our approach performs much better than state-of-the-art works with 50% higher accuracy.Besides,human feedback can reduce more than 70% of false positives and greatly improve detection precision.
引用
收藏
页码:88 / 94
页数:7
相关论文
共 50 条
  • [1] Incremental Analysis of Large-Scale System Logs for Anomaly Detection
    Astekin, Merve
    Ozcan, Selim
    Sozer, Hasan
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2119 - 2127
  • [2] LogFlash: Real-time Streaming Anomaly Detection and Diagnosis from System Logs for Large-scale Software Systems
    Jia, Tong
    Wu, Yifan
    Hou, Chuanjia
    Li, Ying
    [J]. 2021 IEEE 32ND INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING (ISSRE 2021), 2021, : 80 - 90
  • [3] DILAF: A framework for distributed analysis of large-scale system logs for anomaly detection
    Astekin, Merve
    Zengin, Harun
    Sozer, Hasan
    [J]. SOFTWARE-PRACTICE & EXPERIENCE, 2019, 49 (02): : 153 - 170
  • [4] Execution anomaly detection in large-scale systems through console log analysis
    Bao, Liang
    Li, Qian
    Lu, Peiyao
    Lu, Jie
    Ruan, Tongxiao
    Zhang, Ke
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2018, 143 : 172 - 186
  • [5] Anomaly Detection Algorithms in Logs of Process Aware Systems
    Bezerra, Fabio
    Wainer, Jacques
    [J]. APPLIED COMPUTING 2008, VOLS 1-3, 2008, : 951 - 952
  • [6] Anomaly States Monitoring of Large-Scale Systems with Intellectual Analysis of System Logs
    Sheluhin, Oleg
    Osin, Andrey
    [J]. PROCEEDINGS OF THE 24TH CONFERENCE OF OPEN INNOVATIONS ASSOCIATION (FRUCT), 2019, : 395 - 401
  • [7] Connecting the dots: anomaly and discontinuity detection in large-scale systems
    Malik, Haroon
    Davis, Ian J.
    Godfrey, Michael W.
    Neuse, Douglas
    Manskovskii, Serge
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2016, 7 (04) : 509 - 522
  • [8] Connecting the dots: anomaly and discontinuity detection in large-scale systems
    Haroon Malik
    Ian J. Davis
    Michael W. Godfrey
    Douglas Neuse
    Serge Manskovskii
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2016, 7 : 509 - 522
  • [9] Context-aware, Composable Anomaly Detection in Large-scale Mobile Networks
    Nguyen Ngoc Nhu Trang
    Hong-Linh Truong
    [J]. 2023 IEEE 47TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC, 2023, : 183 - 192
  • [10] Large Scale Anomaly Detection in Data Center Logs and Metrics
    Martinez-Alvarez, Rafael P.
    Giraldo-Rodriguez, Carlos
    Chaves-Dieguez, David
    [J]. ECSA 2018: PROCEEDINGS OF THE 12TH EUROPEAN CONFERENCE ON SOFTWARE ARCHITECTURE: COMPANION PROCEEDINGS, 2018,