Feedback-Aware Anomaly Detection Through Logs for Large-Scale Software Systems

被引:1
|
作者
HAN Jing [1 ]
JIA Tong [2 ]
WU Yifan [2 ]
HOU Chuanjia [2 ]
LI Ying [2 ]
机构
[1] ZTE Corporation
[2] Peking University
关键词
D O I
暂无
中图分类号
TP311.5 [软件工程];
学科分类号
081202 ; 0835 ;
摘要
One particular challenge for large-scale software systems is anomaly detection.System logs are a straightforward and common source of information for anomaly detection.Existing log-based anomaly detectors are unusable in real-world industrial systems due to high false-positive rates.In this paper,we incorporate human feedback to adjust the detection model structure to reduce false positives.We apply our approach to two industrial large-scale systems.Results have shown that our approach performs much better than state-of-the-art works with 50% higher accuracy.Besides,human feedback can reduce more than 70% of false positives and greatly improve detection precision.
引用
收藏
页码:88 / 94
页数:7
相关论文
共 50 条
  • [21] Robust Anomaly Detection for Large-Scale Sensor Data
    Chakrabarti, Aniket
    Marwah, Manish
    Arlitt, Martin
    [J]. BUILDSYS'16: PROCEEDINGS OF THE 3RD ACM CONFERENCE ON SYSTEMS FOR ENERGY-EFFCIENT BUILT ENVIRONMENTS, 2016, : 31 - 40
  • [22] Anomaly detection in large-scale data stream networks
    Duc-Son Pham
    Venkatesh, Svetha
    Lazarescu, Mihai
    Budhaditya, Saha
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 28 (01) : 145 - 189
  • [23] Anomaly detection in large-scale data stream networks
    Duc-Son Pham
    Svetha Venkatesh
    Mihai Lazarescu
    Saha Budhaditya
    [J]. Data Mining and Knowledge Discovery, 2014, 28 : 145 - 189
  • [24] Spatiotemporal Anomaly Detection for Large-Scale Sensor Data
    Zhao, Minglu
    Takizawa, Hiroyuki
    Soma, Tomoya
    [J]. PAAP 2021: 2021 12TH INTERNATIONAL SYMPOSIUM ON PARALLEL ARCHITECTURES, ALGORITHMS AND PROGRAMMING, 2021, : 162 - 168
  • [25] Log Anomaly Detection Through GPT-2 for Large Scale Systems
    JI Yuhe
    HAN Jing
    ZHAO Yongxin
    ZHANG Shenglin
    GONG Zican
    [J]. ZTE Communications, 2023, 21 (03) : 70 - 76
  • [26] The complexity nature of large-scale software systems
    Yan Dong
    Qi Guo-Ning
    Gu Xin-Jian
    [J]. CHINESE PHYSICS, 2006, 15 (11): : 2489 - 2495
  • [27] Architectural Complexity of Large-Scale Software Systems
    Lilienthal, Carola
    [J]. 13TH EUROPEAN CONFERENCE ON SOFTWARE MAINTENANCE AND REENGINEERING: CSMR 2009, PROCEEDINGS, 2009, : 17 - 26
  • [28] Cooperative work in large-scale software systems
    Belkhatir, N
    Estublier, J
    Melo, WL
    [J]. JOURNAL OF SOFTWARE MAINTENANCE-RESEARCH AND PRACTICE, 1994, 6 (06): : 319 - 335
  • [29] ACHIEVING RELIABILITY IN LARGE-SCALE SOFTWARE SYSTEMS
    SCHICK, GJ
    WOLVERTON, RW
    [J]. PROCEEDINGS ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM, 1974, 7 (02): : 302 - 319
  • [30] Load Testing Large-Scale Software Systems
    Jiang, Zhen Ming
    [J]. 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, Vol 2, 2015, : 955 - 956