Feedback-Aware Anomaly Detection Through Logs for Large-Scale Software Systems

被引:1
|
作者
HAN Jing [1 ]
JIA Tong [2 ]
WU Yifan [2 ]
HOU Chuanjia [2 ]
LI Ying [2 ]
机构
[1] ZTE Corporation
[2] Peking University
关键词
D O I
暂无
中图分类号
TP311.5 [软件工程];
学科分类号
081202 ; 0835 ;
摘要
One particular challenge for large-scale software systems is anomaly detection.System logs are a straightforward and common source of information for anomaly detection.Existing log-based anomaly detectors are unusable in real-world industrial systems due to high false-positive rates.In this paper,we incorporate human feedback to adjust the detection model structure to reduce false positives.We apply our approach to two industrial large-scale systems.Results have shown that our approach performs much better than state-of-the-art works with 50% higher accuracy.Besides,human feedback can reduce more than 70% of false positives and greatly improve detection precision.
引用
收藏
页码:88 / 94
页数:7
相关论文
共 50 条
  • [31] Engineering Large-Scale Observation Software Systems
    Lamb, David
    Randles, Martin
    Taleb-Bendiab, A.
    [J]. 2009 SECOND INTERNATIONAL CONFERENCE ON DEVELOPMENTS IN ESYSTEMS ENGINEERING (DESE 2009), 2009, : 266 - 272
  • [32] Efficient KPI Anomaly Detection Through Transfer Learning for Large-Scale Web Services
    Zhang, Shenglin
    Zhong, Zhenyu
    Li, Dongwen
    Fan, Qiliang
    Sun, Yongqian
    Zhu, Man
    Zhang, Yuzhi
    Pei, Dan
    Sun, Jiyan
    Liu, Yinlong
    Yang, Hui
    Zou, Yongqiang
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (08) : 2440 - 2455
  • [33] Toward Automated Anomaly Identification in Large-Scale Systems
    Lan, Zhiling
    Zheng, Ziming
    Li, Yawei
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2010, 21 (02) : 174 - 187
  • [34] HADES: a Hybrid Anomaly Detection System for Large-Scale Cyber-Physical Systems
    Alwan, Ahmed Abdulhasan
    Ciupala, Mihaela Anca
    Baravalle, Andres
    Falcarin, Paolo
    [J]. 2020 FIFTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), 2020, : 136 - 142
  • [35] A system architecture for real-time anomaly detection in large-scale NFV systems
    Gulenko, Anton
    Wallschlaeger, Marcel
    Schmidt, Florian
    Kao, Odej
    Liu, Feng
    [J]. 11TH INTERNATIONAL CONFERENCE ON FUTURE NETWORKS AND COMMUNICATIONS (FNC 2016) / THE 13TH INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS AND PERVASIVE COMPUTING (MOBISPC 2016) / AFFILIATED WORKSHOPS, 2016, 94 : 491 - 496
  • [36] ADF: An Anomaly Detection Framework for Large-Scale PM2.5 Sensing Systems
    Chen, Ling-Jyh
    Ho, Yao-Hua
    Hsieh, Hsin-Hung
    Huang, Shih-Ting
    Lee, Hu-Cheng
    Mahajan, Sachit
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (02): : 559 - 570
  • [37] Hierarchical Context-Aware Anomaly Diagnosis in Large-Scale PV Systems Using SCADA Data
    Liu, Qi
    Zhao, Yingying
    Zhang, Yawen
    Kang, Dahai
    Lv, Qin
    Shang, Li
    [J]. 2017 IEEE 15TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2017, : 1025 - 1030
  • [38] LogEvent2vec: LogEvent-to-Vector Based Anomaly Detection for Large-Scale Logs in Internet of Things
    Wang, Jin
    Tang, Yangning
    He, Shiming
    Zhao, Changqing
    Sharma, Pradip Kumar
    Alfarraj, Osama
    Tolba, Amr
    [J]. SENSORS, 2020, 20 (09)
  • [39] Fast Mining of Large-Scale Logs for Botnet Detection: A Field Study
    Bottazzi, Giovanni
    Italiano, Giuseppe F.
    [J]. CIT/IUCC/DASC/PICOM 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY - UBIQUITOUS COMPUTING AND COMMUNICATIONS - DEPENDABLE, AUTONOMIC AND SECURE COMPUTING - PERVASIVE INTELLIGENCE AND COMPUTING, 2015, : 1990 - 1997
  • [40] A Fast and Scalable Method for Threat Detection in Large-scale DNS Logs
    Begleiter, Ron
    Elovici, Yuval
    Hollander, Yona
    Mendelson, Ori
    Rokach, Lior
    Saltzman, Roi
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,