Anomaly Detection and Root Cause Analysis on Log Data

被引：0

作者：

Pasha, Daem ^{[1
]}

Shah, Ali Hussain ^{[1
]}

Zadeh, Esmaeil Habib ^{[1
]}

Konur, Savas ^{[1
]}

机构：

[1] Univ Bradford, Dept Comp Sci, Bradford BD7 1DP, W Yorkshire, England

来源：

ARTIFICIAL INTELLIGENCE XXXIX, AI 2022 | 2022年 / 13652卷

基金：

英国工程与自然科学研究理事会; “创新英国”项目;

关键词：

Root cause analysis; Anomaly detection; Log files; Machine learning;

D O I：

10.1007/978-3-031-21441-7_27

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we perform anomaly detection and root cause analysis on log data (system logs). Firstly, we employ a log parsing solution known as Drain (an online log parsing approach with fixed depth tree). We then present an anomaly detection approach that utilizes a decision tree model. This will be used to determine the anomalous devices in the log files. One benefit of decision tree models is that they are easily traceable, providing a contrast to most "black-box" solutions currently available in the industry. Finally, a sequential model using Keras is built to predict the root cause of a given issue.

引用

页码：333 / 339

页数：7

共 50 条

[1] Progressing from Anomaly Detection to Automated Log Labeling and Pioneering Root Cause Analysis
Wittkopp, Thorsten
Acker, Alexander
Kao, Odej
[J]. 2023 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW 2023, 2023, : 1231 - 1239
[2] On Anomaly Detection and Root Cause Analysis of Microservice Systems
Guan, Zijie
Lin, Jinjin
Chen, Pengfei
[J]. SERVICE-ORIENTED COMPUTING, ICSOC 2018, 2019, 11434 : 465 - 469
[3] Anomaly Detection with Root Cause Analysis for Bottling Process
Bator, Martyna
Dicks, Alexander
Deppe, Sahar
Lohweg, Volker
[J]. 2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1619 - 1622
[4] Anomaly Detection for Web Log Data Analysis: A Review
Siwach, Meena
Mann, Suman
[J]. JOURNAL OF ALGEBRAIC STATISTICS, 2022, 13 (01) : 129 - 148
[5] Root-Cause Metric Location for Microservice Systems via Log Anomaly Detection
Wang, Lingzhi
Zhao, Nengwen
Chen, Junjie
Li, Pinnong
Zhang, Wenchi
Sui, Kaixin
[J]. 2020 IEEE 13TH INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS 2020), 2020, : 142 - 150
[6] Unsupervised Anomaly Detection and Root Cause Analysis in Mobile Networks
Kim, Cheolmin
Mendiratta, Veena B.
Thottan, Marina
[J]. 2020 INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS (COMSNETS), 2020,
[7] Anomaly Detection and Root Cause Analysis Enabled by Artificial Intelligence
Yuan, Yannan
Yang, Jiaolong
Duan, Ran
I, Chih-Lin
Huang, Jinri
[J]. 2020 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2020,
[8] Association Rules for Anomaly Detection and Root Cause Analysis in Process Executions
Boehmer, Kristof
Rinderle-Ma, Stefanie
[J]. ADVANCED INFORMATION SYSTEMS ENGINEERING, CAISE 2018, 2018, 10816 : 3 - 18
[9] SENATUS: An Approach to Joint Traffic Anomaly Detection and Root Cause Analysis
Abdelkefi, Atef
Jiang, Yuming
Sharma, Sachin
[J]. 2018 2ND CYBER SECURITY IN NETWORKING CONFERENCE (CSNET), 2018,
[10] Automated Anomaly Detection and Root Cause Analysis in Virtualized Cloud Infrastructures
Lin, Jieyu
Zhang, Qi
Bannazadeh, Hadi
Leon-Garcia, Alberto
[J]. NOMS 2016 - 2016 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, 2016, : 550 - 556

← 1 2 3 4 5 →