UiLog: Improving Log-Based Fault Diagnosis by Log Analysis

被引:31
|
作者
Zou, De-Qing [1 ]
Qin, Hao
Jin, Hai
机构
[1] Huazhong Univ Sci & Technol, Serv Comp Technol & Syst Lab, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
fault diagnosis; system event log; log classification; fault correlation analysis;
D O I
10.1007/s11390-016-1678-7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In modern computer systems, system event logs have always been the primary source for checking system status. As computer systems become more and more complex, the interaction between software and hardware increases frequently. The components will generate enormous log information, including running reports and fault information. The sheer quantity of data is a great challenge for analysis relying on the manual method. In this paper, we implement a management and analysis system of log information, which can assist system administrators to understand the real-time status of the entire system, classify logs into different fault types, and determine the root cause of the faults. In addition, we improve the existing fault correlation analysis method based on the results of system log classification. We apply the system in a cloud computing environment for evaluation. The results show that our system can classify fault logs automatically and effectively. With the proposed system, administrators can easily detect the root cause of faults.
引用
收藏
页码:1038 / 1052
页数:15
相关论文
共 50 条
  • [1] UiLog: Improving Log-Based Fault Diagnosis by Log Analysis
    De-Qing Zou
    Hao Qin
    Hai Jin
    Journal of Computer Science and Technology, 2016, 31 : 1038 - 1052
  • [2] Log-Based Fault Localization with Unsupervised Log Segmentation
    Dobrowolski, Wojciech
    Iwach-Kowalski, Kamil
    Nikodem, Maciej
    Unold, Olgierd
    APPLIED SCIENCES-BASEL, 2024, 14 (18):
  • [3] Log-Based OpenStack Fault Diagnosis by Machine Learning
    Zhang, Leyi
    Fan, Lei
    Guo, Naiwang
    3RD ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI2018), 2018, 1069
  • [4] Log-based Service Diagnosis Method in Cloud
    Jia, Zhichun
    Xing, Xing
    2014 INTERNATIONAL CONFERENCE ON MECHATRONICS AND CONTROL (ICMC), 2014, : 1299 - 1303
  • [5] Improving Log-Based Anomaly Detection with Component-Aware Analysis
    Yin, Kun
    Yan, Meng
    Xu, Ling
    Xu, Zhou
    Li, Zhao
    Yang, Dan
    Zhang, Xiaohong
    2020 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION (ICSME 2020), 2020, : 667 - 671
  • [6] Log-Based Testing
    Elyasov, Alexander
    2012 34TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2012, : 1591 - 1594
  • [7] Log-based Anomaly Detection Without Log Parsing
    Van-Hoang Le
    Zhang, Hongyu
    2021 36TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING ASE 2021, 2021, : 492 - 504
  • [8] On the effectiveness of log representation for log-based anomaly detection
    Wu, Xingfang
    Li, Heng
    Khomh, Foutse
    EMPIRICAL SOFTWARE ENGINEERING, 2023, 28 (06)
  • [9] On the effectiveness of log representation for log-based anomaly detection
    Xingfang Wu
    Heng Li
    Foutse Khomh
    Empirical Software Engineering, 2023, 28
  • [10] Leveraging Log Instructions in Log-based Anomaly Detection
    Bogatinovski, Jasmin
    Madjarov, Gjorgji
    Nedelkoski, Sasho
    Cardoso, Jorge
    Kao, Odej
    2022 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (IEEE SCC 2022), 2022, : 321 - 326