UiLog: Improving Log-Based Fault Diagnosis by Log Analysis

被引:31
|
作者
Zou, De-Qing [1 ]
Qin, Hao
Jin, Hai
机构
[1] Huazhong Univ Sci & Technol, Serv Comp Technol & Syst Lab, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
fault diagnosis; system event log; log classification; fault correlation analysis;
D O I
10.1007/s11390-016-1678-7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In modern computer systems, system event logs have always been the primary source for checking system status. As computer systems become more and more complex, the interaction between software and hardware increases frequently. The components will generate enormous log information, including running reports and fault information. The sheer quantity of data is a great challenge for analysis relying on the manual method. In this paper, we implement a management and analysis system of log information, which can assist system administrators to understand the real-time status of the entire system, classify logs into different fault types, and determine the root cause of the faults. In addition, we improve the existing fault correlation analysis method based on the results of system log classification. We apply the system in a cloud computing environment for evaluation. The results show that our system can classify fault logs automatically and effectively. With the proposed system, administrators can easily detect the root cause of faults.
引用
收藏
页码:1038 / 1052
页数:15
相关论文
共 50 条
  • [21] A Search Log-Based Approach to Evaluation
    Zhang, Junte
    Kamps, Jaap
    RESEARCH AND ADVANCED TECHNOLOGY FOR DIGITAL LIBRARIES, 2010, 6273 : 248 - 260
  • [22] Log-based transactional workflow mining
    Gaaloul, Walid
    Gaaloul, Khaled
    Bhiri, Sami
    Haller, Armin
    Hauswirth, Manfred
    DISTRIBUTED AND PARALLEL DATABASES, 2009, 25 (03) : 193 - 240
  • [23] Log-Based Simplification of Process Models
    De San Pedro, Javier
    Carmona, Josep
    Cortadella, Jordi
    BUSINESS PROCESS MANAGEMENT, BPM 2015, 2015, 9253 : 457 - 474
  • [24] LogTM: Log-based transactional memory
    Moore, Kevin E.
    Bobba, Jayararn
    Moravan, Michelle J.
    Hill, Mark D.
    Wood, David A.
    TWELFTH INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE COMPUTER ARCHITECTURE, PROCEEDINGS, 2006, : 258 - +
  • [25] Log-based Intrusion Detection for MANET
    Alattar, Mouhannad
    Sailhan, Francoise
    Bourgeois, Julien
    2012 8TH INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING CONFERENCE (IWCMC), 2012, : 697 - 702
  • [26] LOGAN: Problem Diagnosis in the Cloud Using Log-based Reference Models
    Tak, Byung Chul
    Tao, Shu
    Yang, Lin
    Zhu, Chao
    Ruan, Yaoping
    PROCEEDINGS 2016 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E), 2016, : 62 - 67
  • [27] ASGNet: Adaptive Semantic Gate Networks for Log-Based Anomaly Diagnosis
    Yang, Haitian
    Sun, Degang
    Liu, Wen
    Li, Yanshu
    Wang, Yan
    Huang, Weiqing
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT IV, 2024, 14450 : 200 - 212
  • [28] Falcon: A Practical Log-based Analysis Tool for Distributed Systems
    Neves, Francisco
    Machado, Nuno
    Pereira, Jose
    2018 48TH ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS (DSN), 2018, : 534 - 541
  • [29] Improving Log-Based Field Failure Data Analysis of Multi-Node Computing Systems
    Pecchia, Antonio
    Cotroneo, Domenico
    Kalbarczyk, Zbigniew
    Iyer, Ravishankar K.
    2011 IEEE/IFIP 41ST INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS (DSN), 2011, : 97 - 108
  • [30] DSGN: Log-based anomaly diagnosis with dynamic semantic gate networks
    Yang, Haitian
    Sun, Degang
    Wang, Yan
    Huang, Weiqing
    INFORMATION SCIENCES, 2024, 680