Deep Neural Network Based Log Analysis

被引:0
|
作者
Ketmen, Hasan Burak [1 ]
Bulut, Baris [1 ]
机构
[1] Enforma Bilisim AS, Istanbul, Turkey
关键词
DevOps; Jenkins; log analysis; natural language sequence; Bidirectional Long Short Term Memory;
D O I
10.1109/SIU53274.2021.9477836
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Today, the logs of the services running on virtual and real servers provide us with data from which statistical inferences can be made about the service itself and the ecosystem it is in, if it is analyzed. The usage purposes of the tools used in DevOps, the content of the logs they produce, the way they are stored and the frequency of reproduction may vary. Creating metrics by analyzing logs and taking necessary actions on metrics can potentially increase productivity when the hurdles such as fragmentation of unstructured data, processing of data and processing of data are overcome. In this study, it is shown that the logs can be modeled as a natural language sequence in order that the necessary actions be taken, and it is possible to classify the process logs of Jenkins, which is one of the services used in DevOps, by using the Bidirectional Long Short-Term Memory method, with high accuracy and Cohen's Kappa score.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Log-sum enhanced sparse deep neural network
    Qiao, Chen
    Shi, Yan
    Diao, Yu-Xian
    Calhoun, Vince D.
    Wang, Yu-Ping
    [J]. NEUROCOMPUTING, 2020, 407 : 206 - 220
  • [2] Text Coherence Analysis Based on Deep Neural Network
    Cui, Baiyun
    Li, Yingming
    Zhang, Yaqing
    Zhang, Zhongfei
    [J]. CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, : 2027 - 2030
  • [3] Retinopathy Analysis Based on Deep Convolution Neural Network
    Hatanaka, Yuji
    [J]. DEEP LEARNING IN MEDICAL IMAGE ANALYSIS: CHALLENGES AND APPLICATIONS, 2020, 1213 : 107 - 120
  • [4] Fault Localization Analysis Based on Deep Neural Network
    Zheng, Wei
    Hu, Desheng
    Wang, Jing
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2016, 2016
  • [5] Gradient-Free Neural Network Training Based on Deep Dictionary Learning with the Log Regularizer
    Xie, Ying
    Li, Zhenni
    Zhao, Haoli
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PT IV, 2021, 13022 : 561 - 574
  • [6] Negative Log Likelihood Ratio Loss for Deep Neural Network Classification
    Yao, Hengshuai
    Zhu, Dong-lai
    Jiang, Bei
    Yu, Peng
    [J]. PROCEEDINGS OF THE FUTURE TECHNOLOGIES CONFERENCE (FTC) 2019, VOL 1, 2020, 1069 : 276 - 282
  • [7] Recurrent Neural Network Architecture for Communication Log Analysis
    Kumar, Swaraj
    Murgai, Vishal
    Singh, Devashish
    Kommeneni, Issaac
    [J]. 2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022, : 503 - 508
  • [8] Log facies recognition based on convolutional neural network
    He, Xu
    Li, Zhongwei
    Liu, Xin
    Zhang, Tao
    [J]. Shiyou Diqiu Wuli Kantan/Oil Geophysical Prospecting, 2019, 54 (05): : 1159 - 1165
  • [9] Prediction and Analysis of Artwork Price Based on Deep Neural Network
    Liu, Chen
    [J]. SCIENTIFIC PROGRAMMING, 2022, 2022
  • [10] Analysis of Deep Neural Network based Road Distance Estimation
    Moon, Jinsoo
    Lee, Sanghwan
    [J]. 38TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN 2024, 2024, : 637 - 640