Network Alarm Information Analysis - A Hive-based OLAP Method

被引:0
|
作者
Zhang, Dengyin [1 ]
Zhang, Liu [2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Scitech Pk Internet Things, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Elect & Commun Engn, Nanjing, Jiangsu, Peoples R China
关键词
cloud computing; Hive; online analytical processing; network alarm management;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
For network alarm information analysis in the next generation network existing such problems as single dimension, low efficiency, memory overflow or crash, this paper proposes a method for online analytical processing based on Hive. The method first uses HBase to preprocess real-time alarm data, mapping data into Hive, then constructs an N-D cube model. After proving the scientific and operability by cube calculation, is the construction of a star model, as well as customizing dimensions, each dimension with user-defined hierarchies. Finally HQL is used to realize rollup and cube. This new method is available for both situations whether inter domain devices exist or not. It can not only upload large quantities of data, improving performance of upload and analysis, but also discover knowledge of location and meaningful information hidden in massive warnings from multiple dimensions, providing decision support for network management personnel.
引用
收藏
页码:694 / 697
页数:4
相关论文
共 50 条
  • [31] Based on Improved Artificial Neural Network Sewage Monitoring Alarm System Method
    Chen, Liping
    Zhao, Ruichuan
    Wu, Wenzheng
    [J]. SCIENTIFIC PROGRAMMING, 2022, 2022
  • [32] Network Information Security Research based on the Grey Matter Element Analysis Method
    Tian, Qingji
    [J]. INTERNATIONAL JOURNAL OF SECURITY AND ITS APPLICATIONS, 2016, 10 (10): : 107 - 118
  • [33] The Analysis of Measurement Method in the Knowledge System of Network Security Based on Information Entropy
    Qi, Bin
    Wang, Yu
    Zou, Hongxia
    Li, Jixing
    Liu, Sheng-en
    [J]. 2017 17TH IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT 2017), 2017, : 1328 - 1333
  • [34] Analysis and Correction of a Pantograph Location Method Based on Current Information of Traction Network
    Li, Kai
    Zhang, Zhi
    Zhang, Zhibo
    Zheng, Trillion Q.
    Hao, Ruixiang
    You, Xiaojie
    Yang, Jingxi
    [J]. IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2021, 7 (03) : 1858 - 1869
  • [35] Accurate marking method of network attacking information based on big data analysis
    Li Peng
    Min Xiao-cui
    [J]. 2019 INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION, BIG DATA & SMART CITY (ICITBS), 2019, : 228 - 231
  • [36] NetCube: a comprehensive network traffic analysis model based on multidimensional OLAP data cube
    Park, Daihee
    Yu, Jaehak
    Park, Jun-Sang
    Kim, Myung-Sup
    [J]. INTERNATIONAL JOURNAL OF NETWORK MANAGEMENT, 2013, 23 (02) : 101 - 118
  • [37] Intelligent Classification Method for Grid-Monitoring Alarm Messages Based on Information Theory
    Sun, Guoqiang
    Ding, Xiaoliu
    Wei, Zhinong
    Shen, Peifeng
    Zhao, Yang
    Huang, Qiugen
    Zhang, Liang
    Zang, Haixiang
    [J]. ENERGIES, 2019, 12 (14)
  • [38] RETRACTED: Optimization of Substation Alarm Information Processing Based on BP Neural Network (Retracted Article)
    Han, Tuanjun
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
  • [39] Design on Fire Alarm System Based on BP Neural Network and Multiple Source Information Fusion
    Wang, Wei
    Jiang, Bo
    Yang, Li-ping
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON MECHATRONICS, CONTROL AND ELECTRONIC ENGINEERING, 2014, 113 : 99 - 102
  • [40] A Substation Fault Diagnosis Method Based on Substation Alarm Signal Analysis
    Lin, Lingyun
    Chen, Qing
    Wang, Zhe
    Xue, Bing
    Sun, Mengxuan
    [J]. PROCEEDINGS OF 2019 IEEE 3RD INTERNATIONAL ELECTRICAL AND ENERGY CONFERENCE (CIEEC), 2019, : 1603 - 1607