DISTRIBUTED STORAGE OF NETWORK MEASUREMENT DATA ON HBASE

被引:0
|
作者
Ding, Haijie [1 ]
Jin, Yuehui [1 ]
Cui, Yidong [2 ]
Yang, Tan [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing Key Lab Netwok & Switching Technol, Beijing, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Software Engn, Beijing, Peoples R China
关键词
Network measurement; Cloud computing Hadoop; HBase; Distributed data storage;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As traditional network measurement systems store data in relational databases, the storage capacity and computing resource are limited, besides, the extendibility and elasticity are low. The centralized storage scheme will not meet the needs of big data analysis as the data is growing rapidly and continuously. In this paper, we adopt Hadoop and HBase-open source Cloud Computing Frameworks to store network measurement data of non-realtime and realtime applications. The distributed storage scheme is designed to meet the performance demands of storage capacity and computing resource for the mass data.
引用
收藏
页码:716 / 720
页数:5
相关论文
共 50 条
  • [41] The Design of Satellite Telemetry Data Storage and Analysis Software based on HBase Database
    Wang, Yuan
    Xiong, Junlin
    Zhang, Yang
    Fang, Xun
    2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [42] Distributed Data Storage with Data Versioning
    Hejtmanek, Lukas
    CESNET CONFERENCE 2006: FIRST CESNET CONFERENCE ON ADVANCED COMMUNICATIONS AND GRIDS, 2006, : 93 - 104
  • [43] Research on massive AIS ship data storage method based on HBase and Elasticsearch
    Ma, Huadong
    Wen, Yubo
    Zhou, Haiying
    Wang, Lei
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 260 - 263
  • [44] Distributed Storage for Data Security
    Bracher, Annina
    Hof, Eran
    Lapidoth, Amos
    2014 IEEE INFORMATION THEORY WORKSHOP (ITW), 2014, : 506 - 510
  • [45] MHBase: A Distributed Real-Time Query Scheme for Meteorological Data Based on HBase
    Ma, Tinghuai
    Xu, Xichao
    Tang, Meili
    Jin, Yuanfeng
    Shen, Wenhai
    FUTURE INTERNET, 2016, 8 (01):
  • [46] Adaptive Data Center Network Traffic Management for Distributed High Speed Storage
    Ray, Madhurima
    Biswas, Joyanta
    Pal, Amitangshu
    Kant, Krishna
    2019 IEEE 44TH LOCAL COMPUTER NETWORKS (LCN) SYMPOSIUM ON EMERGING TOPICS IN NETWORKING (LCN SYMPOSIUM 2019), 2019, : 166 - 174
  • [47] Network Coding for Distributed Data Storage and Continuous Collection in Wireless Sensor Networks
    Wang, Ning
    Lin, Jiaru
    2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31, 2008, : 3414 - 3417
  • [48] Remote Data Checking for Network Coding-based Distributed Storage Systems
    Chen, Bo
    Curtmola, Reza
    Ateniese, Giuseppe
    Burns, Randal
    PROCEEDINGS OF THE 2010 ACM WORKSHOP CLOUD COMPUTING SECURITY WORKSHOP (CCSW'10:), 2010, : 29 - 40
  • [49] Tree-structured Data Regeneration with Network Coding in Distributed Storage Systems
    Li, Jun
    Yang, Shuang
    Wang, Xin
    Xue, Xiangyang
    Li, Baochun
    IWQOS: 2009 IEEE 17TH INTERNATIONAL WORKSHOP ON QUALITY OF SERVICE, 2009, : 19 - +
  • [50] The Dawn of Big Data - Hbase
    Bhupathiraju, Vijayalakshmi
    Ravuri, Ravi Prasad
    2014 CONFERENCE ON IT IN BUSINESS, INDUSTRY AND GOVERNMENT (CSIBIG), 2014,