DISTRIBUTED STORAGE OF NETWORK MEASUREMENT DATA ON HBASE

被引:0
|
作者
Ding, Haijie [1 ]
Jin, Yuehui [1 ]
Cui, Yidong [2 ]
Yang, Tan [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing Key Lab Netwok & Switching Technol, Beijing, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Software Engn, Beijing, Peoples R China
关键词
Network measurement; Cloud computing Hadoop; HBase; Distributed data storage;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As traditional network measurement systems store data in relational databases, the storage capacity and computing resource are limited, besides, the extendibility and elasticity are low. The centralized storage scheme will not meet the needs of big data analysis as the data is growing rapidly and continuously. In this paper, we adopt Hadoop and HBase-open source Cloud Computing Frameworks to store network measurement data of non-realtime and realtime applications. The distributed storage scheme is designed to meet the performance demands of storage capacity and computing resource for the mass data.
引用
收藏
页码:716 / 720
页数:5
相关论文
共 50 条
  • [31] Application and Research of Massive Big Data Storage System Based on HBase
    Pan Zhengjun
    Zhao Lianfen
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2018, : 219 - 223
  • [32] Performance Evaluation of MongoDB, Cassandra, and HBase for Heterogenous IoT Data Storage
    Pramukantoro, Eko Sakti
    Kartikasari, Dany Primanita
    Siregar, Reza Andria
    2019 2ND INTERNATIONAL CONFERENCE ON APPLIED INFORMATION TECHNOLOGY AND INNOVATION (ICAITI2019), 2019, : 203 - 206
  • [33] HBase/Phoenix-based Data Collection and Storage for the ATLAS EventIndex
    Montoro, Carlos Garcia
    Sanchez, Javier
    Barberis, Dario
    de la Hoz, Santiago Gonzalez
    Salt, Jose
    26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023, 2024, 295
  • [34] A Blockchain-Based Distributed Storage Network to Manage Growing Data Storage Needs
    Kanade, Vijay A.
    ICSPC'21: 2021 3RD INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION (ICPSC), 2021, : 365 - 368
  • [35] Distributed data storage
    Withington, JK
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XIII, 2004, 314 : 66 - 69
  • [36] Design and optimization of spatial vector data storage model based on HBase
    Xie P.
    Yang C.
    Xiong S.
    He L.
    Zhou X.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2020, 49 (10): : 1365 - 1373
  • [37] Distributed Data Centric Similarity Storage Scheme in Wireless Sensor Network
    Ahmed, Khandakar
    Gregory, Mark A.
    2014 IEEE 11TH CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE (CCNC), 2014,
  • [38] Beyond the storage area network: Data intensive computing in a distributed environment
    Duffy, D
    Acks, N
    Noga, V
    Schardt, T
    Gary, JP
    Fink, B
    Kobler, B
    Donovan, M
    McElvaney, J
    Twenty-Second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies, Proceedings: INFORMATION RETRIEVAL FROM VERY LARGE STORAGE SYSTEMS, 2005, : 232 - 236
  • [40] Distributed Object Storage toward Storage and Usage of Packet Data in a High-speed Network
    Tamura, Masahisa
    Iizawa, Ken
    Maeda, Munenori
    Kato, Jun
    Kumano, Tatsuo
    Nomura, Yuji
    Ozawa, Toshihiro
    2014 16TH ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2014,