Distributed Storage System for Electric Power Data Based on HBase

被引:0
|
作者
Jiahui Jin [1 ]
Aibo Song [1 ]
Huan Gong [1 ]
Yingying Xue [1 ]
Mingyang Du [1 ]
Fang Dong [1 ]
Junzhou Luo [1 ]
机构
[1] School of Computer Science and Engineering, Southeast University
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
electric power data; HBase; data storage;
D O I
暂无
中图分类号
TM73 [电力系统的调度、管理、通信]; TP333 [存贮器];
学科分类号
摘要
Managing massive electric power data is a typical big data application because electric power systems generate millions or billions of status, debugging, and error records every single day. To guarantee the safety and sustainability of electric power systems, massive electric power data need to be processed and analyzed quickly to make real-time decisions. Traditional solutions typically use relational databases to manage electric power data.However, relational databases cannot efficiently process and analyze massive electric power data when the data size increases significantly. In this paper, we show how electric power data can be managed by using HBase, a distributed database maintained by Apache. Our system consists of clients, HBase database, status monitors, data migration modules, and data fragmentation modules. We evaluate the performance of our system through a series of experiments. We also show how HBase’s parameters can be tuned to improve the efficiency of our system.
引用
收藏
页码:324 / 334
页数:11
相关论文
共 50 条
  • [1] Distributed Storage System for Electric Power Data Based on HBase
    Jin, Jiahui
    Song, Aibo
    Gong, Huan
    Xue, Yingying
    Du, Mingyang
    Dong, Fang
    Luo, Junzhou
    BIG DATA MINING AND ANALYTICS, 2018, 1 (04): : 324 - 335
  • [2] Distributed Storage and Index of Vector Spatial Data Based on HBase
    Wang, Lin
    Chen, Bin
    Liu, Yuehu
    2013 21ST INTERNATIONAL CONFERENCE ON GEOINFORMATICS (GEOINFORMATICS), 2013,
  • [3] DISTRIBUTED STORAGE OF NETWORK MEASUREMENT DATA ON HBASE
    Ding, Haijie
    Jin, Yuehui
    Cui, Yidong
    Yang, Tan
    2012 IEEE 2ND INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENT SYSTEMS (CCIS) VOLS 1-3, 2012, : 716 - 720
  • [4] An HBase-Based Optimization Model for Distributed Medical Data Storage and Retrieval
    Zhu, Chengzhang
    Liu, Zixi
    Zou, Beiji
    Xiao, Yalong
    Zeng, Meng
    Wang, Han
    Fan, Ziang
    ELECTRONICS, 2023, 12 (04)
  • [5] A Distributed RDF Storage and Query Model Based on HBase
    Li, Keran
    Wu, Bin
    Wang, Bai
    WEB-AGE INFORMATION MANAGEMENT, WAIM 2015, 2015, 9391 : 3 - 15
  • [6] Application and Research of Massive Big Data Storage System Based on HBase
    Pan Zhengjun
    Zhao Lianfen
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2018, : 219 - 223
  • [7] A Distributed Storage Model for Healthcare Big Data Designed on HBase
    Zhang, Lu
    Li, Qi
    Li, Ye
    Cai, Yunpeng
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 4101 - 4105
  • [8] Geospatial data storage based on HBase and MapReduce
    Gao, Fan
    Yue, Peng
    Wu, Zhaoyan
    Zhang, Mingda
    2017 6TH INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS, 2017, : 55 - 58
  • [9] An agricultural data storage mechanism based on HBase
    Li C.
    Zhang Q.
    He P.
    Wang Z.
    Chen L.
    International Journal of Information and Communication Technology, 2019, 14 (04) : 456 - 469
  • [10] Integrated automation system for electric power dispatching based on data storage
    Wang, Weiguo
    Zeng, Weimin
    Dai, Wei
    Wan, Lei
    Che, Fangyi
    Zhang, Xiao
    Yang, Li
    2003, Automation of Electric Power Systems Press (27):