Distributed Storage System for Electric Power Data Based on HBase

被引:0
|
作者
Jiahui Jin [1 ]
Aibo Song [1 ]
Huan Gong [1 ]
Yingying Xue [1 ]
Mingyang Du [1 ]
Fang Dong [1 ]
Junzhou Luo [1 ]
机构
[1] School of Computer Science and Engineering, Southeast University
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
electric power data; HBase; data storage;
D O I
暂无
中图分类号
TM73 [电力系统的调度、管理、通信]; TP333 [存贮器];
学科分类号
摘要
Managing massive electric power data is a typical big data application because electric power systems generate millions or billions of status, debugging, and error records every single day. To guarantee the safety and sustainability of electric power systems, massive electric power data need to be processed and analyzed quickly to make real-time decisions. Traditional solutions typically use relational databases to manage electric power data.However, relational databases cannot efficiently process and analyze massive electric power data when the data size increases significantly. In this paper, we show how electric power data can be managed by using HBase, a distributed database maintained by Apache. Our system consists of clients, HBase database, status monitors, data migration modules, and data fragmentation modules. We evaluate the performance of our system through a series of experiments. We also show how HBase’s parameters can be tuned to improve the efficiency of our system.
引用
收藏
页码:324 / 334
页数:11
相关论文
共 50 条
  • [21] Distributed Electronic Data Storage and Proof System Based on Blockchain
    Wang, Jitao
    Sun, Guozi
    Gu, Yu
    Liu, Kun
    BLOCKCHAIN TECHNOLOGY AND APPLICATION: SECOND CCF CHINA BLOCKCHAIN CONFERENCE (CBCC 2019), 2020, 1176 : 48 - 67
  • [22] Research and Implementation of Distributed Storage System Based on Big Data
    Ma, Ke
    PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYSIS (ICBDA), 2016, : 168 - 171
  • [23] Data integrity in a distributed storage system
    Bright, JD
    Chandy, JA
    PDPTA'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-4, 2003, : 688 - 694
  • [24] The Design of Satellite Telemetry Data Storage and Analysis Software based on HBase Database
    Wang, Yuan
    Xiong, Junlin
    Zhang, Yang
    Fang, Xun
    2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [25] Research on massive AIS ship data storage method based on HBase and Elasticsearch
    Ma, Huadong
    Wen, Yubo
    Zhou, Haiying
    Wang, Lei
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 260 - 263
  • [26] The Optimization and Research of Primitive HBase Data Storage Based on Wireless Sensor Network
    Li, Xiang
    Sun, Huazhi
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2018, 423 : 303 - 308
  • [27] Research on Data Query Technology of Hierarchical Storage for Electric Power Dispatching System
    Qiu, Hong-bin
    Hu, Bin
    Zhu, Li-peng
    Zhou, Ai-hua
    Rao, Wei
    2016 CHINA INTERNATIONAL CONFERENCE ON ELECTRICITY DISTRIBUTION (CICED), 2016,
  • [28] HBase System-based Distributed Framework for Searching Large Graph Databases
    Bei, Yijun
    Lin, Zhen
    Zhao, Chen
    Zhu, Xiaojun
    2013 14TH ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD 2013), 2013, : 151 - 156
  • [29] Temporal RDF(S) data storage and query with HBase
    Yan L.
    Zhang Z.
    Yang D.
    Journal of Computing and Information Technology, 2019, 27 (04): : 17 - 30
  • [30] YEfficient Spatial Big Data Storage and Query in HBase
    Wang, Ping
    Xu, Fanhua
    Ma, Meng
    Duan, Lihua
    4TH IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD 2019) / 3RD INTERNATIONAL SYMPOSIUM ON REINFORCEMENT LEARNING (ISRL 2019), 2019, : 149 - 155