Distributed Storage System for Electric Power Data Based on HBase

被引:0
|
作者
Jiahui Jin [1 ]
Aibo Song [1 ]
Huan Gong [1 ]
Yingying Xue [1 ]
Mingyang Du [1 ]
Fang Dong [1 ]
Junzhou Luo [1 ]
机构
[1] School of Computer Science and Engineering, Southeast University
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
electric power data; HBase; data storage;
D O I
暂无
中图分类号
TM73 [电力系统的调度、管理、通信]; TP333 [存贮器];
学科分类号
摘要
Managing massive electric power data is a typical big data application because electric power systems generate millions or billions of status, debugging, and error records every single day. To guarantee the safety and sustainability of electric power systems, massive electric power data need to be processed and analyzed quickly to make real-time decisions. Traditional solutions typically use relational databases to manage electric power data.However, relational databases cannot efficiently process and analyze massive electric power data when the data size increases significantly. In this paper, we show how electric power data can be managed by using HBase, a distributed database maintained by Apache. Our system consists of clients, HBase database, status monitors, data migration modules, and data fragmentation modules. We evaluate the performance of our system through a series of experiments. We also show how HBase’s parameters can be tuned to improve the efficiency of our system.
引用
收藏
页码:324 / 334
页数:11
相关论文
共 50 条
  • [41] Design of Electric Power Data Management System Based on Hadoop
    Li, Yongheng
    Wang, Yongzhi
    Jin, Liang
    PROCEEDINGS OF THE 2016 4TH INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND INFORMATION TECHNOLOGY APPLICATIONS, 2016, 71 : 1090 - 1093
  • [42] HBaseMQ: A Distributed Message Queuing System on Clouds with HBase
    Zhang, Chen
    Liu, Xue
    2013 PROCEEDINGS IEEE INFOCOM, 2013, : 40 - 44
  • [43] A novel HBase data storage in wireless sensor networks
    Li, Xiang
    Li, Zhuo
    Ma, Xirong
    Liu, Can
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2017,
  • [44] Enhancing data protection with a distributed storage system based on the redundant residue number system
    Gao, Zhen
    Shi, Lu
    Reviriego, Pedro
    WIRELESS NETWORKS, 2024, 30 (06) : 5601 - 5612
  • [45] Control Methods for Power Storage Devices in Distributed Power System
    Owaki, Daiki
    Yukita, Kazuto
    Mastumura, Toshiro
    Goto, Yasuyuki
    Taniguchi, Kazuhiko
    Morita, Hiroshi
    Noritake, Masatoshi
    Hirose, Keiichi
    Miyoshi, Hiroaki
    2017 IEEE INTERNATIONAL TELECOMMUNICATIONS ENERGY CONFERENCE (INTELEC), 2017, : 215 - 219
  • [46] A Scalable Spatio-temporal Data Storage for Intelligent Transportation Systems Based on HBase
    Van Le, Hong
    Takasu, Atsuhiro
    2015 IEEE 18TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, 2015, : 2733 - 2738
  • [47] On construction of a distributed data storage system in cloud
    Chao-Tung Yang
    Wen-Chung Shih
    Chih-Lin Huang
    Fuu-Cheng Jiang
    William Cheng-Chung Chu
    Computing, 2016, 98 : 93 - 118
  • [48] Improved distributed storage system for medical data
    Knoll, P
    Mirzael, S
    Koriska, M
    Koehn, H
    RADIOLOGY, 2000, 217 : 519 - 520
  • [49] dCache, a distributed storage data caching system
    Ernst, M
    Fuhrmann, P
    Gasthuber, M
    Mkrtchyan, T
    Waldman, C
    PROCEEDINGS OF CHEP 2001, 2001, : 241 - 244
  • [50] Bigtable: A distributed storage system for structured data
    Chang, Fay
    Dean, Jeffrey
    Ghemawat, Sanjay
    Hsieh, Wilson C.
    Wallach, Deborah A.
    Burrows, Mike
    Chandra, Tushar
    Fikes, Andrew
    Gruber, Robert E.
    ACM TRANSACTIONS ON COMPUTER SYSTEMS, 2008, 26 (02):