Research on the Storage of Large-Scale Insulator Leakage Current Data Based on Hadoop

被引:0
|
作者
Song, Yaqi [1 ]
Li, Li [1 ]
机构
[1] North China Elect Power Univ Baoding, Dept Comp Sci, Baoding, Hebei, Peoples R China
关键词
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the smart grid environment, huge volumes of data will be accumulated from the condition monitoring system of power equipment. Apache Hadoop platform is designed with high reliability and large data processing capability to meet the needs of data-intensive applications. In this paper, a Hadoop cluster is created which contains 19 nodes and is benchmarked. A case-study on distributed storage of insulator leakage current data is presented which is a useful attempt of building smart grid information platform using cloud computing technology. Our results indicate that the Hadoop and Hbase provide sufficiently high performance characteristics with regard to storage capacity, latency and throughput, and can meet the requirements of the smart grid environment.
引用
收藏
页码:229 / 235
页数:7
相关论文
共 50 条
  • [1] Large Scale Data Storage and Processing of Insulator Leakage Current Using HBase and MapReduce
    Song, Yaqi
    Zhu, Yongli
    Li, Li
    [J]. 2014 INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY (POWERCON), 2014, : 1331 - 1337
  • [2] Research on Insulator Leakage Current Data Analysis Based on DBClustering
    Wang, Baoyi
    Lv, Chenjing
    Zhang, Shaomin
    [J]. PROCEEDINGS OF THE 2016 4TH INTERNATIONAL CONFERENCE ON ELECTRICAL & ELECTRONICS ENGINEERING AND COMPUTER SCIENCE (ICEEECS 2016), 2016, 50 : 781 - 787
  • [3] Towards a framework for large-scale multimedia data storage and processing on Hadoop platform
    Lai, Wei Kuang
    Chen, Yi-Uan
    Wu, Tin-Yu
    Obaidat, Mohammad S.
    [J]. JOURNAL OF SUPERCOMPUTING, 2014, 68 (01): : 488 - 507
  • [4] Towards a framework for large-scale multimedia data storage and processing on Hadoop platform
    Wei Kuang Lai
    Yi-Uan Chen
    Tin-Yu Wu
    Mohammad S. Obaidat
    [J]. The Journal of Supercomputing, 2014, 68 : 488 - 507
  • [5] Hadoop-HBase for Large-Scale Data
    Vora, Mehul Nalin
    [J]. 2011 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), VOLS 1-4, 2012, : 601 - 605
  • [6] A Hadoop-Based Output Analyzer for Large-Scale Simulation Data
    Lee, Kangsun
    Park, Joonho
    [J]. 2014 IEEE FOURTH INTERNATIONAL CONFERENCE ON BIG DATA AND CLOUD COMPUTING (BDCLOUD), 2014, : 197 - 200
  • [7] Fractal-based Insulator Leakage Current Data Compression Research
    Zhai, Xueming
    Tang, Zhuliang
    [J]. 2012 2ND INTERNATIONAL CONFERENCE ON APPLIED ROBOTICS FOR THE POWER INDUSTRY (CARPI), 2012, : 220 - 224
  • [8] An Efficient Hadoop-Based Framework for Data Storage and Fault Recovering in Large-Scale Multimedia Sensor Networks
    Saad, Ghina
    Harb, Hassan
    Abouaissa, Abdelhafid
    Idoumghar, Lhassane
    Charara, Nour
    [J]. 2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 316 - 321
  • [9] Research on Database Storage of Large-scale Terrestrial LIDAR Data
    Guo Ming
    Wang Yanmin
    Zhao Youshan
    Zhou Junzhao
    [J]. 2009 INTERNATIONAL FORUM ON COMPUTER SCIENCE-TECHNOLOGY AND APPLICATIONS, VOL 2, PROCEEDINGS, 2009, : 19 - +
  • [10] BioPig: a Hadoop-based analytic toolkit for large-scale sequence data
    Nordberg, Henrik
    Bhatia, Karan
    Wang, Kai
    Wang, Zhong
    [J]. BIOINFORMATICS, 2013, 29 (23) : 3014 - 3019