Power Big Data platform Based on Hadoop Technology

被引:0
|
作者
Chen, Jilin [1 ]
Liu, Nana [1 ]
Chen, Yong [1 ]
Qiu, Weijiang [1 ]
机构
[1] China Elect Power Res Inst, Beijing 100192, Peoples R China
关键词
Power big data; Hadoop; distributed storage;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The utility industry has entered into big data era as the construction and development of smart grid. It becomes more critical to store and process the big data efficiently, and to make effective utilization when the power big data are massive complicate. This paper analyses the status of power big data. Then, it introduces the main architecture of power big data platform based on Hadoop technology. Several key technologies are analyzed including data storing and processing. Finally, discusses the application of power big data platform based on Hadoop technology
引用
收藏
页码:571 / 576
页数:6
相关论文
共 50 条
  • [31] Analysis of Power Marketing Data Mining Based on the Big Data Technology
    Yu, Jiwen
    Shu, Xiaoxiao
    Shang, Chao
    Liu, Fan
    [J]. PROCEEDINGS OF THE 2017 7TH INTERNATIONAL CONFERENCE ON EDUCATION, MANAGEMENT, COMPUTER AND SOCIETY (EMCS 2017), 2017, 61 : 376 - 380
  • [32] Big Data Security Problem Based on Hadoop Framework
    Samet, Refik
    Aydin, Ayhan
    Toy, Feridun
    [J]. 2019 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ENGINEERING (UBMK), 2019, : 525 - 530
  • [33] Hadoop Based Scalable Cluster Deduplication for Big Data
    Liu, Qing
    Fu, Yinjin
    Ni, Guiqiang
    Hou, Rui
    [J]. 2016 IEEE 36TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW 2016), 2016, : 98 - 105
  • [34] HaoLap: A Hadoop based OLAP system for big data
    Song, Jie
    Guo, Chaopeng
    Wang, Zhi
    Zhang, Yichan
    Yu, Ge
    Pierson, Jean-Marc
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2015, 102 : 167 - 181
  • [35] Big medical data processing system based on hadoop
    Liu, W.
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 181 - 181
  • [36] The Research on Big Data Security Architecture Based on Hadoop
    Zhuang, Miao
    [J]. PROCEEDINGS OF THE 2015 4TH NATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS AND COMPUTER ENGINEERING ( NCEECE 2015), 2016, 47 : 241 - 244
  • [37] Hadoop based Demography Big Data Management System
    Bukhari, Syeda Sana
    Park, JinHyuck
    Shin, Dong Ryeol
    [J]. 2018 19TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD), 2018, : 93 - 98
  • [38] Big Data Management Processing with Hadoop MapReduce and Spark Technology: A Comparison
    Verma, Ankush
    Mansuri, Ashik Hussain
    Jain, Neelesh
    [J]. 2016 SYMPOSIUM ON COLOSSAL DATA ANALYSIS AND NETWORKING (CDAN), 2016,
  • [39] Application and functional simulation of data mining technology in Hadoop cloud platform based on improved algorithm
    Dai, Nina
    [J]. SOFT COMPUTING, 2023, 27 (12) : 8381 - 8389
  • [40] The Research on Smart Power Consumption Technology Based on Big Data
    Zhang, Suxiang
    Zhang, Dong
    Zhang, Yaping
    Cao, Jinping
    Gao, Dequan
    Pang, Jiufeng
    [J]. 2016 INTERNATIONAL CONFERENCE ON SMART GRID AND CLEAN ENERGY TECHNOLOGIES (ICSGCE), 2016, : 12 - 18