A Big Data Framework for Electric Power Data Quality Assessment

被引：10
|
作者：
Liu, He [1 ]
Huang, Fupeng [1 ]
Li, Han [2 ,3 ]
Liu, Weiwei [1 ]
Wang, Tongxun [4 ]
机构：
[1] Global Energy Interconnect Res Inst, Adv Comp & Big Data Technol Lab SGCC, Beijing, Peoples R China
[2] Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing, Peoples R China
[3] North China Univ Technol, Coll Comp Sci, Beijing, Peoples R China
[4] Global Energy Interconnect Res Inst, State Key Lab Adv Power Transmiss Technol, Beijing, Peoples R China
来源：
2017 14TH WEB INFORMATION SYSTEMS AND APPLICATIONS CONFERENCE (WISA 2017) | 2017年
关键词：
data quality; electric power data; data quality assessment; big data; framework;
D O I：
10.1109/WISA.2017.29
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Since a low-quality data may influence the effectiveness and reliability of applications, data quality is required to be guaranteed. Data quality assessment is considered as the foundation of the promotion of data quality, so it is essential to access the data quality before any other data related activities. In the electric power industry, more and more electric power data is continuously accumulated, and many electric power applications have been developed based on these data. In China, the power grid has many special characteristic, traditional big data assessment frameworks cannot be directly applied. Therefore, a big data framework for electric power data quality assessment is proposed. Based on big data techniques, the framework can accumulate both the real-time data and the history data, provide an integrated computation environment for electric power big data assessment, and support the storage of different types of data.
引用
收藏
页码：289 / 292
页数：4
相关论文
共 50 条
  • [1] A data cleaning model for electric power big data based on Spark framework
    Qu, Zhao-Yang
    Wang, Yong-Wen
    Wang, Chong
    Qu, Nan
    Yan, Jia
    [J]. International Journal of Database Theory and Application, 2016, 9 (03): : 137 - 150
  • [2] Quality Assessment : Big Data
    Shadrin, A.
    Afonichkina, E.
    [J]. EDUCATION EXCELLENCE AND INNOVATION MANAGEMENT THROUGH VISION 2020, 2019, : 8865 - 8869
  • [3] Transient power quality assessment based on big data analysis
    Huang Zhiwei
    Gao Tian
    Zhang Huaying
    Han Xu
    Cao Junwei
    Hu Ziheng
    Yao Senjing
    Zhu Zhengguo
    [J]. 2014 CHINA INTERNATIONAL CONFERENCE ON ELECTRICITY DISTRIBUTION (CICED), 2014,
  • [4] The Application Research of Electric Power Data on the Era of Big Data
    Zhang, Jie
    Zhang, Hao
    [J]. NEW INDUSTRIALIZATION AND URBANIZATION DEVELOPMENT ANNUAL CONFERENCE: THE INTERNATIONAL FORUM ON NEW INDUSTRIALIZATION DEVELOPMENT IN BIG-DATA ERA, 2015, : 592 - 596
  • [5] Data Quality Identification Model for Power Big Data
    Zheng, Haijie
    Tian, Bing
    Liu, Xiaobao
    Zhang, Wenbin
    Liu, Shenqi
    Wang, Cong
    [J]. DATA SCIENCE (ICPCSEE 2022), PT II, 2022, 1629 : 20 - 29
  • [6] Big Data Quality Assessment Model for Unstructured Data
    Taleb, Ikbal
    Serhani, Mohamed Adel
    Dssouli, Rachida
    [J]. PROCEEDINGS OF THE 2018 13TH INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION TECHNOLOGY (IIT), 2018, : 69 - 74
  • [7] Electric Power Big Data and Its Applications
    Cai, Defu
    Tian, Hongxun
    Wang, Yi
    Wang, Honggang
    Zheng, Haifeng
    Cao, Kan
    Zhou, Chu
    [J]. PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON ENERGY, POWER AND ELECTRICAL ENGINEERING, 2016, 56 : 181 - 184
  • [8] Data Quality Assessment for On-line Monitoring and Measuring System of Power Quality Based on Big Data and Data Provenance Theory
    Tian Hongxun
    Wang Honggang
    Zhou Kun
    Shi Mingtai
    Li Haosong
    Xu Zhongping
    Kang Taifeng
    Li Jin
    Cai Yaqi
    [J]. 2018 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2018, : 248 - 252
  • [9] Incremental Attribute Reduction Method for Electric Power Big Data Based on MapReduce Framework
    Liao, Hanxun
    Teng, Huan
    Lu, Guanghui
    [J]. Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2019, 43 (15): : 186 - 192
  • [10] A Framework for Ensuring the Quality of a Big Data Service
    Ding, Junhua
    Zhang, Dongmei
    Hui, Xin-Hua
    [J]. PROCEEDINGS 2016 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (SCC 2016), 2016, : 82 - 89
12345