A Novel Lightweight Middleware for Distributed Massive PMU Data Mining

被引:0
|
作者
Yi, Jianbo [1 ]
Dong, Binbin [1 ]
Huang, Qi [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu, Sichuan, Peoples R China
关键词
PMU data; light-eight middlerware; sampling parallel mining; round robin allocation algorithm;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
PMU data is facing with the problems of processing and application caused by the massive, distributed, multi-source, high redundancy existing in data. Therefore, this paper proposes a novel lightweight middleware to process and mine distributed massive PMU data. There employs light sampling parallel mining algorithm to deal with rules of data association, and proposes round robin algorithm to allocate computing tasks and data streams equally. Then the proposed middleware is applied in a multi-core computer. Test and comparison results from mining massive PMU data verify the feasibility and effectiveness of the proposed middleware technology in algorithm strategy and real-time requirement.
引用
收藏
页码:290 / 294
页数:5
相关论文
共 50 条
  • [1] Lightweight morphing support for evolving middleware data exchanges in distributed applications
    Agarwala, S
    Eisenhauer, G
    Schwan, K
    [J]. 25TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, PROCEEDINGS, 2005, : 697 - 706
  • [2] Service-oriented middleware for distributed data mining on the grid
    Congiusta, Antonio
    Talia, Domenico
    Trunfio, Paolo
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2008, 68 (01) : 3 - 15
  • [3] Lightweight clustering technique for distributed data mining applications
    Aouad, Lamine M.
    Le-Khac, Nhien-An
    Kechadi, Tahar M.
    [J]. ADVANCES IN DATA MINING: THEORETICAL ASPECTS AND APPLICATIONS, PROCEEDINGS, 2007, 4597 : 120 - +
  • [4] DDDAS/ITR: A data mining and exploration middleware for grid and distributed computing
    Weissman, Jon B.
    Kumar, Vipin
    Chandola, Varun
    Eilertson, Eric
    Ertoz, Levent
    Simon, Gyorgy
    Kim, Seonho
    Kim, Jinoh
    [J]. COMPUTATIONAL SCIENCE - ICCS 2007, PT 1, PROCEEDINGS, 2007, 4487 : 1222 - +
  • [5] DSCAGENTS: A LIGHTWEIGHT MIDDLEWARE FOR DISTRIBUTED SMART CAMERAS
    Quaritsch, Markus
    Rinner, Bernhard
    [J]. 2008 SECOND ACM/IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS, 2008, : 565 - 572
  • [6] A Lightweight Middleware Monitor for Distributed Scientific Workflows
    Serra da Cruz, Sergio Manuel
    da Silva, Fabricio Nogueira
    Gadelha, Luiz M. R., Jr.
    Reis Cavalcanti, Maria Claudia
    Campos, Maria Luiza M.
    Mattoso, Marta
    [J]. CCGRID 2008: EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, VOLS 1 AND 2, PROCEEDINGS, 2008, : 693 - +
  • [7] A Lightweight Elastic Queue Middleware for Distributed Streaming Pipeline
    Qu, Weiping
    Dessloch, Stefan
    [J]. BIG DATA ANALYTICS AND KNOWLEDGE DISCOVERY, DAWAK 2017, 2017, 10440 : 173 - 182
  • [8] AJIRA: a Lightweight Distributed Middleware for MapReduce and Stream Processing
    Urbani, Jacopo
    Margara, Alessandro
    Jacobs, Ceriel
    Voulgaris, Spyros
    Bal, Henri
    [J]. 2014 IEEE 34TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2014), 2014, : 545 - 554
  • [9] A Novel Data Mining Method in Distributed Network
    Yang Zhenjian
    Xia Kewen
    [J]. SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING: THEORY AND PRACTICE, VOL 1, 2012, 114 : 115 - 123
  • [10] Implementation of Distributed Crawler System Based on Spark for Massive Data Mining
    Liu, Feng
    Xin, Wang
    [J]. 2020 5TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS (ICCCS 2020), 2020, : 482 - 485