A Data Replica Selection Algorithm Based on Cloud Platform

被引：0

作者：

Zhang, Shaomin ^{[1
]}

Wang, Qi ^{[1
]}

Wang, Baoyi ^{[1
]}

机构：

[1] North China Elect Power Univ, Sch Control & Comp Engn, Baoding 071003, Peoples R China

来源：

PROCEEDINGS OF THE 2015 3RD INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND INFORMATION TECHNOLOGY APPLICATIONS | 2015年 / 35卷

关键词：

Smart Grid Task; MapReduce; Data Replicas; Join Operation;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Aiming at the problem that how to choose the least cost data resources from multiple datasets which have the same contents but different locations for smart grid tasks, a least cost of selection algorithm based on locality is proposed. First, the problem of choosing data replicas is abstract as a shortest path issue that is from the source point to other vertices in directed graph. Second, in order to complete the join operation in Map stage, the related data is grouped in the same datanode, so as to avoid pulling data in Reduce stage. Experimental results show that the algorithm can effectively reduce the data transmission time, and then reduce the task completion time, improve the real-time performance of the smart grid processing tasks.

引用

页码：514 / 519

页数：6

共 50 条

[1] An Improved Dynamic Data Replica Selection and Placement in Cloud
Rajalakshmi, A.
Vijayakumar, D.
Srinivasagan, K. G.
[J]. 2014 INTERNATIONAL CONFERENCE ON RECENT TRENDS IN INFORMATION TECHNOLOGY (ICRTIT), 2014,
[2] Optimal Replica Selection Algorithm in Data Grid
Tang, Bing
Zhang, Li
[J]. THEORETICAL AND MATHEMATICAL FOUNDATIONS OF COMPUTER SCIENCE, 2011, 164 : 297 - 304
[3] A fast replica selection algorithm for data grid
Yin, Dafei
Chen, Bin
Fang, Yu
[J]. COMPSAC 2007: THE THIRTY-FIRST ANNUAL INTERNATIONAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE, VOL I, PROCEEDINGS, 2007, : 383 - +
[4] Replica selection in the cloud environments using an ant colony algorithm
Navimipour, Nima Jafari
Milani, Bahareh Alami
[J]. 2016 THIRD INTERNATIONAL CONFERENCE ON DIGITAL INFORMATION PROCESSING, DATA MINING, AND WIRELESS COMMUNICATIONS (DIPDMWC), 2016, : 105 - 110
[5] Research and Implementation of the Data Mining Algorithm based on Cloud Platform
Yin XiaoHong
Diao ZhiJian
[J]. 2014 IEEE WORKSHOP ON ELECTRONICS, COMPUTER AND APPLICATIONS, 2014, : 685 - 687
[6] A Data Placement Strategy Based on Genetic Algorithm in Cloud Computing Platform
Guo, Wei
Wang, Xinjun
[J]. 2013 10TH WEB INFORMATION SYSTEM AND APPLICATION CONFERENCE (WISA 2013), 2013, : 369 - 372
[7] Accessibility Algorithm Based on Site Availability to Enhance Replica Selection in a Data Grid Environment
Jaradat, Ayman
Patel, Ahmed
Zakaria, M. N.
Amina, A. H. Muhamad
[J]. COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2013, 10 (01) : 105 - 132
[8] Research on Distributed Heterogeneous Data PCA Algorithm Based on Cloud Platform
Zhang, Jin
Huang, Gang
[J]. 6TH INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN, MANUFACTURING, MODELING AND SIMULATION (CDMMS 2018), 2018, 1967
[9] Research on data mining algorithm based on business cloud platform for mobile internet
Liu, Fenghua
[J]. International Journal of u- and e- Service, Science and Technology, 2016, 9 (02) : 343 - 352
[10] AN OPTIMIZED LOAD ALGORITHM OF PARALLEL DATA WAREHOUSE BASED ON THE CLOUD COMPUTING PLATFORM
Yang, Zhengqiu
Li, Tong
Xiu, Jiapeng
Liu, Chen
[J]. 2012 IEEE 2ND INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENT SYSTEMS (CCIS) VOLS 1-3, 2012, : 413 - 417

← 1 2 3 4 5 →