A prediction-based dynamic replication strategy for data-intensive applications

被引:9
|
作者
Nagarajan, Vijaya [1 ]
Mohamed, Mulk Abdul Maluk [1 ]
机构
[1] MAM Coll Engn & Technol, Dept Comp Sci & Engn, Software Syst Grp, Tiruchirappalli, Tamil Nadu, India
关键词
Replication; Intelligent Replica Manager; Association rules; Modified apriori algorithm; Prediction; IMPROVING DATA AVAILABILITY; ALGORITHM;
D O I
10.1016/j.compeleceng.2016.11.036
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Data-intensive applications produce huge amount of data sets which need to be analyzed among geographically distributed nodes in grid computing environment. Data replication is essential in this environment to reduce the data access latency and to improve the data availability across several grid sites. In this work, an Intelligent Replica Manager (IRM) is designed and incorporated in the middleware of the grid for scheduling data-intensive applications. IRM uses a Multi-criteria based replication algorithm which considers multiple parameters like storage capacity, bandwidth and communication cost of the neighboring sites before taking decisions for the selection and placement of replica. Additionally, future needs of the grid site are predicted in advance using modified apriori algorithm, which is an association rule based mining technique. This IRM based strategy reduces the data availability time, data access time and make span. The simulation results prove that the proposed strategy outperforms the existing strategies. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:281 / 293
页数:13
相关论文
共 50 条
  • [1] Data replication techniques for data-intensive applications
    No, Jaechun
    Park, Chang Won
    Park, Sung Soon
    [J]. COMPUTATIONAL SCIENCE - ICCS 2006, PT 4, PROCEEDINGS, 2006, 3994 : 1063 - 1070
  • [2] Towards a Replication Service for Data-Intensive Fog Applications
    Hasenburg, Jonathan
    Grambow, Martin
    Bermbach, David
    [J]. PROCEEDINGS OF THE 35TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING (SAC'20), 2020, : 267 - 270
  • [3] An LIRS-based Replica Replacement Strategy for Data-intensive Applications
    Liu, Wei
    Shi, Feiyan
    Du, Wei
    [J]. TRUSTCOM 2011: 2011 INTERNATIONAL JOINT CONFERENCE OF IEEE TRUSTCOM-11/IEEE ICESS-11/FCST-11, 2011, : 1381 - 1386
  • [4] Simultaneous scheduling of replication and computation for data-intensive applications on the grid
    Desprez F.
    Vernois A.
    [J]. Journal of Grid Computing, 2006, 4 (1) : 19 - 31
  • [5] Performance Prediction for Families of Data-Intensive Software Applications
    Verriet, Jacques
    Dankers, Reinier
    Somers, Lou
    [J]. COMPANION OF THE 2018 ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE '18), 2018, : 189 - 194
  • [6] Exploiting replication and data reuse to efficiently schedule data-intensive applications on grids
    Santos-Neto, E
    Cirne, W
    Brasileiro, F
    Lima, A
    [J]. JOB SCHEDULING STRATEGIES FOR PARALLEL PROCESSING, 2005, 3277 : 210 - 232
  • [7] Multi-Replication with Intelligent Staging in Data-Intensive Grid Applications
    Machida, Yuya
    Takizawa, Shin'ichiro
    Nakada, Hidemoto
    Matsuoka, Satoshi
    [J]. 2006 7TH IEEE/ACM INTERNATIONAL CONFERENCE ON GRID COMPUTING, 2006, : 88 - +
  • [8] A LNS-based data placement strategy for data-intensive e-science applications
    Zhang, Tiantian
    Cui, Lizhen
    Xu, Meng
    [J]. INTERNATIONAL JOURNAL OF GRID AND UTILITY COMPUTING, 2014, 5 (04) : 249 - 262
  • [9] Dynamic Tuning of the Workload Partition Factor in Data-Intensive Applications
    Rosas, Claudia
    Sikora, Anna
    Jorba, Josep
    Moreno, Andreu
    Cesar, Eduardo
    [J]. 2012 IEEE 14TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2012 IEEE 9TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (HPCC-ICESS), 2012, : 216 - 223
  • [10] Applications in Data-Intensive Computing
    Shah, Anuj R.
    Adkins, Joshua N.
    Baxter, Douglas J.
    Cannon, William R.
    Chavarria-Miranda, Daniel G.
    Choudhury, Sutanay
    Gorton, Ian
    Gracio, Deborah K.
    Halter, Todd D.
    Jaitly, Navdeep D.
    Johnson, John R.
    Kouzes, Richard T.
    Macduff, Matthew C.
    Marquez, Andres
    Monroe, Matthew E.
    Oehmen, Christopher S.
    Pike, William A.
    Scherrer, Chad
    Villa, Oreste
    Webb-Robertson, Bobbie-Jo
    Whitney, Paul D.
    Zuljevic, Nino
    [J]. ADVANCES IN COMPUTERS, VOL 79, 2010, 79 : 1 - 70