An Enhanced and Efficient Approach for Improving the Performance of HPC Environment Using Map-Reduce With MARIANE

被引:1
|
作者
Kumar, Sathish P. J. [1 ]
Kannan, R. Jagadeesh [2 ]
机构
[1] Bharath Univ, Madras, Tamil Nadu, India
[2] VIT Univ Chennai Campus, Dept CSE, Madras, Tamil Nadu, India
关键词
MARIANE; MapReduce; Job Scheduling; Fault Tracker; Fault Tolerance; Fault Controller; Weight Based Approach;
D O I
10.1016/j.matpr.2017.11.302
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Hadoop is the main open source tool which backs the acknowledgment of the Big data upheaval and depends on Googles MapReduce spearheading mission in the area of very much substantial measure of information stocking space and handling. As of late, functions and advancements tending to "Big Data" confrontations have turned out to be colossally critical in numerous ranges of business and logical registering. The Map-Reduce model has empowered an expansive arrangement of uses, has prodded the improvement of open-source programming advances such as Hadoop, and is making a whirlwind of enthusiasm for the scholarly in addition to researchers from industry around enhancements and optional ways to deal with taking care of the requests of breaking down extensive complex information sets. The HPC people group is constantly vigilant for approaches to influence more extensive product speculations to distinguish mass-market advances which could be viably connected to take care of issues particular to high-performance computing. For example there are a few cases where outing of the rush of mass-business sector innovations has fundamentally affected HPC. Utilizing bigger business sector advances and the related economy-of-scale is being a compelling method for lessening prices and drawing in a bigger group. HPC, much competent devices, and regularly expanding reenactment scales are creating information at a pace that surpasses our capacity to viably oversee, break down, and distribute it. Execution of MapReduce pattern gives a method for extensive information volumes that could be consistently handled through utilization of vast item PCs. Hadoop and MapReduce have generally been utilized for web information handling and just as of late been utilized for exploratory applications. Our recommended framework comprehends the effect of document framework, programming modes on execution and system. Acquirement of an application's execution is to a great extent work load subordinate. Configuration of each MapReduce frameworks needs to incorporate the Key components such as, precise output, Quick Response and High speed. Enhancement of the Fault resilience of Map Reduce Implementation Adapted for High Performance Computing Environments in Distributed and Parallel Computing is considered to be the primary objective of this work. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1980 / 1988
页数:9
相关论文
共 50 条
  • [1] The Design of the Efficient Theta-Join in Map-Reduce Environment
    Penar, Maciej
    Wilczek, Artur
    [J]. BEYOND DATABASES, ARCHITECTURES AND STRUCTURES, BDAS 2016, 2016, 613 : 204 - 215
  • [2] A Map-Reduce based parallel approach for improving query performance in a geospatial semantic web for disaster response
    Zhang, Chuanrong
    Zhao, Tian
    Anselin, Luc
    Li, Weidong
    Chen, Ke
    [J]. EARTH SCIENCE INFORMATICS, 2015, 8 (03) : 499 - 509
  • [3] A Map-Reduce based parallel approach for improving query performance in a geospatial semantic web for disaster response
    Chuanrong Zhang
    Tian Zhao
    Luc Anselin
    Weidong Li
    Ke Chen
    [J]. Earth Science Informatics, 2015, 8 : 499 - 509
  • [4] Optimizing Multiway Joins in a Map-Reduce Environment
    Afrati, Foto N.
    Ullman, Jeffrey D.
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2011, 23 (09) : 1282 - 1298
  • [5] Index Clustering: A Map-reduce Clustering Approach using Numba
    Chen, Xinyu
    Estrada, Trike
    [J]. PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON DATA SCIENCE, TECHNOLOGY AND APPLICATIONS (DATA), 2017, : 233 - 240
  • [6] Grey-box Approach for Performance Prediction in Map-Reduce based Platforms
    Kadirvel, Selvi
    Fortes, Jose A. B.
    [J]. 2012 21ST INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN), 2012,
  • [7] Framework for Horizontal Scaling of Map Matching Using Map-Reduce
    Tiwari, Vishnu Shankar
    Arya, Arti
    Chaturvedi, Sudha
    [J]. 2014 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY (ICIT), 2014, : 30 - 34
  • [8] Enumerating Subgraph Instances Using Map-Reduce
    Afrati, Foto N.
    Fotakis, Dimitris
    Ullman, Jeffrey D.
    [J]. 2013 IEEE 29TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2013, : 62 - 73
  • [9] Image Segmentation Using Map-Reduce Framework
    Akhtar, M. Nishat
    Saleh, Junita Mohamad
    Irshad, Talha
    [J]. 2018 INTERNATIONAL CONFERENCE ON APPLIED MATHEMATICS & COMPUTATIONAL SCIENCE (ICAMCS.NET 2018), 2018, : 115 - 124
  • [10] Categorising the .mu Domain Using Map-Reduce
    Aatish, Chiniah
    Tashley, Toocaram
    [J]. 2017 IEEE 2ND INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2017, : 470 - 474