An Enhanced and Efficient Approach for Improving the Performance of HPC Environment Using Map-Reduce With MARIANE

被引:1
|
作者
Kumar, Sathish P. J. [1 ]
Kannan, R. Jagadeesh [2 ]
机构
[1] Bharath Univ, Madras, Tamil Nadu, India
[2] VIT Univ Chennai Campus, Dept CSE, Madras, Tamil Nadu, India
关键词
MARIANE; MapReduce; Job Scheduling; Fault Tracker; Fault Tolerance; Fault Controller; Weight Based Approach;
D O I
10.1016/j.matpr.2017.11.302
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Hadoop is the main open source tool which backs the acknowledgment of the Big data upheaval and depends on Googles MapReduce spearheading mission in the area of very much substantial measure of information stocking space and handling. As of late, functions and advancements tending to "Big Data" confrontations have turned out to be colossally critical in numerous ranges of business and logical registering. The Map-Reduce model has empowered an expansive arrangement of uses, has prodded the improvement of open-source programming advances such as Hadoop, and is making a whirlwind of enthusiasm for the scholarly in addition to researchers from industry around enhancements and optional ways to deal with taking care of the requests of breaking down extensive complex information sets. The HPC people group is constantly vigilant for approaches to influence more extensive product speculations to distinguish mass-market advances which could be viably connected to take care of issues particular to high-performance computing. For example there are a few cases where outing of the rush of mass-business sector innovations has fundamentally affected HPC. Utilizing bigger business sector advances and the related economy-of-scale is being a compelling method for lessening prices and drawing in a bigger group. HPC, much competent devices, and regularly expanding reenactment scales are creating information at a pace that surpasses our capacity to viably oversee, break down, and distribute it. Execution of MapReduce pattern gives a method for extensive information volumes that could be consistently handled through utilization of vast item PCs. Hadoop and MapReduce have generally been utilized for web information handling and just as of late been utilized for exploratory applications. Our recommended framework comprehends the effect of document framework, programming modes on execution and system. Acquirement of an application's execution is to a great extent work load subordinate. Configuration of each MapReduce frameworks needs to incorporate the Key components such as, precise output, Quick Response and High speed. Enhancement of the Fault resilience of Map Reduce Implementation Adapted for High Performance Computing Environments in Distributed and Parallel Computing is considered to be the primary objective of this work. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1980 / 1988
页数:9
相关论文
共 50 条
  • [31] Article Recommendation System Based on Keyword using Map-Reduce
    Singh, Sanjana
    Ahuja, Nishtha
    [J]. 2015 THIRD INTERNATIONAL CONFERENCE ON IMAGE INFORMATION PROCESSING (ICIIP), 2015, : 548 - 550
  • [32] Post Classification in the Social Networks using the Map-reduce Algorithm
    Sere, Abdoulaye
    Ouedraogo, Jose Arthur
    Zerbo, Boureima
    Sie, Oumarou
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (12) : 809 - 814
  • [33] Optimized scheduling of multi-user Map-Reduce jobs in heterogeneous environment
    Varalakshmi, Perumal
    Subbiah, Sankari
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (27):
  • [34] Towards a New Approach to Empower Periodic Pattern Mining for Massive Data using Map-Reduce
    Ibrahim, Rami
    Shafiq, M. Omair
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2206 - 2215
  • [35] Comparing the Performance and Power Usage of GPU and ARM Clusters for Map-Reduce
    Delplace, Vivian
    Manneback, Pierre
    Pinel, Frederic
    Varette, Sebastien
    Bouvry, Pascal
    [J]. 2013 IEEE THIRD INTERNATIONAL CONFERENCE ON CLOUD AND GREEN COMPUTING (CGC 2013), 2013, : 199 - +
  • [36] An Efficient Map-Reduce Algorithm for Computing Formal Concepts from Binary data
    Bhatnagar, Raj
    Kumar, Lalit
    [J]. PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 1519 - 1528
  • [37] Impact of Map-Reduce framework on Hadoop and Spark MR Application Performance
    Lagwankar, Ishaan
    Sankaranarayanan, Ananth Narayan
    Kalambur, Subramaniam
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 2763 - 2772
  • [38] A formal framework to analyze cost and performance in Map-Reduce based applications
    Nunez, Alberto
    Merayo, Mercedes G.
    [J]. JOURNAL OF COMPUTATIONAL SCIENCE, 2014, 5 (02) : 106 - 118
  • [39] Efficient Prototyping of Fault Tolerant Map-Reduce Applications with Docker-Hadoop
    Rey, Javier
    Cogorno, Matias
    Nesmachnow, Sergio
    Steffenel, Luiz Angelo
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E 2015), 2015, : 369 - 376
  • [40] Evolving the Efficiency of Searching Technique Using Map-Reduce Hashing Technique
    Pandey, Shivendra Kumar
    Tripathi, Priyanka
    [J]. SMART COMPUTING AND INFORMATICS, 2018, 77 : 353 - 361