Performance Enhancement of Hadoop MapReduce Framework for Analyzing BigData

被引：0

作者：

Prabhu, Swathi ^{[1
]}

Rodrigues, Anisha P. ^{[1
]}

Prasad, Guru M. S. ^{[2
]}

Nagesh, H. R. ^{[3
]}

机构：

[1] NMAMIT, Dept CSE, Nitte, India

[2] SDMIT, Dept CSE, Ujire, India

[3] MITE, Dept CSE, Moodabidri, India

来源：

2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES | 2015年

关键词：

BigData; Hadoop; MapReduce; Peiformance; Baseline system;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this BigData era processing and analyzing the data is very important and tedious job. An open source framework called Hadoop, implementation of MapReduce provides efficient platform for BigData analytics. The performance of Hadoop MapReduce mainly depends on its configuration parameters. Tuning the job configuration parameters is an effective way to improve performance so that we can reduce the execution time and the disk utilization. The performance tuning mainly based on CPU usage, disk I/O rate, memory usage, network traffic components. In this paper we are discussing the tuning methods to enhance the performance of MapReduce jobs. From our experiment we can say that performance has improved by 32.97% over the baseline system.

引用

下载

页数：7

共 50 条

[21] Straggler Mitigation in Hadoop MapReduce Framework: A Review
Ajibade, Lukuman Saheed
Abu Bakar, Kamalrulnizam
Aliyu, Ahmed
Danish, Tasneem
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (08) : 870 - 878
[22] Performance Improvement of MapReduce Framework by Identifying Slow TaskTrackers in Heterogeneous Hadoop Cluster
Naik, Nenavath Srinivas
Negi, Atul
Sastry, V. N.
PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING, NETWORKING AND INFORMATICS, ICACNI 2015, VOL 2, 2016, 44 : 465 - 473
[23] A Hadoop MapReduce Performance Prediction Method
Song, Ge
Meng, Zide
Huet, Fabrice
Magoules, Frederic
Yu, Lei
Lin, Xuelian
2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 820 - 825
[24] A BigData MapReduce Hadoop Distribution Architecture for Processing Input Splits to solve the Small Data Problem
Manjunath, R.
Tejus
Channabasava, R. K.
Balaji, S.
PROCEEDINGS OF THE 2016 2ND INTERNATIONAL CONFERENCE ON APPLIED AND THEORETICAL COMPUTING AND COMMUNICATION TECHNOLOGY (ICATCCT), 2016, : 480 - 487
[25] High Performance Analytics of Bigdata with Dynamic and Optimized Hadoop Cluster
Pradhananga, Yanish
Karande, Shridevi
Karande, Chandraprakash
PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2016, : 715 - 720
[26] A Parallel Genetic Algorithms Framework based on Hadoop MapReduce
Ferrucci, Filomena
Salza, Pasquale
Kechadi, M-Tahar
Sarro, Federica
30TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, VOLS I AND II, 2015, : 1664 - 1667
[27] Implementation of Page Rank Algorithm in Hadoop MapReduce Framework
Bhawivuga, Adhitya
Kirana, Annisa Puspa
2016 INTERNATIONAL SEMINAR ON INTELLIGENT TECHNOLOGY AND ITS APPLICATIONS (ISITIA): RECENT TRENDS IN INTELLIGENT COMPUTATIONAL TECHNOLOGIES FOR SUSTAINABLE ENERGY, 2016, : 231 - 235
[28] HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework
Gandomi, Abolfazl
Reshadi, Midia
Movaghar, Ali
Khademzadeh, Ahmad
JOURNAL OF BIG DATA, 2019, 6 (01)
[29] HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework
Abolfazl Gandomi
Midia Reshadi
Ali Movaghar
Ahmad Khademzadeh
Journal of Big Data, 6
[30] Apache Hadoop-MapReduce on YARN framework latency
El Yazidi, Abdelaziz
Azizi, Mohamed Saad
Benlachmi, Yassine
Hasnaoui, Moulay Lahcen
12TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 4TH INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2021, 184 : 803 - 808

← 1 2 3 4 5 →