Performance Enhancement of Hadoop MapReduce Framework for Analyzing BigData

被引：0

作者：

Prabhu, Swathi ^{[1
]}

Rodrigues, Anisha P. ^{[1
]}

Prasad, Guru M. S. ^{[2
]}

Nagesh, H. R. ^{[3
]}

机构：

[1] NMAMIT, Dept CSE, Nitte, India

[2] SDMIT, Dept CSE, Ujire, India

[3] MITE, Dept CSE, Moodabidri, India

来源：

2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES | 2015年

关键词：

BigData; Hadoop; MapReduce; Peiformance; Baseline system;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this BigData era processing and analyzing the data is very important and tedious job. An open source framework called Hadoop, implementation of MapReduce provides efficient platform for BigData analytics. The performance of Hadoop MapReduce mainly depends on its configuration parameters. Tuning the job configuration parameters is an effective way to improve performance so that we can reduce the execution time and the disk utilization. The performance tuning mainly based on CPU usage, disk I/O rate, memory usage, network traffic components. In this paper we are discussing the tuning methods to enhance the performance of MapReduce jobs. From our experiment we can say that performance has improved by 32.97% over the baseline system.

引用

页数：7

共 50 条

[31] Performance Modelling and Analysis of MapReduce/Hadoop Workloads
Yu, Xiaolong
Li, Wei
2015 IEEE 21ST INTERNATIONAL WORKSHOP ON LOCAL & METROPOLITAN AREA NETWORKS (LANMAN), 2015,
[32] Various approches to improve MapReduce performance in Hadoop
Manjaly, Jisha S.
Subbulakshmi, T.
PROCEEDINGS OF THE 2018 3RD INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT 2018), 2018, : 778 - 782
[33] Performance analysis of MapReduce Programs on Hadoop cluster
Maurya, Mahesh
Mahajan, Sunita
PROCEEDINGS OF THE 2012 WORLD CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGIES, 2012, : 505 - 510
[34] Performance Analysis of Coupling Scheduler for MapReduce/Hadoop
Tan, Jian
Meng, Xiaoqiao
Zhang, Li
2012 PROCEEDINGS IEEE INFOCOM, 2012, : 2586 - 2590
[35] Analyzing & Optimizing Hadoop Performance
Jain, Ankita
Choudhary, Monika
PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS AND COMPUTATIONAL INTELLIGENCE (ICBDAC), 2017, : 116 - 121
[36] Analyzing Patterns in Large-Scale Graphs Using MapReduce in Hadoop
Schultz, Joshua
Vierya, Jonathan
Lu, Enyue
2012 SC COMPANION: HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SCC), 2012, : 1457 - +
[37] Analyzing Patterns in Large-Scale Graphs Using MapReduce in Hadoop
Schultz, Joshua
Vieyra, Jonathan
Lu, Enyue
2012 SC COMPANION: HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SCC), 2012, : 1459 - 1459
[38] Parallelized Genetic Operations for SBST using Hadoop MapReduce Framework
Mayandi, Geethapriya
Arumugam, Chamundeswari
2014 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2014, : 1686 - 1691
[39] Join Operations to Enhance Performance in Hadoop MapReduce Environment
Pagadala, Pavan Kumar
Vikram, M.
Eswarawaka, Rajesh
Reddy, P. Srinivasa
PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON FRONTIERS IN INTELLIGENT COMPUTING: THEORY AND APPLICATIONS, (FICTA 2016), VOL 2, 2017, 516 : 491 - 500
[40] Coupling GPU and MPTCP to Improve Hadoop/MapReduce Performance
Wang, Chia-Hui
Yang, Chen-Kuei
Liao, Wei-Chih
Chang, Ray-I
Wei, Tsao-Ta
2016 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT GREEN BUILDING AND SMART GRID (IGBSG), 2016, : 109 - 114

← 1 2 3 4 5 →