Performance Enhancement of Hadoop MapReduce Framework for Analyzing BigData

被引：0
|
作者：
Prabhu, Swathi [1 ]
Rodrigues, Anisha P. [1 ]
Prasad, Guru M. S. [2 ]
Nagesh, H. R. [3 ]
机构：
[1] NMAMIT, Dept CSE, Nitte, India
[2] SDMIT, Dept CSE, Ujire, India
[3] MITE, Dept CSE, Moodabidri, India
来源：
2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES | 2015年
关键词：
BigData; Hadoop; MapReduce; Peiformance; Baseline system;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In this BigData era processing and analyzing the data is very important and tedious job. An open source framework called Hadoop, implementation of MapReduce provides efficient platform for BigData analytics. The performance of Hadoop MapReduce mainly depends on its configuration parameters. Tuning the job configuration parameters is an effective way to improve performance so that we can reduce the execution time and the disk utilization. The performance tuning mainly based on CPU usage, disk I/O rate, memory usage, network traffic components. In this paper we are discussing the tuning methods to enhance the performance of MapReduce jobs. From our experiment we can say that performance has improved by 32.97% over the baseline system.
引用
收藏
页数：7
相关论文
共 50 条
  • [1] Hadoop MapReduce Performance on SSDs for Analyzing Social Networks
    Bakratsas, M.
    Basaras, P.
    Katsaros, D.
    Tassiulas, L.
    [J]. BIG DATA RESEARCH, 2018, 11 : 1 - 10
  • [2] Framework for Analyzing Web Access Logs using Hadoop and MapReduce
    Borgaonkar, Pranjali
    Kumar, Gaurav
    Yaduwanshi, Jyoti
    [J]. 2018 INTERNATIONAL CONFERENCE ON RECENT INNOVATIONS IN ELECTRICAL, ELECTRONICS & COMMUNICATION ENGINEERING (ICRIEECE 2018), 2018, : 2124 - 2129
  • [3] Analyzing BigData with Hadoop Cluster in HDInsight Azure Cloud
    Bhardwaj, Aditya
    Singh, Vineet Kumar
    Choudhary, Vanraj
    Narayan, Yogendra
    [J]. 2015 ANNUAL IEEE INDIA CONFERENCE (INDICON), 2015,
  • [4] An Expressive Hadoop MapReduce Framework
    Shah, Nathar
    Messom, Christopher
    [J]. ADVANCED SCIENCE LETTERS, 2017, 23 (11) : 11197 - 11201
  • [5] An Open Source Project for Tuning and Analyzing MapReduce Performance in Hadoop and Spark
    Chen, Donghua
    Zhang, Runtong
    [J]. IEEE SOFTWARE, 2022, 39 (01) : 61 - 69
  • [6] Memory and Performance Aware Scheduling Design for Hadoop MapReduce Framework
    Bakka, Jagadevi
    Lingareddy, Sanjeev C.
    [J]. BIOSCIENCE BIOTECHNOLOGY RESEARCH COMMUNICATIONS, 2020, 13 (13): : 242 - 246
  • [7] An Approach to Enhance the Performance of Hadoop MapReduce Framework for Big Data
    Chandra, Subhash
    Motwani, Deepak
    [J]. 2016 INTERNATIONAL CONFERENCE ON MICRO-ELECTRONICS AND TELECOMMUNICATION ENGINEERING (ICMETE), 2016, : 178 - 182
  • [8] Distributed authentication framework for Hadoop based bigdata environment
    Hena, M.
    Jeyanthi, N.
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 13 (9) : 4397 - 4414
  • [9] AN APPROACH FOR STITCHING SATELLITE IMAGES IN A BIGDATA MAPREDUCE FRAMEWORK
    Sari, H.
    Eken, S.
    Sayar, A.
    [J]. 4TH INTERNATIONAL GEOADVANCES WORKSHOP - GEOADVANCES 2017: ISPRS WORKSHOP ON MULTI-DIMENSIONAL & MULTI-SCALE SPATIAL DATA MODELING, 2017, 4-4 (W4): : 351 - 355
  • [10] SmartGrids: MapReduce Framework using Hadoop
    Fanibhare, Vaibhav
    Dahake, Vijay
    [J]. 2016 3RD INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2016, : 406 - 411
12345