Performance Analysis of Hadoop MapReduce on an OpenNebula Cloud with KVM and OpenVZ Virtualizations

被引:0
|
作者
Magalhaes Vasconcelos, Pedro Roger [1 ]
de Araujo Freitas, Gisele Azevedo [1 ]
机构
[1] Univ Fed Ceara, Fortaleza, Ceara, Brazil
关键词
Big Data; MapReduce; cloud computing; virtualization; KVM; OpenVZ;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Cloud computing provides access to a set of resources such as virtual machines, storage and network as services. In this context, virtualization has been used as an platform for resource-intensive applications, like Hadoop, as it has brought features like server consolidation, scalability and better resources usage. OpenVZ and KVM are very popular and widely used virtualization platforms with distinct virtualization modes: containet-based and full-virtualization. In this work, we conducted benchmarks to measure the performance of a Hadoop cluster deployed on OpenNebula clouds with KVM and OpenVZ. Our results show that OpenVZ performs better than KVM in the CPU and I/O reading benchmarks. KVM achieves better performance in the I/O writing benchmarks.
引用
收藏
页码:471 / 476
页数:6
相关论文
共 50 条
  • [1] A Performance Analysis of MapReduce Applications on Big Data in Cloud based Hadoop
    Gohil, Parth
    Garg, Dweepna
    Panchal, Bakul
    [J]. 2014 INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND EMBEDDED SYSTEMS (ICICES), 2014,
  • [2] Performance Analysis of Container-based Hadoop Cluster : OpenVZ and LXC
    Rizki, Rizki
    Rakhmatsyah, Andrian
    Nugroho, M. Arief
    [J]. 2016 4TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY (ICOICT), 2016,
  • [3] Performance analysis of MapReduce Programs on Hadoop cluster
    Maurya, Mahesh
    Mahajan, Sunita
    [J]. PROCEEDINGS OF THE 2012 WORLD CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGIES, 2012, : 505 - 510
  • [4] Performance Modelling and Analysis of MapReduce/Hadoop Workloads
    Yu, Xiaolong
    Li, Wei
    [J]. 2015 IEEE 21ST INTERNATIONAL WORKSHOP ON LOCAL & METROPOLITAN AREA NETWORKS (LANMAN), 2015,
  • [5] Performance Analysis of Coupling Scheduler for MapReduce/Hadoop
    Tan, Jian
    Meng, Xiaoqiao
    Zhang, Li
    [J]. 2012 PROCEEDINGS IEEE INFOCOM, 2012, : 2586 - 2590
  • [6] Comparison and Improvement of Hadoop MapReduce Performance Prediction Models in the Private Cloud
    Wang, Nini
    Yang, Jian
    Lu, Zhihui
    Li, Xiaoyan
    Wu, Jie
    [J]. ADVANCES IN SERVICES COMPUTING, 2016, 10065 : 77 - 91
  • [7] Model Driven Performance Simulation of Cloud Provisioned Hadoop MapReduce Applications
    Alipour, Hanieh
    Liu, Yan
    Hamou-Lhadj, Abdelwahab
    Gorton, Ian
    [J]. 2016 IEEE/ACM 8TH INTERNATIONAL WORKSHOP ON MODELING IN SOFTWARE ENGINEERING (MISE), 2016, : 48 - 54
  • [8] Analysis of Resource Usage Profile for MapReduce Applications Using Hadoop on Cloud
    Liu, Zheyuan
    Mu, Dejun
    [J]. 2012 INTERNATIONAL CONFERENCE ON QUALITY, RELIABILITY, RISK, MAINTENANCE, AND SAFETY ENGINEERING (ICQR2MSE), 2012, : 1500 - 1504
  • [9] Analyzing performance of Apache Tez and MapReduce with hadoop multinode cluster on Amazon cloud
    Singh R.
    Kaur P.J.
    [J]. Journal of Big Data, 3 (1)
  • [10] A Hadoop MapReduce Performance Prediction Method
    Song, Ge
    Meng, Zide
    Huet, Fabrice
    Magoules, Frederic
    Yu, Lei
    Lin, Xuelian
    [J]. 2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 820 - 825