Performance Analysis of Hadoop MapReduce on an OpenNebula Cloud with KVM and OpenVZ Virtualizations

被引:0
|
作者
Magalhaes Vasconcelos, Pedro Roger [1 ]
de Araujo Freitas, Gisele Azevedo [1 ]
机构
[1] Univ Fed Ceara, Fortaleza, Ceara, Brazil
关键词
Big Data; MapReduce; cloud computing; virtualization; KVM; OpenVZ;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Cloud computing provides access to a set of resources such as virtual machines, storage and network as services. In this context, virtualization has been used as an platform for resource-intensive applications, like Hadoop, as it has brought features like server consolidation, scalability and better resources usage. OpenVZ and KVM are very popular and widely used virtualization platforms with distinct virtualization modes: containet-based and full-virtualization. In this work, we conducted benchmarks to measure the performance of a Hadoop cluster deployed on OpenNebula clouds with KVM and OpenVZ. Our results show that OpenVZ performs better than KVM in the CPU and I/O reading benchmarks. KVM achieves better performance in the I/O writing benchmarks.
引用
收藏
页码:471 / 476
页数:6
相关论文
共 50 条
  • [21] Join Operations to Enhance Performance in Hadoop MapReduce Environment
    Pagadala, Pavan Kumar
    Vikram, M.
    Eswarawaka, Rajesh
    Reddy, P. Srinivasa
    [J]. PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON FRONTIERS IN INTELLIGENT COMPUTING: THEORY AND APPLICATIONS, (FICTA 2016), VOL 2, 2017, 516 : 491 - 500
  • [22] Performance optimization for short job execution in Hadoop MapReduce
    Gu, Rong
    Yan, Jinshuang
    Yang, Xiaoliang
    Yuan, Chunfeng
    Huang, Yihua
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2014, 51 (06): : 1270 - 1280
  • [23] A Scheduling Algorithm for Hadoop MapReduce Workflows with Budget Constraints in the Heterogeneous Cloud
    Wylie, Andrew
    Shi, Wei
    Corriveau, Jean-Pierre
    Wang, Yang
    [J]. 2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2016, : 1433 - 1442
  • [24] Hadoop MapReduce Performance on SSDs for Analyzing Social Networks
    Bakratsas, M.
    Basaras, P.
    Katsaros, D.
    Tassiulas, L.
    [J]. BIG DATA RESEARCH, 2018, 11 : 1 - 10
  • [25] Mapreduce performance model for Hadoop 2.x
    Glushkova, Dada
    Jovanovic, Petar
    Abello, Alberto
    [J]. INFORMATION SYSTEMS, 2019, 79 : 32 - 43
  • [26] Performance Modeling for RDMA-Enhanced Hadoop MapReduce
    Wasi-ur-Rahman, Md.
    Lu, Xiaoyi
    Islam, Nusrat Sharmin
    Panda, Dhabaleswar K.
    [J]. 2014 43RD INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP), 2014, : 50 - 59
  • [27] Performance Enhancement of Hadoop MapReduce Framework for Analyzing BigData
    Prabhu, Swathi
    Rodrigues, Anisha P.
    Prasad, Guru M. S.
    Nagesh, H. R.
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES, 2015,
  • [28] Fuzzy K-mean Clustering in MapReduce on Cloud Based Hadoop
    Garg, Dweepna
    Trivedi, Khushboo
    [J]. 2014 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2014, : 1607 - 1610
  • [29] Performance Optimization for Short MapReduce Job Execution in Hadoop
    Yan, Jinshuang
    Yang, Xiaoliang
    Gu, Rong
    Yuan, Chunfeng
    Huang, Yihua
    [J]. SECOND INTERNATIONAL CONFERENCE ON CLOUD AND GREEN COMPUTING / SECOND INTERNATIONAL CONFERENCE ON SOCIAL COMPUTING AND ITS APPLICATIONS (CGC/SCA 2012), 2012, : 688 - 694
  • [30] KVM, Xen and Docker: a performance analysis for ARM based NFV and Cloud computing
    Raho, Moritz
    Spyridakis, Alexander
    Paolino, Michele
    Raho, Daniel
    [J]. PROCEEDINGS OF THE 2015 IEEE 3RD WORKSHOP ON ADVANCES IN INFORMATION, ELECTRONIC AND ELECTRICAL ENGINEERING (AIEEE 2015), 2015,