Improved Resource Exploitation by Combining Hadoop Map Reduce Framework with VirtualBox

被引:0
|
作者
Kaur, Ramanpal [1 ]
Kaur, Harjeet [1 ]
Dhamija, Archu [1 ]
机构
[1] Lovely Profess Univ, Phagwara, India
关键词
Hadoop; MapReduce; HDFS; Virtualization; Cluster;
D O I
10.1007/978-81-322-2755-7_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
MapReduce is a framework for processing huge volumes of data in parallel, on large groups of nodes. Processing enormous data requires fast coordination and allocation of resources. Emphasis is on achieving maximum performance with optimal resources. This paper portraits a technique for accomplishing better resource utilization. The main objective of the work is to incorporate virtualization in Hadoop MapReduce framework and measuring the performance enhancement. In order to realize this master node is setup on physical machine and slave nodes are setup in a common physical machine as virtual machines (VM), by cloning of Hadoop configured VM images. To further enhance the performance Hadoop virtual cluster are configured to use capacity scheduler.
引用
收藏
页码:41 / 49
页数:9
相关论文
共 50 条
  • [1] An Efficient Improved Join Algorithm Using Map Reduce in Hadoop
    Patel, Warish D.
    Vaghela, Dineshkumar B.
    [J]. 2014 INTERNATIONAL CONFERENCE ON SIGNAL PROPAGATION AND COMPUTER TECHNOLOGY (ICSPCT 2014), 2014, : 263 - 272
  • [2] Distributed FP-ARMH Algorithm in Hadoop Map Reduce Framework
    Natarajan, Surendar
    Sehar, Sountharrajan
    [J]. 2013 INTERNATIONAL CONFERENCE ON GREEN COMPUTING, COMMUNICATION AND CONSERVATION OF ENERGY (ICGCE), 2013, : 264 - 270
  • [3] Referential DNA Data Compression using Hadoop Map Reduce Framework
    Bhukya, Raju
    Deshmuk, Sumit
    [J]. INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2020, 17 (02) : 207 - 214
  • [4] Impact of Map-Reduce framework on Hadoop and Spark MR Application Performance
    Lagwankar, Ishaan
    Sankaranarayanan, Ananth Narayan
    Kalambur, Subramaniam
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 2763 - 2772
  • [5] Improved Resource Provisioning in Hadoop
    Divya, M.
    Annappa, B.
    [J]. PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING, NETWORKING AND INFORMATICS, ICACNI 2015, VOL 2, 2016, 44 : 39 - 49
  • [6] Big Data Analytics using Hadoop Map Reduce Framework and Data Migration Process
    Bante, Payal M.
    Rajeswari, K.
    [J]. 2017 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, CONTROL AND AUTOMATION (ICCUBEA), 2017,
  • [7] A New Scheduling Algorithm in Hadoop Map Reduce
    Peng, Zhiping
    Ma, Yanchun
    [J]. EMERGING RESEARCH IN ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, 2011, 237 : 537 - +
  • [8] Towards Optimization of Hadoop Map Reduce Jobs on Cloud
    Lakshmi, A. Sree
    BalRaju, M.
    Chandra, N. Subash
    [J]. 2016 INTERNATIONAL CONFERENCE ON COMPUTING, ANALYTICS AND SECURITY TRENDS (CAST), 2016, : 255 - 260
  • [9] Hadoop and Map Reduce Biomedical Images using Clustering
    Sonawane, Minakshi M.
    Kawathekar, Seema S.
    [J]. 2017 INTERNATIONAL CONFERENCE ON CURRENT TRENDS IN COMPUTER, ELECTRICAL, ELECTRONICS AND COMMUNICATION (CTCEEC), 2017, : 945 - 947
  • [10] An Improved Parallel Algorithm of Genetic Programming based on the Framework of Map/Reduce
    Zhang Song
    Ma Jun
    Zhao Yang-yang
    Liu Qiong
    [J]. 2015 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY, 2015, : 221 - 225