Prominence of MapReduce in BIG DATA Processing

被引:22
|
作者
Pandey, Shweta [1 ]
Tokekar, Vrinda [2 ]
机构
[1] Shri Vaishnav Inst Tech & Sci, Indore, India
[2] Inst Engn & Technol, Indore, India
关键词
Big Data; MapReduce; Hadoop Distributed File System; Google file System; Hadoop;
D O I
10.1109/CSNT.2014.117
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Big Data has come up with aureate haste and a clef enabler for the social business; Big Data gifts an opportunity to create extraordinary business advantage and better service delivery. Big Data is bringing a positive change in the decision making process of various business organizations. With the several offerings Big Data has come up with several issues and challenges which are related to the Big Data Management, Big Data processing and Big Data analysis. Big Data is having challenges related to volume, velocity and variety. Big Data has 3Vs Volume means large amount of data, Velocity means data arrives at high speed, Variety means data comes from heterogeneous resources. In Big Data definition, Big means a dataset which makes data concept to grow so much that it becomes difficult to manage it by using existing data management concepts and tools. Map Reduce is playing a very significant role in processing of Big Data. This paper includes a brief about Big Data and its related issues, emphasizes on role of MapReduce in Big Data processing. MapReduce is elastic scalable, efficient and fault tolerant for analysing a large set of data, highlights the features of MapReduce in comparison of other design model which makes it popular tool for processing large scale data. Analysis of performance factors of MapReduce shows that elimination of their inverse effect by optimization improves the performance of Map Reduce.
引用
收藏
页码:555 / 560
页数:6
相关论文
共 50 条
  • [1] Efficient Big Data Processing in Hadoop MapReduce
    Dittrich, Jens
    Quiane-Ruiz, Jorge-Arnulfo
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (12): : 2014 - 2015
  • [2] The Performance Optimization of Big Data Processing by Adaptive MapReduce Workflow
    Li, Wei
    Tang, Maolin
    [J]. IEEE ACCESS, 2022, 10 : 79004 - 79020
  • [3] Heterogeneous Architectures for Big Data Batch Processing in MapReduce Paradigm
    Goudarzi, Maziar
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2019, 5 (01) : 18 - 33
  • [4] Verifying Properties of MapReduce-Based Big Data Processing
    Zhang, Nan
    Wang, Meng
    Duan, Zhenhua
    Tian, Cong
    [J]. IEEE TRANSACTIONS ON RELIABILITY, 2022, 71 (01) : 321 - 338
  • [5] Big Data Processing with Probabilistic Latent Semantic Analysis on MapReduce
    Zhao, Yong
    Chen, Yao
    Liang, Zhao
    Yuan, Shuangshuang
    Li, Youfu
    [J]. 2014 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY (CYBERC), 2014, : 162 - 166
  • [6] Multi-objective scheduling of MapReduce jobs in big data processing
    Hashem, Ibrahim Abaker Targio
    Anuar, Nor Badrul
    Marjani, Mohsen
    Gani, Abdullah
    Sangaiah, Arun Kumar
    Sakariyah, Adewole Kayode
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (08) : 9979 - 9994
  • [7] Big Data Management Processing with Hadoop MapReduce and Spark Technology: A Comparison
    Verma, Ankush
    Mansuri, Ashik Hussain
    Jain, Neelesh
    [J]. 2016 SYMPOSIUM ON COLOSSAL DATA ANALYSIS AND NETWORKING (CDAN), 2016,
  • [8] Trust-Based Scheduling Framework for Big Data Processing with MapReduce
    Thanh Dat Dang
    Doan Hoang
    Nguyen, Diep N.
    [J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (01) : 279 - 293
  • [9] Processing Geo-Dispersed Big Data in an Advanced MapReduce Framework
    Zhang, Hongli
    Zhang, Qiang
    Zhou, Zhigang
    Du, Xiaojiang
    Yu, Wei
    Guizani, Mohsen
    [J]. IEEE NETWORK, 2015, 29 (05): : 24 - 30
  • [10] Big Data Processing with harnessing Hadoop - MapReduce for Optimizing Analytical Workloads
    Satish, Rama K., V
    Kavya, N. P.
    [J]. 2014 INTERNATIONAL CONFERENCE ON CONTEMPORARY COMPUTING AND INFORMATICS (IC3I), 2014, : 49 - 54