Present and importance of the implementation of Big Data using the Hadoop and Spark tools

被引:0
|
作者
Montoya Suarez, Lina [1 ]
Gil Restrepo, Gustavo Andres [1 ]
机构
[1] Univ Catolica Luis Amigo, Medellin, Colombia
来源
REVISTA DIGITAL LAMPSAKOS | 2018年 / 19期
关键词
Big Data; Open Data; Volume; Variety; Speed; Hadoop; Spark; Map Reduce; HDFS; Data Mining;
D O I
10.21501/21454086.2403
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In the present article, a review was made on the relevance and importance of Big Data through the Hadoop and Spark tools. First the Big Data concept is contextualized from different authors and making reference to its importance in the different organizations, having as a premise, the three V that must be present when implementing Big Data (Volume, Variety and Speed). Then, the Hadoop and Spark tools are analyzed, identifying their capacity to make more efficient the processing of large volumes of data, of different types of data and at a high speed, solving the problems that arose before when many data were going to be worked on. Finally, a reflection is made on the importance of Big Data in the decision-making of an organization, taking into account that decision-making allows an organization to be competitive and to last over time.
引用
收藏
页码:67 / 72
页数:6
相关论文
共 50 条
  • [1] Big data and Spark: Comparison with Hadoop
    Benlachmi, Yassine
    Hasnaoui, Moulay Lahcen
    [J]. PROCEEDINGS OF THE 2020 FOURTH WORLD CONFERENCE ON SMART TRENDS IN SYSTEMS, SECURITY AND SUSTAINABILITY (WORLDS4 2020), 2020, : 811 - 817
  • [2] Big Data Processing Using Hadoop and Spark: The Case of Meteorology Data
    Hussein, Eslam
    Sadiki, Ronewa
    Jafta, Yahlieel
    Sungay, Muhammad Mujahid
    Ajayi, Olasupo
    Bagula, Antoine
    [J]. E-INFRASTRUCTURE AND E-SERVICES FOR DEVELOPING COUNTRIES (AFRICOMM 2019), 2020, 311 : 180 - 185
  • [3] Resilient Distributed Computing Platforms for Big Data Analysis Using Spark and Hadoop
    Chang, Bao Rong
    Tsai, Hsiu-Fen
    Wang, Yo-Ai
    Huang, Chien-Feng
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON APPLIED SYSTEM INNOVATION (ICASI), 2016,
  • [4] Processing Real World Datasets using Big Data Hadoop Tools
    Deshai, N.
    Sekhar, B. V. D. S.
    Reddy, P. V. G. D. Prasad
    Chakravarthy, V. V. S. S. S.
    [J]. JOURNAL OF SCIENTIFIC & INDUSTRIAL RESEARCH, 2020, 79 (07): : 631 - 635
  • [5] The Role of Hadoop Technology in the Implementation of Big Data Concept
    Stupar, Savo
    Car, Mirha Bico
    Sahic, Elvir
    [J]. NEW TECHNOLOGIES, DEVELOPMENT AND APPLICATION, 2019, 42 : 254 - 261
  • [6] Big Data and Hadoop in Biology: Introduction, Implementation and Applications
    Sharma, Isha
    Mandal, Disha
    Hasija, Yasha
    [J]. 2018 INTERNATIONAL CONFERENCE ON COMPUTING, POWER AND COMMUNICATION TECHNOLOGIES (GUCON), 2018, : 247 - 251
  • [7] A Comparative Study of Big Data Processing : Hadoop vs. Spark
    Sharma, Meghna
    Kaur, Jagdeep
    [J]. PROCEEDINGS OF THE 2019 6TH INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT (INDIACOM), 2019, : 1073 - 1077
  • [8] Migrating GIS Big Data Computing from Hadoop to Spark: An Exemplary Study Using Twitter
    Sun, Zhibo
    Zhang, Hong
    Liu, Zixia
    Xu, Chen
    Wang, Liqiang
    [J]. PROCEEDINGS OF 2016 IEEE 9TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2016, : 351 - 358
  • [9] Big Data Management Processing with Hadoop MapReduce and Spark Technology: A Comparison
    Verma, Ankush
    Mansuri, Ashik Hussain
    Jain, Neelesh
    [J]. 2016 SYMPOSIUM ON COLOSSAL DATA ANALYSIS AND NETWORKING (CDAN), 2016,
  • [10] A Comparison of Big Remote Sensing Data Processing with Hadoop MapReduce and Spark
    Chebbi, I.
    Boulila, W.
    Mellouli, N.
    Lamolle, M.
    Farah, I. R.
    [J]. 2018 4TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP), 2018,