EVALUATING THE SCALABILITY OF BIG DATA FRAMEWORKS

被引：1
|
作者：
Sanchez, David [2 ]
Solarte, Oswaldo [2 ]
Bucheli, Victor [2 ]
Ordonez, Hugo [1 ]
机构：
[1] Univ San Buenaventura, Cali, Colombia
[2] Univ Valle, Cali, Colombia
来源：
SCALABLE COMPUTING-PRACTICE AND EXPERIENCE | 2018年 / 19卷 / 03期
关键词：
Scalability; Isoefficiency; Big Data; Hadoop; Spark; MapReduce;
D O I：
10.12694/scpe.v19i3.1402
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
The aim of this paper is to present a method based on the isoefficiency model for assessing the scalability in big data environments. The programs word count and sort were implemented and compared in Hadoop and Spark. The results confirm that isoefficiency presented a linear growth as the size of the data sets was increased. They were checked experimentally to ensure that the evaluated frameworks are scalable and a sublinear function was obtained. This paper discusses how scalability in big data is governed by a constant of scalability (beta).
引用
收藏
页码：301 / 307
页数：7
相关论文
共 50 条
  • [31] Privacy, Big Data, and the Public Good: Frameworks for Engagement
    Combe, Colin
    LOCAL GOVERNMENT STUDIES, 2015, 41 (01) : 181 - 182
  • [32] An advanced comparison on big data world computing frameworks
    Deshai, N.
    Venkataramana, S.
    Sekhar, B. V. D. S.
    Srinivas, K.
    Singh, Sundhar
    NagaKrishna, L.
    INTERNATIONAL CONFERENCE ON COMPUTER VISION AND MACHINE LEARNING, 2019, 1228
  • [33] Production Machine Learning Frameworks for Geospatial Big Data
    Ntouskos, Valsamis
    Iliopoulou, Chrysa
    Karantzalos, Konstantinos
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 5972 - 5974
  • [34] A Comparative Analysis of Big Data Frameworks: An Adoption Perspective
    Khalid, Madiha
    Yousaf, Muhammad Murtaza
    APPLIED SCIENCES-BASEL, 2021, 11 (22):
  • [35] Bridging the Gap Between HPC and Big Data Frameworks
    Anderson, Michael
    Smith, Shaden
    Sundaram, Narayanan
    Capota, Mihai
    Zhao, Zheguang
    Dulloor, Subramanya
    Satish, Nadathur
    Willke, Theodore L.
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2017, 10 (08): : 901 - 912
  • [36] Evaluation of big data frameworks for analysis of smart grids
    Ansari, Mohammad Hasan
    Vakili, Vahid Tabatab
    Bahrak, Behnam
    JOURNAL OF BIG DATA, 2019, 6 (01)
  • [37] Evaluation of big data frameworks for analysis of smart grids
    Mohammad Hasan Ansari
    Vahid Tabatab Vakili
    Behnam Bahrak
    Journal of Big Data, 6
  • [38] Parallel Programming Paradigms and Frameworks in Big Data Era
    Ciprian Dobre
    Fatos Xhafa
    International Journal of Parallel Programming, 2014, 42 : 710 - 738
  • [39] DEMYSTIFYING CHALLENGES, OPPORTUNITIES AND ISSUES OF BIG DATA FRAMEWORKS
    Padmapriya, V
    Amudhavel, J.
    Gowri, V
    Lakshmipriya, K.
    Vinothini, S.
    Kumar, K. Prem
    ICARCSET'15: PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON ADVANCED RESEARCH IN COMPUTER SCIENCE ENGINEERING & TECHNOLOGY (ICARCSET - 2015), 2015,
  • [40] A Systematic Literature Review of Big Data and the Hadoop frameworks
    Naidu, Devishree
    Thakur, Adi
    INTERNATIONAL JOURNAL OF EARLY CHILDHOOD SPECIAL EDUCATION, 2022, 14 (02) : 2969 - 2973
12345