EVALUATING THE SCALABILITY OF BIG DATA FRAMEWORKS

被引：1
|
作者：
Sanchez, David [2 ]
Solarte, Oswaldo [2 ]
Bucheli, Victor [2 ]
Ordonez, Hugo [1 ]
机构：
[1] Univ San Buenaventura, Cali, Colombia
[2] Univ Valle, Cali, Colombia
来源：
SCALABLE COMPUTING-PRACTICE AND EXPERIENCE | 2018年 / 19卷 / 03期
关键词：
Scalability; Isoefficiency; Big Data; Hadoop; Spark; MapReduce;
D O I：
10.12694/scpe.v19i3.1402
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
The aim of this paper is to present a method based on the isoefficiency model for assessing the scalability in big data environments. The programs word count and sort were implemented and compared in Hadoop and Spark. The results confirm that isoefficiency presented a linear growth as the size of the data sets was increased. They were checked experimentally to ensure that the evaluated frameworks are scalable and a sublinear function was obtained. This paper discusses how scalability in big data is governed by a constant of scalability (beta).
引用
收藏
页码：301 / 307
页数：7
相关论文
共 50 条
  • [41] Word pattern prediction using Big Data frameworks
    Szabari, Bence
    Kiss, Attila
    ACTA UNIVERSITATIS SAPIENTIAE INFORMATICA, 2020, 12 (01) : 51 - 69
  • [42] Survey on JVM Optimization for Big Data Processing Frameworks
    Wang, Yi-Cheng
    Zeng, Hong-Bin
    Xu, Li-Jie
    Wang, Wei
    Wei, Jun
    Huang, Tao
    Ruan Jian Xue Bao/Journal of Software, 2023, 34 (01): : 463 - 488
  • [43] Parallel Programming Paradigms and Frameworks in Big Data Era
    Dobre, Ciprian
    Xhafa, Fatos
    INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2014, 42 (05) : 710 - 738
  • [44] Systematic Mapping for Big Data Stream Processing Frameworks
    Alayyoub, Mohammed
    Yazici, Ali
    Karakaya, Ziya
    2016 ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL INFORMATION MANAGEMENT (ICDIM 2016), 2016, : 31 - 36
  • [45] A Survey on Big Data Processing Frameworks for Mobility Analytics
    Doulkeridis, Christos
    Vlachou, Akrivi
    Pelekis, Nikos
    Theodoridis, Yannis
    SIGMOD RECORD, 2021, 50 (02) : 18 - 30
  • [46] Solidarity and regulatory frameworks in (public health) Big Data
    Puyol, A.
    EUROPEAN JOURNAL OF PUBLIC HEALTH, 2020, 30
  • [47] A Study on Big Data Processing Frameworks: Spark and Storm
    Deshai, N.
    Venkataramana, S.
    Sekhar, B. V. D. S.
    Srinivas, K.
    Varma, G. P. Saradhi
    SMART INTELLIGENT COMPUTING AND APPLICATIONS, VOL 2, 2020, 160 : 415 - 424
  • [48] Performance Evaluation of Big Data Frameworks: MapReduce and Spark
    Singh, Jaspreet
    Panda, S. N.
    Kaushal, Rajesh
    INTELLIGENT COMMUNICATION, CONTROL AND DEVICES, ICICCD 2017, 2018, 624 : 1611 - 1619
  • [49] Big Data Security in Healthcare Survey on Frameworks and Algorithms
    Chandra, Sudipta
    Ray, Soumya
    Goswami, R. T.
    2017 7TH IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC), 2017, : 89 - 94
  • [50] Poster: BDTest, a System to Test Big Data Frameworks
    Langeois, Alexandre
    de Almeida, Eduardo Cunha
    Ventresque, Anthony
    10TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS - ICSTW 2017, 2017, : 395 - 397
12345