Development of Multiple Big Data Analytics Platforms with Rapid Response

被引:2
|
作者
Chang, Bao Rong [1 ]
Lee, Yun-Da [1 ]
Liao, Po-Hao [1 ]
机构
[1] Natl Univ Kaohsiung, Dept Comp Sci & Informat Engn, 700 Kaohsiung Univ Rd, Kaohsiung 811, Taiwan
关键词
BUSINESS INTELLIGENCE;
D O I
10.1155/2017/6972461
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The crucial problem of the integration of multiple platforms is how to adapt for their own computing features so as to execute the assignments most efficiently and gain the best outcome. This paper introduced the new approaches to big data platform, RHhadoop and SparkR, and integrated them to form a high-performance big data analytics with multiple platforms as part of business intelligence (BI) to carry out rapid data retrieval and analytics with R programming. This paper aims to develop the optimization for job scheduling using MSHEFT algorithm and implement the optimized platform selection based on computing features for improving the system throughput significantly. In addition, users would simply give R commands rather than run Java or Scala programto perform the data retrieval and analytics in the proposed platforms. As a result, according to performance index calculated for various methods, although the optimized platform selection can reduce the execution time for the data retrieval and analytics significantly, furthermore scheduling optimization definitely increases the system efficiency a lot.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] A survey on platforms for big data analytics
    Singh D.
    Reddy C.K.
    [J]. Journal of Big Data, 2 (1)
  • [2] A Compiler for Agnostic Programming and Deployment of Big Data Analytics on Multiple Platforms
    Di Martino, Beniamino
    Esposito, Antonio
    D'Angelo, Salvatore
    Maisto, Salvatore Augusto
    Nacchia, Stefania
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (09) : 1920 - 1931
  • [3] Popular platforms for big data analytics: A survey
    Merrouchi, Mohamed
    Skittou, Mustapha
    Gadi, Taoufiq
    [J]. 2018 INTERNATIONAL CONFERENCE ON ELECTRONICS, CONTROL, OPTIMIZATION AND COMPUTER SCIENCE (ICECOCS), 2018,
  • [4] A Performance Study of Big Data Analytics Platforms
    Pirzadeh, Pouria
    Carey, Michael
    Westmann, Till
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 2911 - 2920
  • [5] Cloud Computing Platforms for Big Data Adoption and Analytics
    Hussain, Mohammad Jabed
    Alsadie, Deafallah
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2022, 22 (02): : 290 - 296
  • [6] Applying intelligent data traffic adaptation to high-performance multiple big data analytics platforms
    Chang, Bao Rong
    Tsai, Hsiu-Fen
    Liao, Po-Hao
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2018, 70 : 998 - 1018
  • [7] Multiple Big Data Processing Platforms
    Chang, Bao Rong
    Tsai, Hsiu-Fen
    Chang, Yi-Sheng
    Huang, Chien-Feng
    [J]. 2016 CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI), 2016, : 207 - 211
  • [8] Big Data Platforms and Tools for Data Analytics in the Data Science Engineering Curriculum
    Demchenko, Yuri
    [J]. PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON CLOUD AND BIG DATA COMPUTING (ICCBDC 2019), 2019, : 60 - 64
  • [9] Big Data Analytics: A Preliminary Study of Open Source Platforms
    Nereu, Jorge
    Almeida, Ana
    Bernardino, Jorge
    [J]. ICSOFT: PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON SOFTWARE TECHNOLOGIES, 2017, : 435 - 440
  • [10] A Survey on Vertical and Horizontal Scaling Platforms for Big Data Analytics
    Ali, Ahmed Hussein
    Abdullah, Mahmood Zaki
    [J]. INTERNATIONAL JOURNAL OF INTEGRATED ENGINEERING, 2019, 11 (06): : 138 - 150