Development of Multiple Big Data Analytics Platforms with Rapid Response

被引:2
|
作者
Chang, Bao Rong [1 ]
Lee, Yun-Da [1 ]
Liao, Po-Hao [1 ]
机构
[1] Natl Univ Kaohsiung, Dept Comp Sci & Informat Engn, 700 Kaohsiung Univ Rd, Kaohsiung 811, Taiwan
关键词
BUSINESS INTELLIGENCE;
D O I
10.1155/2017/6972461
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The crucial problem of the integration of multiple platforms is how to adapt for their own computing features so as to execute the assignments most efficiently and gain the best outcome. This paper introduced the new approaches to big data platform, RHhadoop and SparkR, and integrated them to form a high-performance big data analytics with multiple platforms as part of business intelligence (BI) to carry out rapid data retrieval and analytics with R programming. This paper aims to develop the optimization for job scheduling using MSHEFT algorithm and implement the optimized platform selection based on computing features for improving the system throughput significantly. In addition, users would simply give R commands rather than run Java or Scala programto perform the data retrieval and analytics in the proposed platforms. As a result, according to performance index calculated for various methods, although the optimized platform selection can reduce the execution time for the data retrieval and analytics significantly, furthermore scheduling optimization definitely increases the system efficiency a lot.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] EVEREST: A design environment for extreme-scale big data analytics on heterogeneous platforms
    Pilato, Christian
    Bohm, Stanislav
    Brocheton, Fabien
    Castrillon, Jeronimo
    Cevasco, Riccardo
    Cima, Vojtech
    Cmar, Radim
    Diamantopoulos, Dionysios
    Ferrandi, Fabrizio
    Martinovic, Jan
    Palermo, Gianluca
    Paolino, Michele
    Parodi, Antonio
    Pittaluga, Lorenzo
    Raho, Daniel
    Regazzoni, Francesco
    Slaninova, Katerina
    Hagleitner, Christoph
    [J]. PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), 2021, : 1320 - 1325
  • [42] The growing role of integrated and insightful big and real-time data analytics platforms
    Ranganathan, Indrakumari
    Thangamuthu, Poongodi
    Palanimuthu, Suresh
    Balusamy, Balamurugan
    [J]. DIGITAL TWIN PARADIGM FOR SMARTER SYSTEMS AND ENVIRONMENTS: THE INDUSTRY USE CASES, 2020, 117 : 165 - 186
  • [43] Crisis analytics: big data-driven crisis response
    Junaid Qadir
    Anwaar Ali
    Raihan ur Rasool
    Andrej Zwitter
    Arjuna Sathiaseelan
    Jon Crowcroft
    [J]. Journal of International Humanitarian Action, 2016, 1 (1)
  • [44] Mapping the Big Data Landscape: Technologies, Platforms and Paradigms for Real-Time Analytics of Data Streams
    Dubuc, Timothee
    Stahl, Frederic
    Roesch, Etienne B.
    [J]. IEEE ACCESS, 2021, 9 : 15351 - 15374
  • [45] Big Data: The Structure & Value of Big Data Analytics
    Kim, Hak J.
    [J]. AMCIS 2015 PROCEEDINGS, 2015,
  • [46] Big data analytics and big data science: a survey
    Chen, Yong
    Chen, Hong
    Gorkhali, Anjee
    Lu, Yang
    Ma, Yiqian
    Li, Ling
    [J]. JOURNAL OF MANAGEMENT ANALYTICS, 2016, 3 (01) : 1 - 42
  • [47] Situated Big Data and Big Data Analytics for Healthcare
    Sterling, Mark
    [J]. 2017 IEEE GLOBAL HUMANITARIAN TECHNOLOGY CONFERENCE (GHTC), 2017,
  • [48] A note on big data analytics capability development in supply chain
    Jha, Ashish Kumar
    Agi, Maher A. N.
    Ngai, Eric W. T.
    [J]. DECISION SUPPORT SYSTEMS, 2020, 138
  • [49] A Big Data Analytics Approach for the Development of Advanced Cardiology Applications
    Carnevale, Lorenzo
    Celesti, Antonio
    Fazio, Maria
    Villari, Massimo
    [J]. INFORMATION, 2020, 11 (02)
  • [50] Survey on personalised recommendation system development in big data analytics
    Ezhilarasi, T. P.
    Rekha, K. Sashi
    [J]. INTERNATIONAL JOURNAL OF ENGINEERING SYSTEMS MODELLING AND SIMULATION, 2022, 13 (03) : 194 - 199