Heterogeneous Architectures for Big Data Batch Processing in MapReduce Paradigm

被引:12
|
作者
Goudarzi, Maziar [1 ]
机构
[1] Sharif Univ Technol, Comp Engn Dept, Tehran 11365, Iran
关键词
Big data; hardware accelerator; FPGA; MapReduce; Hadoop; data center; efficiency; MEMORY;
D O I
10.1109/TBDATA.2017.2736557
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The amount of digital data produced worldwide is exponentially growing. While the source of this data, collectively known as Big Data, varies from among mobile services to cyber physical systems and beyond, the invariant is their increasingly rapid growth for the foreseeable future. Immense incentives exist, from marketing campaigns to forensics and to research in social sciences, that motivate processing increasingly bigger data so as to extract information and knowledge for the betterment of processes and benefits. Consequently, the need for more efficient computing systems tailored to such big data applications is increasingly intensified. Such custom architectures would expectedly embrace heterogeneity to better match each phase of the computation. In this paper we review state of the art as well as envisioned future large-scale computing architectures customized for batch processing of big data applications in the MapReduce paradigm. We also provide our view of current important trends relevant to such systems, and their impacts on future architectures and architectural features expected to address the needs of tomorrow big data processing in this paradigm.
引用
收藏
页码:18 / 33
页数:16
相关论文
共 50 条
  • [1] Prominence of MapReduce in BIG DATA Processing
    Pandey, Shweta
    Tokekar, Vrinda
    [J]. 2014 FOURTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT), 2014, : 555 - 560
  • [2] Big data classification using heterogeneous ensemble classifiers in Apache Spark based on MapReduce paradigm
    Kadkhodaei, Hamidreza
    Moghadam, Amir Masoud Eftekhari
    Dehghan, Mehdi
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 183
  • [3] Efficient Big Data Processing in Hadoop MapReduce
    Dittrich, Jens
    Quiane-Ruiz, Jorge-Arnulfo
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (12): : 2014 - 2015
  • [4] Big Data Analytics on Heterogeneous Accelerator Architectures
    Neshatpour, Katayoun
    Sasan, Avesta
    Homayoun, Houman
    [J]. 2016 INTERNATIONAL CONFERENCE ON HARDWARE/SOFTWARE CODESIGN AND SYSTEM SYNTHESIS (CODES+ISSS), 2016,
  • [5] Heterogeneous Chip Multiprocessor Architectures for Big Data Applications
    Homayoun, Houman
    [J]. PROCEEDINGS OF THE ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS (CF'16), 2016, : 400 - 405
  • [6] The Performance Optimization of Big Data Processing by Adaptive MapReduce Workflow
    Li, Wei
    Tang, Maolin
    [J]. IEEE ACCESS, 2022, 10 : 79004 - 79020
  • [7] Verifying Properties of MapReduce-Based Big Data Processing
    Zhang, Nan
    Wang, Meng
    Duan, Zhenhua
    Tian, Cong
    [J]. IEEE TRANSACTIONS ON RELIABILITY, 2022, 71 (01) : 321 - 338
  • [8] Big Data Processing with Probabilistic Latent Semantic Analysis on MapReduce
    Zhao, Yong
    Chen, Yao
    Liang, Zhao
    Yuan, Shuangshuang
    Li, Youfu
    [J]. 2014 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY (CYBERC), 2014, : 162 - 166
  • [9] Issues and Challenges of Heterogeneous Datasets in MapReduce Framework of Big Data Environment
    Gupta, Saraswati
    Bhatnagar, Vishal
    Chadha, Ramneet Singh
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ICT FOR SUSTAINABLE DEVELOPMENT ICT4SD 2015, VOL 2, 2016, 409 : 751 - 759
  • [10] An Efficient Batch Similarity Processing with MapReduce
    Trong Nhan Phan
    Tran Khanh Dang
    [J]. FUTURE DATA AND SECURITY ENGINEERING, FDSE 2018, 2018, 11251 : 158 - 171