An Expressive Hadoop MapReduce Framework

被引：0
|
作者：
Shah, Nathar [1 ,3 ]
Messom, Christopher [2 ]
机构：
[1] Multimedia Univ, Fac Comp & Informat, Cyberjaya 63100, Malaysia
[2] Monash Univ, Sch Informat Technol, Clayton, Vic 3800, Australia
[3] Monash Univ, Sch Informat Technol, Bandar Sunway 47500, Malaysia
来源：
ADVANCED SCIENCE LETTERS | 2017年 / 23卷 / 11期
关键词：
Expressive; Hadoop MapReduce; Parallel Trees;
D O I：
10.1166/asl.2017.10250
中图分类号：
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号：
07 ; 0710 ; 09 ;
摘要：
The traditional Hadoop MapReduce framework is a simple programming model for large scale parallel and distributed data processing. However, the model is not structured for semantic-oriented large data processing since it is not expressive. This paper presents a tree-oriented approach to enable expressiveness in the traditional Hadoop MapReduce framework. The new tree based MapReduce structure provides for group based processing, level based processing, and traversal order based processing. Stand-alone or nested, these processing constructs provides the required expressivity for semantic-oriented large data processing. This is accomplished yet preserving the fundamental benefit of traditional MapReduce framework-fault-tolerant processing.
引用
收藏
页码：11197 / 11201
页数：5
相关论文
共 50 条
  • [1] SmartGrids: MapReduce Framework using Hadoop
    Fanibhare, Vaibhav
    Dahake, Vijay
    [J]. 2016 3RD INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2016, : 406 - 411
  • [2] Introducing SSDs to the Hadoop MapReduce Framework
    Moon, Sangwhan
    Lee, Jaehwan
    Kee, Yang-suk
    [J]. 2014 IEEE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2014, : 272 - 279
  • [3] Tree Structure for Expressive MapReduce Framework
    Shah, Nathar
    Messom, Chris
    [J]. 2017 INTERNATIONAL CONFERENCE ON SOFTWARE AND E-BUSINESS (ICSEB 2017), 2015, : 33 - 37
  • [4] Straggler Mitigation in Hadoop MapReduce Framework: A Review
    Ajibade, Lukuman Saheed
    Bakar, Kamalrulnizam Abu
    Aliyu, Ahmed
    Danish, Tasneem
    [J]. International Journal of Advanced Computer Science and Applications, 2022, 13 (08): : 870 - 878
  • [5] Evaluation of Hadoop/Mapreduce Framework Migration Tools
    Odia, Trust
    Misra, Sanjay
    Adewumi, Adewole
    [J]. 2014 ASIA-PACIFIC WORLD CONGRESS ON COMPUTER SCIENCE AND ENGINEERING (APWC ON CSE), 2014,
  • [6] Scientific data processing framework for Hadoop MapReduce
    Department of Computer and Information, Xinxiang University, Xinxiang, China
    [J]. J. Chem. Pharm. Res., 6 (2950-2954):
  • [7] Straggler Mitigation in Hadoop MapReduce Framework: A Review
    Ajibade, Lukuman Saheed
    Abu Bakar, Kamalrulnizam
    Aliyu, Ahmed
    Danish, Tasneem
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (08) : 870 - 878
  • [8] A Parallel Genetic Algorithms Framework based on Hadoop MapReduce
    Ferrucci, Filomena
    Salza, Pasquale
    Kechadi, M-Tahar
    Sarro, Federica
    [J]. 30TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, VOLS I AND II, 2015, : 1664 - 1667
  • [9] Implementation of Page Rank Algorithm in Hadoop MapReduce Framework
    Bhawivuga, Adhitya
    Kirana, Annisa Puspa
    [J]. 2016 INTERNATIONAL SEMINAR ON INTELLIGENT TECHNOLOGY AND ITS APPLICATIONS (ISITIA): RECENT TRENDS IN INTELLIGENT COMPUTATIONAL TECHNOLOGIES FOR SUSTAINABLE ENERGY, 2016, : 231 - 235
  • [10] HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework
    Gandomi, Abolfazl
    Reshadi, Midia
    Movaghar, Ali
    Khademzadeh, Ahmad
    [J]. JOURNAL OF BIG DATA, 2019, 6 (01)
12345