Beyond Map-Reduce: LATNODE - A New Programming Paradigm for Big Data Systems

被引：0
|
作者：
Sheng, Chai Yit [1 ]
Keong, Phang Keat [1 ]
机构：
[1] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur, Malaysia
来源：
INFORMATION SCIENCE AND APPLICATIONS 2017, ICISA 2017 | 2017年 / 424卷
关键词：
Big data; Map-Reduce; Trees; Lambda calculus; Functional programming; Programming paradigm;
D O I：
10.1007/978-981-10-4154-9_9
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The Compute Aggregate model used to model Map Reduce does not allow for dynamic node reordering once a job has started, assumes homogenous nodes and a balanced tree layout. We introduce heterogeneous nodes into the tree structure, thereby causing unbalanced trees. Finally, we present a new programming abstraction to allow for dynamic tree balancing.
引用
收藏
页码：69 / 75
页数：7
相关论文
共 50 条
  • [41] AN IMPLEMENTATION OF A DISTRIBUTED STOCHASTIC GRADIENT DESCENT FOR RECOMMENDER SYSTEMS BASED ON MAP-REDUCE
    Pozo, Manuel
    Chiky, Raja
    [J]. 2015 INTERNATIONAL WORKSHOP ON COMPUTATIONAL INTELLIGENCE FOR MULTIMEDIA UNDERSTANDING (IWCIM), 2015,
  • [42] Dimensioning Scientific Computing systems to improve performance of Map-Reduce based applications
    Castane, Gabriel G.
    Nunez, Alberto
    Filgueira, Rosa
    Carretero, Jesus
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, ICCS 2012, 2012, 9 : 226 - 235
  • [43] A Map-Reduce Approach for the Dijkstra Algorithm in SDN Over Osmotic Computing Systems
    Fazio, Maria
    Buzachis, Alina
    Galletta, Antonino
    Celesti, Antonio
    Wan, Jiafu
    Longo, Antonella
    Villari, Massimo
    [J]. INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2021, 49 (03) : 347 - 375
  • [44] Scalable preference queries for high-dimensional data using map-reduce
    Guzun, Gheorghi
    Tosado, Joel E.
    Canahuate, Guadalupe
    [J]. PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 2243 - 2252
  • [45] A Map-Reduce Approach for the Dijkstra Algorithm in SDN Over Osmotic Computing Systems
    Maria Fazio
    Alina Buzachis
    Antonino Galletta
    Antonio Celesti
    Jiafu Wan
    Antonella Longo
    Massimo Villari
    [J]. International Journal of Parallel Programming, 2021, 49 : 347 - 375
  • [46] Unstructured Data Analysis on Big Data using Map Reduce
    Subramaniyaswamy, V
    Vijayakumar, V.
    Logesh, R.
    Indragandhi, V
    [J]. BIG DATA, CLOUD AND COMPUTING CHALLENGES, 2015, 50 : 456 - 465
  • [47] An enlarged map-reduce using 2logmean-PSO optimization for unstructured data
    Kanimozhi, K., V
    Krishnan, Rajakumar
    Venkatesan, M.
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL ENGINEERING EDUCATION, 2019,
  • [48] Performance Enhancement in Big Data by Guided Map Reduce
    Ray, Himadri Sekhar
    Chakraborty, Anurag
    Kar, Radib
    [J]. INFORMATION, COMMUNICATION AND COMPUTING TECHNOLOGY (ICICCT 2021), 2021, 1417 : 3 - 17
  • [49] On the Performance Analysis of Map-Reduce Programming Model on In-Memory NoSQL Storage Platforms: A Case Study
    Yuzuk, Secil
    Aktas, Murat G.
    Aktas, Mehmet S.
    [J]. 2018 INTERNATIONAL CONGRESS ON BIG DATA, DEEP LEARNING AND FIGHTING CYBER TERRORISM (IBIGDELFT), 2018, : 45 - 50
  • [50] A Map Reduce solution for associative classification of big data
    Bechini, Alessio
    Marcelloni, Francesco
    Segatori, Armando
    [J]. INFORMATION SCIENCES, 2016, 332 : 33 - 55
12345