Distributed MapReduce Framework using Distributed Hash Table

被引:0
|
作者
Chiu, Chuan-Feng [1 ]
Hsu, Steen J. [1 ]
Jan, Sen-Ren [1 ]
机构
[1] Minghsin Univ Sci & Technol, Dept Informat Management, Xinfeng Hsinchu, Taiwan
关键词
cloud computing; MapReduce; Distributed Hash Tables;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In past years, Cloud computing is gained more attention in industry and academic area. The advance technologies are needed to match the demand of the development of cloud computing. MapReduce is one of the enabling technology. MapReduce is a programming model supporting parallel computation especially for data-intensive cloud computing applications. However, MapReduce needs a master node to coordinate the execution of the parallel computation. This may cause communication bottleneck and single point of failure error. Therefore, in this paper we propose a distributed MapReduce framework based on Distributed Hash Tables to support large scale cloud computing applications.
引用
收藏
页码:475 / 480
页数:6
相关论文
共 50 条
  • [1] Social distributed hash table
    Matuszewski, Marcin
    Garcia-Martin, Miguel A.
    [J]. 2007 IEEE WIRELESS COMMUNICATIONS & NETWORKING CONFERENCE, VOLS 1-9, 2007, : 2814 - 2820
  • [2] Fully Distributed Indexing over a Distributed Hash Table
    Desaulniers, Simon
    Beraud, Adrien
    Masse, Alexandre Blondin
    Reynaud, Nicolas
    [J]. UBIQUITOUS NETWORKING, UNET 2017, 2017, 10542 : 308 - 318
  • [3] LOAD REBALANCING FOR HADOOP DISTRIBUTED FILE SYSTEM USING DISTRIBUTED HASH TABLE
    Nithya, M.
    Maheshwari, N. Uma
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT SUSTAINABLE SYSTEMS (ICISS 2017), 2017, : 939 - 943
  • [4] Dermi:: A new distributed hash table-based middleware framework
    Gavaldà, CP
    López, PG
    Skarmeta, AFG
    [J]. IEEE INTERNET COMPUTING, 2004, 8 (03) : 74 - 84
  • [5] A Distributed Hash Table for Shared Memory
    Oortwijn, Wytse
    van Dijk, Tom
    van de Pol, Jaco
    [J]. PARALLEL PROCESSING AND APPLIED MATHEMATICS, PPAM 2015, PT II, 2016, 9574 : 15 - 24
  • [6] Towards Secure Distributed Hash Table
    Wang, Zhe
    Minsky, Naftaly H.
    [J]. COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS, AND WORKSHARING, COLLABORATECOM 2015, 2016, 163 : 257 - 266
  • [7] Distributed Hash Table on mobile phones
    Kelenyi, Imre
    Forstner, Bertalan
    [J]. 2008 5TH IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, VOLS 1-3, 2008, : 1226 - 1227
  • [8] Data Recovery of Distributed Hash Table with Distributed-to-Distributed Data Copy
    Doi, Yusuke
    Wakayama, Shirou
    Ozaki, Satoshi
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2009, E92D (10) : 1999 - 2006
  • [9] A Distributed Framework for Event Log Analysis using MapReduce
    Dewangan, Sandeep Kumar
    Pandey, Shikha
    Verma, Toran
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2016, : 503 - 506
  • [10] A Distributed Control Plane for the Internet of Things Based on a Distributed Hash Table
    Bolonio, Jaime Jimenez
    Uruena, Manuel
    Camarillo, Gonzalo
    [J]. MOBILE NETWORKS AND MANAGEMENT, 2013, 125 : 108 - 121