Algorithmic Mechanisms for Reliable Master-Worker Internet-Based Computing

被引:10
|
作者
Christoforou, Evgenia [1 ,2 ]
Fernandez Anta, Antonio [1 ]
Georgiou, Chryssis [3 ]
Mosteiro, Miguel A. [4 ,5 ]
机构
[1] Inst IMDEA Networks, Leganes 28918, Spain
[2] Univ Carlos III Madrid, Leganes 28918, Spain
[3] Univ Cyprus, Dept Comp Sci, CY-1678 Nicosia, Cyprus
[4] Kean Univ, Dept Comp Sci, Union, NJ 07083 USA
[5] Univ Rey Juan Carlos, Dept Telemat Syst & Comp Sci, Madrid, Spain
基金
美国国家科学基金会;
关键词
Algorithmic mechanism design; Internet-based computing; reliability and fault-tolerance; untrusted workers; unreliable communication;
D O I
10.1109/TC.2012.186
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We consider Internet-based master-worker computations, where a master processor assigns, across the Internet, a computational task to a set of untrusted worker processors, and collects their responses. Examples of such computations are the "@home" projects such as SETI. In this work, various worker behaviors are considered. Altruistic workers always return the correct result of the task, malicious workers always return an incorrect result, and rational workers act based on their self-interest. In a massive computation platform, such as the Internet, it is expected that all three type of workers coexist. Therefore, in this work, we study Internet-based master-worker computations in the presence of malicious, altruistic, and rational workers. A stochastic distribution of the workers over the three types is assumed. In addition, we consider the possibility that the communication between the master and the workers is not reliable, and that workers could be unavailable. Considering all the three types of workers renders a combination of game-theoretic and classical distributed computing approaches to the design of mechanisms for reliable Internet-based computing. Indeed, in this work, we design and analyze two algorithmic mechanisms to provide appropriate incentives to rational workers to act correctly, despite the malicious workers' actions and the unreliability of the communication. Only when necessary, the incentives are used to force the rational players to a certain equilibrium (which forces the workers to be truthful) that overcomes the attempt of the malicious workers to deceive the master. Finally, the mechanisms are analyzed in two realistic Internet-based master-worker settings, a SETI-like one and a contractor-based one, such as Amazon's mechanical turk. We also present plots that illustrate the tradeoffs between reliability and cost, under different system parameters.
引用
收藏
页码:179 / 195
页数:17
相关论文
共 50 条
  • [1] RELIABLE INTERNET-BASED MASTER-WORKER COMPUTING IN THE PRESENCE OF MALICIOUS WORKERS
    Fernandez Anta, Antonio
    Georgiou, Chryssis
    Lopez, Luis
    Santos, Agustin
    PARALLEL PROCESSING LETTERS, 2012, 22 (01)
  • [2] Brief Announcement: Algorithmic Mechanisms for Internet-Based Computing under Unreliable Communication
    Christoforou, Evgenia
    Fernandez Anta, Antonio
    Ceorgiou, Chryssis
    Mosteiro, Miguel A.
    DISTRIBUTED COMPUTING, 2011, 6950 : 147 - +
  • [3] Applying the dynamics of evolution to achieve reliability in master-worker computing
    Christoforou, Evgenia
    Fernandez Anta, Antonio
    Georgiou, Chryssis
    Mosteiro, Miguel A.
    Sanchez, Angel
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2013, 25 (17): : 2363 - 2380
  • [4] Achieving Reliability in Master-Worker Computing via Evolutionary Dynamics
    Christoforou, Evgenia
    Fernandez Anta, Antonio
    Georgiou, Chryssis
    Mosteiro, Miguel A.
    Sanchez, Angel
    EURO-PAR 2012 PARALLEL PROCESSING, 2012, 7484 : 451 - 463
  • [5] Dynamic MPI parallel task scheduling based on a master-worker pattern in cloud computing
    Ding, Fan
    Wienke, Sandra
    Zhang, Ruisheng
    International Journal of Autonomous and Adaptive Communications Systems, 2015, 8 (04) : 424 - 438
  • [6] Multi-round Master-Worker Computing: A Repeated Game Approach
    Fernandez Anta, Antonio
    Georgiou, Chryssis
    Mosteiro, Miguel A.
    Pareja, Daniel
    PROCEEDINGS OF 2016 IEEE 35TH SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS), 2016, : 31 - 40
  • [7] Distributed computing with hierarchical master-worker paradigm for parallel branch and bound algorithm
    Aida, K
    Natsume, W
    Futakata, Y
    CCGRID 2003: 3RD IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, PROCEEDINGS, 2003, : 156 - 163
  • [8] Active reliable multicast strategies for Internet-based grid computing infrastructures
    Maimour, M
    Pham, C
    IC'2001: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTERNET COMPUTING, VOLS I AND II, 2001, : 437 - 443
  • [9] Model-based performance diagnosis of Master-Worker parallel computations
    Li, Li
    Malony, Allen D.
    EURO-PAR 2006 PARALLEL PROCESSING, 2006, 4128 : 35 - 46
  • [10] Towards dynamic adaptability support for the master-worker paradigm in component based applications
    Andre, Francoise
    Bouziane, Hinde Lilia
    Buisson, Jeremy
    Pazat, Jean-Louis
    Perez, Christian
    TOWARDS NEXT GENERATION GRIDS, 2007, : 117 - +