Grid and P2P middleware for wide-area parallel processing

被引:2
|
作者
Xhafa, Fatos [1 ]
Pllana, Sabri [2 ]
Barolli, Leonard [3 ]
Spaho, Evjola [4 ]
机构
[1] Tech Univ Catalonia, Barcelona 08304, Catalonia, Spain
[2] Univ Vienna, Dept Comp Sci, A-1090 Vienna, Austria
[3] Fukuoka Inst Technol, Dept Informat & Commun Engn, Higashi Ku, Fukuoka 8110295, Japan
[4] Fukuoka Inst Technol, Grad Sch Engn, Higashi Ku, Fukuoka 8110295, Japan
来源
关键词
Grid computing; P2P computing; parallel processing; middleware; communications libraries; e-Science applications; PEER; IMPLEMENTATION; COMMUNICATION; ARCHITECTURE; INTERFACE; FRAMEWORK; MODELS;
D O I
10.1002/cpe.1657
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Grid computing emerged as a paradigm for high-performance computing and massive parallel processing. Currently, Grid systems have become an important paradigm for efficiently solving large-scale complex problems from many fields. On the other hand, P2P paradigm originated from file-sharing, but each time more is being used for the development of large-scale distributed platforms. Grid and P2P systems have thus followed different trajectories pushed by different motivations, needs and research communities. In fact, both paradigms are evolving in a way that each time they are sharing more common characteristics and are mutually benefiting from their best features. Among these characteristics, we could distinguish the cooperative model for solving complex problems by exploiting their large computing capacity. As such, Grid and P2P systems have achieved notable success, in particular, for e-Science applications, a family of complex applications arising in science and engineering that need considerable computation power. Despite important advances in the design and use of Grid and P2P systems, they remain still difficult to implement and apply to real-life problems. The main difficulties reside in the lack of easy-to-use middleware for Grid and P2P, in the complexities of setting up and in the tedious task of deploying real-world Grid/P2P platforms as well as in experimental studies which are often complex and not easy to repeat. In this paper we survey and analyze the advances in communication libraries and middleware for both Grid and P2P systems as well as their limitations when used in real Grid and P2P infrastructures. We also bring examples of real- life applications of massive data processing that can be efficiently handled through Grid and P2P approaches. Copyright (C) 2010 John Wiley & Sons, Ltd.
引用
收藏
页码:458 / 476
页数:19
相关论文
共 50 条
  • [21] An adaptive parallel query processing middleware for the Grid
    Da Silva, V. F. V.
    Dutra, M. L.
    Porto, F.
    Schulze, B.
    Barbosa, A. C.
    de Oliveira, J. C.
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2006, 18 (06): : 621 - 634
  • [22] Demand forecasting in P2P and GRID systems
    Loeser, C
    [J]. ISAS/CITSA 2004: INTERNATIONAL CONFERENCE ON CYBERNETICS AND INFORMATION TECHNOLOGIES, SYSTEMS AND APPLICATIONS AND 10TH INTERNATIONAL CONFERENCE ON INFORMATION SYSTEMS ANALYSIS AND SYNTHESIS, VOL 1, PROCEEDINGS: COMMUNICATIONS, INFORMATION TECHNOLOGIES AND COMPUTING, 2004, : 386 - 391
  • [23] A scalable P2P platform for the knowledge grid
    Zhuge, H
    Sun, XP
    Liu, J
    Yao, EL
    Chen, X
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (12) : 1721 - 1736
  • [24] P2P与Grid的结合:P2P-Grid模型研究
    叶从欢
    江武汉
    孙世新
    [J]. 网络安全与数据治理, 2005, (05) : 4 - 6
  • [25] Data management in Grid and P2P systems
    Hameurlain, Abdelkader
    [J]. COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2008, 23 (02): : 57 - 58
  • [26] Grid and P2P economics and market models
    Hwang, J
    Lee, CH
    Song, J
    Pyo, K
    [J]. GECON 2004, 2004, : 3 - 18
  • [27] A file transfer service with client/server, P2P and Wide Area Storage Protocols
    Fedak, Gilles
    He, Haiwu
    Cappello, Franck
    [J]. DATA MANAGEMENT IN GRID AND PEER-TO-PEER SYSTEMS, PROCEEDINGS, 2008, 5187 : 1 - +
  • [28] A wide-area synchronized parallel processing platform for power system monitoring and control
    Wang, SR
    Ma, J
    Cheng, SJ
    Wen, J
    Sun, HS
    Li, G
    Zhang, P
    [J]. UPEC 2004: 39th International Universitities Power Engineering Conference, Vols 1-3, Conference Proceedings, 2005, : 822 - 826
  • [29] SCTP-based middleware for MPI in wide-area networks
    Kamal, H
    Penoff, B
    Wagner, A
    [J]. PROCEEDINGS OF THE 3RD ANNUAL COMMUNICATION NETWORKS AND SERVICES RESEARCH CONFERENCE, 2005, : 157 - 162
  • [30] A scalable middleware solution for advanced wide-area Web services
    van Steen, M
    Tanenbaum, AS
    Kuz, I
    Sips, HJ
    [J]. MIDDLEWARE'98: IFIP INTERNATIONAL CONFERENCE ON DISTRIBUTED SYSTEMS PLATFORMS AND OPEN DISTRIBUTED PROCESSING, 1998, : 37 - 53