Provision of Docker and InfiniBand in High Performance Computing

被引:0
|
作者
Minh Thanh Chung [1 ]
Le, An [1 ]
Nguyen Quang-Hung [1 ]
Duc-Dung Nguyen [1 ]
Nam Thoai [1 ]
机构
[1] HCMC Univ Technol, Fac Comp Sci & Engn, VNU HCM, Ho Chi Minh City, Vietnam
关键词
Docker; InfiniBand; HPC; performance evaluation; Graph500; HPL; Cloud Computing;
D O I
10.1109/ACOMP.2016.24
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
High Performance Computing (HPC) is playing an important role in a variety of domains with the demand of high-level computational capacity. Besides, HPC provides services for a huge range of different users as well as multiple environments. Hence, the performance of the network is also one of the important criteria. The advent of InfiniBand (IB) aims at the improvement of computer-networking. IB technology has been used and expanded on virtualization environments, especially in virtual machines (VMs). Recently, another virtualization technique known as Docker platform is being popularly considered. Docker promises to bring higher performance, but it also poses some challenging problems. Concretely, while VMs are combined with IB by standard virtualization modules such as SR-IOV, Docker containers are still being examined on feasible solutions with IB. An important question is the advantages and disadvantages of both architectures, namely VM and Docker. In this paper, we deploy Docker on IB infrastructure and evaluate their performance with VMs. Remarkably, we highlight the benefits and the drawbacks of Docker in the conflict of resources when its architecture shares the same kernel with the host. Our evaluations emphasize the potential of Docker containers in HPC field, simultaneously, we propose experiences when using Docker for running parallel applications.
引用
收藏
页码:127 / 134
页数:8
相关论文
共 50 条
  • [1] High Performance Computing with Harness over InfiniBand
    Valentini, A.
    Di Biagio, C.
    Batino, F.
    Pennella, G.
    Palma, F.
    Engelmann, C.
    [J]. PROCEEDINGS OF THE PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING, 2009, : 151 - +
  • [2] Using Docker in High Performance Computing Applications
    Minh Thanh Chung
    Nguyen Quang-Hung
    Manh-Thin Nguyen
    Nam Thoai
    [J]. 2016 IEEE SIXTH INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND ELECTRONICS (ICCE), 2016, : 52 - 57
  • [3] An enhanced congestion control mechanism in InfiniBand networks for High Performance Computing systems
    Yan, Shihang
    Min, Geyong
    Awan, Irfan
    [J]. 20TH INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOL 1, PROCEEDINGS, 2006, : 845 - +
  • [4] Enabling Docker Containers for High-Performance and Many-Task Computing
    Azab, Abdulrahman
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E 2017), 2017, : 279 - 285
  • [5] Exploring Infiniband Hardware Virtualization in OpenNebula towards Efficient High-Performance Computing
    Ruivo, Tiago Pais Pitta de Lacerda
    Altayo, Gerard Bernabeu
    Garzoglio, Gabriele
    Timm, Steven
    Kim, Hyun Woo
    Noh, Seo-Young
    Raicu, Ioan
    [J]. 2014 14TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2014, : 943 - 948
  • [6] A High Performance Superpipeline Protocol for InfiniBand
    Denis, Alexandre
    [J]. EURO-PAR 2011 PARALLEL PROCESSING, PT 2, 2011, 6853 : 276 - 287
  • [7] Evaluating ARM and RISC-V Architectures for High-Performance Computing with Docker and Kubernetes
    Dakic, Vedran
    Mrsic, Leo
    Kunic, Zdravko
    Dambic, Goran
    [J]. ELECTRONICS, 2024, 13 (17)
  • [8] Docker Characterization on High Performance SSDs
    Xu, Qiumin
    Awasthi, Manu
    Malladi, Krishna T.
    Bhimani, Janki
    Yang, Jingpei
    Annavaram, Murali
    [J]. 2017 IEEE INTERNATIONAL SYMPOSIUM ON PERFORMANCE ANALYSIS OF SYSTEMS AND SOFTWARE (ISPASS), 2017, : 133 - 134
  • [9] In-kernel integration of operating system and infiniband functions for high performance computing clusters: A DSM example
    Liss, L
    Birk, Y
    Schuster, A
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2005, 16 (09) : 830 - 840
  • [10] A methodology to enable QoS provision on InfiniBand hardware
    Javier Cano-Cano
    Francisco J. Andújar
    Jesús Escudero-Sahuquillo
    Francisco J. Alfaro-Cortés
    José L. Sánchez
    [J]. The Journal of Supercomputing, 2021, 77 : 9934 - 9946