Proposal of Container-Based HPC Structures and Performance Analysis

被引:10
|
作者
Yong, Chanho [1 ]
Lee, Go-Won [1 ]
Huh, Eui-Nam [1 ]
机构
[1] Kyung Hee Univ, Dept Comp Sci & Engn, Suwon, South Korea
来源
关键词
Container; Docker; High-Performance Computing; Singularity;
D O I
10.3745/JIPS.01.0033
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
High-performance computing (HPC) provides to researchers a powerful ability to resolve problems with intensive computations, such as those in the math and medical fields. When an HPC platform is provided as a service, users may suffer from unexpected obstacles in developing and running applications due to restricted development environments and dependencies. In this context, operating system level virtualization can be a solution for HPC service to ensure lightweight virtualization and consistency in Dev-Ops environments. Therefore, this paper proposes three types of typical HPC structure for container environments built with HPC container and Docker. The three structures focus on smooth integration with existing HPC job framework, message passing interface (MPI). Lastly, the performance of the structures is analyzed with High Performance Linpack benchmark from the aspect of performance degradation in network communications under Docker.
引用
收藏
页码:1398 / 1404
页数:7
相关论文
共 50 条
  • [1] High Performance MPI Library for Container-based HPC Cloud on InfiniBand Clusters
    Zhang, Jie
    Lu, Xiaoyi
    Panda, Dhabaleswar K.
    [J]. PROCEEDINGS 45TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING - ICPP 2016, 2016, : 268 - 277
  • [2] Providing Security in Container-Based HPC Runtime Environments
    Gantikow, Holger
    Reich, Christoph
    Knahl, Martin
    Clarke, Nathan
    [J]. HIGH PERFORMANCE COMPUTING, ISC HIGH PERFORMANCE 2016 INTERNATIONAL WORKSHOPS, 2016, 9945 : 685 - 695
  • [3] Performance Impact of IEEE 802.3ad in Container-Based Clouds for HPC Applications
    Maliszewski, Anderson M.
    Roloff, Eduardo
    Griebler, Dalvan
    Gaspary, Luciano P.
    Navaux, Philippe O. A.
    [J]. COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2020, PT VI, 2020, 12254 : 158 - 167
  • [4] Minimizing Communication Overheads in Container-based Clouds for HPC Applications
    Maliszewski, Anderson M.
    Vogel, Adriano
    Griebler, Dalvan
    Roloff, Eduardo
    Fernandes, Luiz G.
    Navaux, Philippe O. A.
    [J]. 2019 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (ISCC), 2019, : 474 - 479
  • [5] Improving the efficiency of HPC data movement on container-based virtual cluster
    Huang, Dan
    Lu, Yutong
    [J]. CCF TRANSACTIONS ON HIGH PERFORMANCE COMPUTING, 2020, 2 (01) : 67 - 80
  • [6] Performance Analysis of Container-based Hadoop Cluster : OpenVZ and LXC
    Rizki, Rizki
    Rakhmatsyah, Andrian
    Nugroho, M. Arief
    [J]. 2016 4TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY (ICOICT), 2016,
  • [7] Crescoware: A Container-Based Gateway for HPC and AI Applications in the ENEAGRID Infrastructure
    Mariano, Angelo
    D'Amato, Giulio
    Formisano, Giovanni
    Guarnieri, Guido
    Santomauro, Giuseppe
    Migliori, Silvio
    [J]. INTELLIGENT COMPUTING, VOL 1, 2022, 506 : 196 - 206
  • [8] Improving the efficiency of HPC data movement on container-based virtual cluster
    Dan Huang
    Yutong Lu
    [J]. CCF Transactions on High Performance Computing, 2020, 2 : 67 - 80
  • [9] Investigating performance metrics for container-based HPC environments using x86 and OpenPOWER systems
    Animesh Kuity
    Sateesh K. Peddoju
    [J]. Journal of Cloud Computing, 12
  • [10] Investigating performance metrics for container-based HPC environments using x86 and OpenPOWER systems
    Kuity, Animesh
    Peddoju, Sateesh K.
    [J]. JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2023, 12 (01):