High-Productivity Parallelism With Python']Python Plus Packages (But Without a Cluster)

被引:1
|
作者
Bartlett, John [1 ]
Uchytil, Chris [1 ]
Storti, Duane [1 ]
机构
[1] Univ Washington, Seattle, WA 98195 USA
关键词
Mathematical model; Graphics processing units; Arrays; Computational modeling; Tensors; Kernel; Parallel processing;
D O I
10.1109/MCSE.2021.3082864
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We present two computing projects, peridynamics simulation and numerical integration on implicit domains, for which we realized high performance implementations using Python with appropriate packages. The problems are sufficiently compute intensive that a straightforward serial implementation is prohibitively slow. While conventional wisdom suggests moving such problems onto a computing cluster, we very directly produced high-performance parallel implementations that effectively perform the computing tasks on a single GPU. For the peridynamics application, the only package needed in addition to Numpy is Numba whose just-in-time compiler allows us to write kernel functions in Python and compile them to run in parallel on a CUDA-enabled GPU. Our approach to numerical integration on implicit domains invokes two additional packages to support interval arithmetic and dynamic parallelism to enable tree-structured recursive refinement. Use of Python (with only kernels requiring dynamic parallelism written in C) enabled rapid development of concise code that successfully achieves significant performance enhancement.
引用
收藏
页码:38 / 46
页数:9
相关论文
共 6 条
  • [1] Linkage of XcalableMP and Python']Python languages for high productivity on HPC cluster system
    Nakao, Masahiro
    Murai, Hitoshi
    Boku, Taisuke
    Sato, Mitsuhisa
    [J]. HPC ASIA'18: PROCEEDINGS OF WORKSHOPS OF HPC ASIA, 2018, : 39 - 47
  • [2] PySHMEM: A High Productivity OpenSHMEM Interface for Python']Python
    Welch, Aaron
    Shamis, Pavel
    Hao, Pengfei
    Chapman, Barbara
    [J]. 2015 9TH INTERNATIONAL CONFERENCE ON PARTITIONED GLOBAL ADDRESS SPACE PROGRAMMING MODELS (PGAS), 2015, : 99 - 101
  • [3] High-performance Python']Python-C plus plus bindings with PyPy and Cling
    Lavrijsen, Wim T. L. P.
    Dutta, Aditi
    [J]. PROCEEDINGS OF PYHPC2016: 6TH WORKSHOP ON PYTHON FOR HIGH-PERFORMANCE AND SCIENTIFIC COMPUTING, 2016, : 27 - 35
  • [4] Octave and python']python: High-level scripting languages productivity and performance evaluation
    Chaves, Juan Carlos
    Nehrbass, John
    Guilfoos, Brian
    Gardiner, Judy
    Ahalt, Stanley
    Krishnarnurthy, Ashok
    Unpingco, Jose
    Chalker, Alan
    Warnock, Andy
    Samsi, Siddharth
    [J]. PROCEEDINGS OF THE HPCMP USERS GROUP CONFERENCE 2006, 2006, : 429 - 434
  • [5] Optimization of Aggregate Production Planning Problems with and without Productivity Loss using Python']Python Pulp Package
    Rehman, Hakeem Ur
    Ahmad, Ayyaz
    Ali, Zarak
    Baig, Sajjad Ahmad
    Manzoor, Umair
    [J]. MANAGEMENT AND PRODUCTION ENGINEERING REVIEW, 2021, 12 (04) : 38 - 44
  • [6] Hi-LASSO: High-performance python']python and apache spark packages for feature selection with high-dimensional data
    Jo, Jongkwon
    Jung, Seungha
    Park, Joongyang
    Kim, Youngsoon
    Kang, Mingon
    [J]. PLOS ONE, 2022, 17 (12):