Linkage of XcalableMP and Python']Python languages for high productivity on HPC cluster system

被引:0
|
作者
Nakao, Masahiro [1 ]
Murai, Hitoshi [1 ]
Boku, Taisuke [2 ]
Sato, Mitsuhisa [1 ]
机构
[1] RIKEN Adv Inst Computat Sci, Kobe, Hyogo, Japan
[2] Univ Tsukuba, Ctr Computat Sci, Ibaraki, Japan
基金
日本科学技术振兴机构;
关键词
PGAS; XcalableMP; !text type='Python']Python[!/text; Parallel language;
D O I
10.1145/3176364.3176369
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
When developing applications on high-performance computing (HPC) cluster systems, Partitioned GlobalAddress Space (PGAS) languages are used due to their high productivity and performance. However, in order to more efficiently develop such applications, it is also important to be able to combine a PGAS language with other languages instead of using a single PGAS language alone. We have designed an XcalableMP (XMP) PGAS language, and developed Omni Compiler as an XMP compiler. In this paper, we report on the development of linkage functions between XMP and {C, Fortran, or Python} for Omni Compiler. Furthermore, as a functional example of interworking between XMP and Python,we discuss the development of an application for the Graph Order/degree problem. Specifically, we paralleled all of the shortest paths among the vertices searches of the application using XMP. When the results of the application in XMP and the original Python were compared, we found that the performance of XMP was 21% faster than that of the original Python on a single CPU core. Moreover, when applying the application on an HPC cluster system with 1,280 CPU cores of 64 compute nodes, we could achieve a 921 times better performance than that on a single CPU core.
引用
收藏
页码:39 / 47
页数:9
相关论文
共 8 条
  • [1] High-Productivity Parallelism With Python']Python Plus Packages (But Without a Cluster)
    Bartlett, John
    Uchytil, Chris
    Storti, Duane
    [J]. COMPUTING IN SCIENCE & ENGINEERING, 2021, 23 (04) : 38 - 46
  • [2] Octave and python']python: High-level scripting languages productivity and performance evaluation
    Chaves, Juan Carlos
    Nehrbass, John
    Guilfoos, Brian
    Gardiner, Judy
    Ahalt, Stanley
    Krishnarnurthy, Ashok
    Unpingco, Jose
    Chalker, Alan
    Warnock, Andy
    Samsi, Siddharth
    [J]. PROCEEDINGS OF THE HPCMP USERS GROUP CONFERENCE 2006, 2006, : 429 - 434
  • [3] Python']Python and HPC for High Energy Physics Data Analyses
    Sehrish, S.
    Kowalkowski, J.
    Paterno, M.
    Green, C.
    [J]. PROCEEDINGS OF PYHPC'17: 7TH WORKSHOP ON PYTHON FOR HIGH-PERFORMANCE AND SCIENTIFIC COMPUTING, 2017,
  • [4] PySHMEM: A High Productivity OpenSHMEM Interface for Python']Python
    Welch, Aaron
    Shamis, Pavel
    Hao, Pengfei
    Chapman, Barbara
    [J]. 2015 9TH INTERNATIONAL CONFERENCE ON PARTITIONED GLOBAL ADDRESS SPACE PROGRAMMING MODELS (PGAS), 2015, : 99 - 101
  • [5] Performance analysis of different distribution of Python']Python and TensorFlow to efficiently utilize CPU on HPC Cluster
    Gupta, Krishan Gopal
    Maity, Samrit Kumar
    Das, Abhishek
    Wandhekar, Sanjay
    [J]. INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND ENERGY TECHNOLOGIES (ICECET 2021), 2021, : 1969 - 1974
  • [6] Integration of MODBUS/TCP master monitoring and control system using python']python for High power RF system
    Mehta, Krupa
    Joshi, Ramesh
    Jadav, H. M.
    Kulkarni, S. V.
    Soni, Bhavesh H.
    Mali, Aniruddh
    [J]. 2015 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, SIGNALS, COMMUNICATION AND OPTIMIZATION (EESCO), 2015,
  • [7] An observation control system for radio telescopes based on Python and C++ languages
    Yuxiang Huang
    Longfei Hao
    Kejia Lee
    Wei Dai
    Min Wang
    Zhixuan Li
    Yonghua Xu
    Bojun Wang
    Faxin Shen
    [J]. 天文技术与仪器(英文)., 2024, 1 (06) - 315
  • [8] Productivity of high-level languages on reconfigurable computers: An HPC perspective
    El-Araby, Esam
    Nosum, Preetham
    El-Ghazawi, Tarek
    [J]. ICFPT 2007: INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY, PROCEEDINGS, 2007, : 257 - 260