Challenges in the automatic parallelization of large-scale computational applications

被引:0
|
作者
Armstrong, B [1 ]
Eigenmann, R [1 ]
机构
[1] Purdue Univ, Sch Elect & Comp Engn, W Lafayette, IN 47907 USA
关键词
large-scale computational applications; automatic parallelization; compiler techniques;
D O I
10.1117/12.434876
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Application test suites used in the development of parallelizing compilers typically include single-file programs and algorithm kernels. The challenges posed by full-scale commercial applications are rarely addressed. It is often assumed that automatic parallelization is not feasible in the presence of large, realistic programs. In this paper, we reveal some of the hurdles that must be crossed in order to enable these compilers to apply parallelization techniques to large-scale codes. We use a benchmark suite that has been specifically designed to exhibit the computing needs found in industry. The benchmarks are provided by the High Performance Group of the Standard Performance Evaluation Corporation (SPEC). They consist of a seismic processing application and a quantum level molecular simulation. Both applications exist in a serial and a parallel variant. The parallel variants are hand-parallelized with shared-memory directives either at the largest level of granularity or in a hybrid manner where MPI is used at the largest level of granularity and OpenMP directives are used at a lower level. In our studies we compare the parallel variants with the automatically parallelized, serial codes. We use the Polaris parallelizing compiler, which takes Fortran codes and inserts OpenMP directives around loops determined to be dependence-free. Polaris also reports the reasons why it assumes that a loop is parallel. We have found five challenges faced by an automatic parallelizing compiler when dealing with full applications: modularity, legacy optimizations, symbolic analysis, array reshaping, and issues arising from input/output operations. The results of this work will be used to equip parallelizing compilers with the necessary capabilities for handling commercially relevant science and engineering applications.
引用
收藏
页码:50 / 60
页数:11
相关论文
共 50 条
  • [1] Parallelization of a large-scale computational earthquake simulation program
    Tiampo, KF
    Rundle, JB
    Hopper, P
    Martins, JS
    Gross, S
    McGinnis, S
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2002, 14 (6-7): : 531 - 550
  • [2] Integrated Parallelization of Computations and Visualization for Large-scale Applications
    Malakar, Preeti
    Natarajan, Vijay
    Vadhiyar, Sathish S.
    [J]. 2012 IEEE 26TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS & PHD FORUM (IPDPSW), 2012, : 2510 - 2513
  • [3] Computational challenges for large-scale astrophysics calculations
    Fryxell, B
    [J]. ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH, 2001, 583 : 310 - 312
  • [4] Computational Intelligence Challenges and Applications on Large-Scale Astronomical Time Series Databases
    Huijse, Pablo
    Estevez, Pablo A.
    Protopapas, Pavlos
    Principe, Jose C.
    Zegers, Pablo
    [J]. IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2014, 9 (03) : 27 - 39
  • [5] Challenges in Large-Scale Computational Mass Spectrometry and Multiomics
    Kohlbacher, Oliver
    Vitek, Olga
    [J]. JOURNAL OF PROTEOME RESEARCH, 2016, 15 (03) : 681 - 682
  • [6] Computational methods and challenges for large-scale circuit mapping
    Helmstaedter, Moritz
    Mitra, Partha P.
    [J]. CURRENT OPINION IN NEUROBIOLOGY, 2012, 22 (01) : 162 - 169
  • [7] Large-scale photonic inverse design: computational challenges and breakthroughs
    Kang, Chanik
    Park, Chaejin
    Lee, Myunghoo
    Kang, Joonho
    Jang, Min Seok
    Chung, Haejun
    [J]. NANOPHOTONICS, 2024, 13 (20) : 3765 - 3792
  • [8] Polymer nanogenerators: Opportunities and challenges for large-scale applications
    Wang, Aurelia Chi
    Wu, Changsheng
    Pisignano, Dario
    Wang, Zhong Lin
    Persano, Luana
    [J]. JOURNAL OF APPLIED POLYMER SCIENCE, 2018, 135 (24)
  • [9] Superconducting materials: Challenges and opportunities for large-scale applications
    Yao, Chao
    Ma, Yanwei
    [J]. ISCIENCE, 2021, 24 (06)
  • [10] Large-Scale Parallelization of Human Migration Simulation
    Groen, Derek
    Papadopoulou, Nikela
    Anastasiadis, Petros
    Lawenda, Marcin
    Szustak, Lukasz
    Gogolenko, Sergiy
    Arabnejad, Hamid
    Jahani, Alireza
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (02): : 2135 - 2146