CESMTuner: An Auto-Tuning Framework for the Community Earth System Model

被引:8
|
作者
Ding Nan [1 ,2 ,3 ,4 ]
Xue Wei [1 ,2 ,3 ,4 ]
Ji Xu [1 ,2 ,3 ,4 ]
Xu Haoyu [1 ,2 ]
Song Zhenya [5 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Tsinghua Natl Lab Informat Sci & Technol, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Key Lab Earth Syst Modeling, Minist Educ, Beijing 100084, Peoples R China
[4] Tsinghua Univ, Ctr Earth Syst Sci, Beijing 100084, Peoples R China
[5] SOA, Inst Oceanog 1, Qingdao 266061, Peoples R China
关键词
auto-tuning; CESM; load balance; processor allocation; performance prediction; PERFORMANCE PORTABILITY; DYNAMICAL CORE; OCEAN MODEL;
D O I
10.1109/HPCC.2014.51
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The growing scientific demands of climate predication and climate projection have promoted to manage the computational resources of climate model rationally. The Community Earth System Model (CESM) is one of the state-of-the-art and the most widely-used coupled models for simulating the earth system. Although considerable effort has been put to improve the scalability of single component, CESM is still struggling with the poor performance due to load balance across components. To solve this problem, an easy-used and easy-ported auto-tuning framework named CESMTuner is proposed in this paper. It targets to reduce the time consumed of CESM as much as possible by looking for the optimal process configuration. In which, a novel process layout searching algorithm is presented that can look for the optimal process count of each component as well as the best process layout across components simultaneously. Moreover, a lightweight and accurate performance model is built to reduce searching overhead effectively. With the evaluation over TianHe-1A, CESMTuner can achieve 58.49% performance improvement compared to the widely-used sequential process layout and achieve 38.23% performance improvement compared to the heuristic branch and bound algorithm based on the performance model of simply fitting each component's runtime.
引用
收藏
页码:282 / 289
页数:8
相关论文
共 50 条
  • [1] ATF: A Generic Auto-Tuning Framework
    Rasch, Ari
    Haidl, Michael
    Gorlatch, Sergei
    2017 19TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS (HPCC) / 2017 15TH IEEE INTERNATIONAL CONFERENCE ON SMART CITY (SMARTCITY) / 2017 3RD IEEE INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (DSS), 2017, : 64 - 71
  • [2] ATF: A Generic Auto-Tuning Framework
    Rasch, Ari
    Gorlatch, Sergei
    HPDC '18: PROCEEDINGS OF THE 27TH INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE PARALLEL AND DISTRIBUTED COMPUTING: POSTERS/DOCTORAL CONSORTIUM, 2018, : 3 - 4
  • [3] Efficient Auto-Tuning of Parallel Programs with Interdependent Tuning Parameters via Auto-Tuning Framework (ATF)
    Rasch, Ari
    Schulze, Richard
    Steuwer, Michel
    Gorlatch, Sergei
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2021, 18 (01)
  • [4] FIBER: A generalized framework for auto-tuning software
    Katagiri, T
    Kise, K
    Honda, H
    Yuba, T
    HIGH PERFORMANCE COMPUTING, 2003, 2858 : 146 - 159
  • [5] A Scalable Auto-tuning Framework for Compiler Optimization
    Tiwari, Ananta
    Chen, Chun
    Chame, Jacqueline
    Hall, Mary
    Hollingsworth, Jeffrey K.
    2009 IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL & DISTRIBUTED PROCESSING, VOLS 1-5, 2009, : 796 - +
  • [6] A Verification Framework for Streamlining Empirical Auto-tuning
    Hirasawa, Shoichi
    Takizawa, Hiroyuki
    Kobayashi, Hiroaki
    PROCEEDINGS OF 2015 THIRD INTERNATIONAL SYMPOSIUM ON COMPUTING AND NETWORKING (CANDAR), 2015, : 508 - 514
  • [7] Mjolnir: A framework agnostic auto-tuning system with deep reinforcement learning
    Nourchene Ben Slimane
    Houssem Sagaama
    Maher Marwani
    Sabri Skhiri
    Applied Intelligence, 2023, 53 : 14008 - 14022
  • [8] Auto-tuning interactive multiple model
    Ng, GW
    Lau, A
    How, KY
    ACQUISITION, TRACKING, AND POINTING XII, 1998, 3365 : 131 - 138
  • [9] Mjolnir: A framework agnostic auto-tuning system with deep reinforcement learning
    Ben Slimane, Nourchene
    Sagaama, Houssem
    Marwani, Maher
    Skhiri, Sabri
    APPLIED INTELLIGENCE, 2023, 53 (11) : 14008 - 14022
  • [10] An Architecture for Flexible Auto-Tuning: The Periscope Tuning Framework 2.0
    Mijakovic, Robert
    Firbach, Michael
    Gerndt, Michael
    2016 2ND INTERNATIONAL CONFERENCE ON GREEN HIGH PERFORMANCE COMPUTING (ICGHPC), 2016,