A Transfer Learning Framework for High-Accurate Cross-Workload Design Space Exploration of CPU

被引:2
|
作者
Wang, Duo [1 ,2 ]
Yan, Mingyu [1 ,2 ]
Teng, Yihan [1 ,2 ]
Han, Dengke [1 ,2 ]
Dang, Haoran [1 ,2 ]
Ye, Xiaochun [1 ,2 ]
Fan, Dongrui [1 ,2 ]
机构
[1] Chinese Acad Sci, SKLP, Inst Comp Technol, Beijing, Peoples R China
[2] UNiv Chinese Acad Sci, Beijing, Peoples R China
来源
2023 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD | 2023年
基金
中国国家自然科学基金;
关键词
Design Space Exploration; Cross-workload; Prediction Model; Transfer Learning; CPU Microarchitecture; PERFORMANCE;
D O I
10.1109/ICCAD57390.2023.10323840
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
To perform cross-workload design space exploration of CPU, previous works implicitly transfer knowledge from several existing source workloads and try to make predictions on the target one. However, they do not fully explore the transferability across workloads and their single basic prediction models limit the prediction accuracy. In this paper, an open-source Transfer learning Ensemble Design Space Exploration framework (TrEnDSE) is proposed to perform cross-workload performance predictions. The black-box transferability between workloads is quantitatively dissected and explicitly utilized as sample weights for training. Moreover, an ensemble bagging learning model and an uncertainty-driven iterative optimization method are proposed to perform accurate and robust prediction, with these sample weights leveraged. Experiments on SPEC CPU 2017 demonstrate that TrEnDSE can reduce cycle per instruction prediction error by 54% and power prediction error by 34% compared with the state-of-the-art work.
引用
收藏
页数:9
相关论文
共 34 条
  • [21] Accurate High-level Modeling and Automated Hardware/Software Co-design for Effective SoC Design Space Exploration
    Zuo, Wei
    Pouchet, Louis-Noel
    Ayupov, Andrey
    Kim, Taemin
    Lin, Chung-Wei
    Shiraishi, Shinichi
    Chen, Deming
    PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2017,
  • [22] Fast and Inexpensive High-Level Synthesis Design Space Exploration: Machine Learning to the Rescue
    Rashid, Md Imtiaz
    Schafer, Benjamin Carrion
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2023, 42 (11) : 3939 - 3950
  • [23] Learning from the Past: Efficient High-level Synthesis Design Space Exploration for FPGAs
    Wang, Zi
    Schafer, Benjamin Carrion
    ACM TRANSACTIONS ON DESIGN AUTOMATION OF ELECTRONIC SYSTEMS, 2022, 27 (04)
  • [24] On Learning-Based Methods for Design-Space Exploration with High-Level Synthesis
    Liu, Hung-Yi
    Carloni, Luca P.
    2013 50TH ACM / EDAC / IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2013,
  • [25] Machine-Learning based Simulated Annealer method for High Level Synthesis Design Space Exploration
    Mahapatra, Anushree
    Schafer, Benjamin Carrion
    PROCEEDINGS OF THE 2014 ELECTRONIC SYSTEM LEVEL SYNTHESIS CONFERENCE (ESLSYN), 2014,
  • [26] Magellan: A search and machine learning-based framework for fast multi-core design space exploration and optimization
    Kang, Sukhun
    Kumar, Rakesh
    2008 DESIGN, AUTOMATION AND TEST IN EUROPE, VOLS 1-3, 2008, : 1236 - 1241
  • [27] MOELA: A Multi-Objective Evolutionary/Learning Design Space Exploration Framework for 3D Heterogeneous Manycore Platforms
    Qi, Sirui
    Li, Yingheng
    Pasricha, Sudeep
    Kim, Ryan Gary
    2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
  • [28] 3DNN-Xplorer: A Machine Learning Framework for Design Space Exploration of Heterogeneous 3D DNN Accelerators
    Murali, Gauthaman
    Iyer, Aditya
    Ravichandran, Navneeth
    Lim, Sung Kyu
    2023 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2023,
  • [29] 3DNN-Xplorer: A Machine Learning Framework for Design Space Exploration of Heterogeneous 3-D DNN Accelerators
    Murali, Gauthaman
    Park, Min Gyu
    Lim, Sung Kyu
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2025, 33 (02) : 358 - 370
  • [30] Design space exploration for configurable architectures and the role of modeling, high-level program analysis and learning techniques
    Diniz, PC
    COMPUTER SYSTEMS: ARCHITECTURES, MODELING, AND SIMULATION, 2004, 3133 : 213 - 223