A Transfer Learning Framework for High-Accurate Cross-Workload Design Space Exploration of CPU

被引:2
|
作者
Wang, Duo [1 ,2 ]
Yan, Mingyu [1 ,2 ]
Teng, Yihan [1 ,2 ]
Han, Dengke [1 ,2 ]
Dang, Haoran [1 ,2 ]
Ye, Xiaochun [1 ,2 ]
Fan, Dongrui [1 ,2 ]
机构
[1] Chinese Acad Sci, SKLP, Inst Comp Technol, Beijing, Peoples R China
[2] UNiv Chinese Acad Sci, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Design Space Exploration; Cross-workload; Prediction Model; Transfer Learning; CPU Microarchitecture; PERFORMANCE;
D O I
10.1109/ICCAD57390.2023.10323840
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
To perform cross-workload design space exploration of CPU, previous works implicitly transfer knowledge from several existing source workloads and try to make predictions on the target one. However, they do not fully explore the transferability across workloads and their single basic prediction models limit the prediction accuracy. In this paper, an open-source Transfer learning Ensemble Design Space Exploration framework (TrEnDSE) is proposed to perform cross-workload performance predictions. The black-box transferability between workloads is quantitatively dissected and explicitly utilized as sample weights for training. Moreover, an ensemble bagging learning model and an uncertainty-driven iterative optimization method are proposed to perform accurate and robust prediction, with these sample weights leveraged. Experiments on SPEC CPU 2017 demonstrate that TrEnDSE can reduce cycle per instruction prediction error by 54% and power prediction error by 34% compared with the state-of-the-art work.
引用
收藏
页数:9
相关论文
共 34 条
  • [1] MoDSE: A High-Accurate Multiobjective Design Space Exploration Framework for CPU Microarchitectures
    Wang, Duo
    Yan, Mingyu
    Teng, Yihan
    Han, Dengke
    Liu, Xin
    Li, Wenming
    Ye, Xiaochun
    Fan, Dongrui
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (05) : 1525 - 1537
  • [2] A High-accurate Multi-objective Exploration Framework for Design Space of CPU
    Wang, Duo
    Yan, Mingyu
    Liu, Xin
    Zou, Mo
    Liu, Tianyu
    Li, Wenming
    Ye, Xiaochun
    Fan, Dongrui
    2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,
  • [3] A High-accurate Multi-objective Ensemble Exploration Framework for Design Space of CPU Microarchitecture
    Wang, Duo
    Yan, Mingyu
    Teng, Yihan
    Han, Dengke
    Ye, Xiaochun
    Fan, Dongrui
    PROCEEDINGS OF THE GREAT LAKES SYMPOSIUM ON VLSI 2023, GLSVLSI 2023, 2023, : 379 - 383
  • [4] Cross-program Design Space Exploration by Ensemble Transfer Learning
    Li, Dandan
    Yao, Shuzhen
    Wang, Senzhang
    Wang, Ying
    2017 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD), 2017, : 201 - 208
  • [5] Deep learning framework for material design space exploration using active transfer learning and data augmentation
    Kim, Yongtae
    Kim, Youngsoo
    Yang, Charles
    Park, Kundo
    Gu, Grace X.
    Ryu, Seunghwa
    NPJ COMPUTATIONAL MATERIALS, 2021, 7 (01)
  • [6] Deep learning framework for material design space exploration using active transfer learning and data augmentation
    Yongtae Kim
    Youngsoo Kim
    Charles Yang
    Kundo Park
    Grace X. Gu
    Seunghwa Ryu
    npj Computational Materials, 7
  • [7] Transfer Learning for Design-Space Exploration with High-Level Synthesis
    Kwon, Jihye
    Carloni, Luca P.
    PROCEEDINGS OF THE 2020 ACM/IEEE 2ND WORKSHOP ON MACHINE LEARNING FOR CAD (MLCAD '20), 2020, : 163 - 168
  • [8] Hybrid Graph Representation and Learning Framework for High-Level Synthesis Design Space Exploration
    Taghipour, Pouya
    Granger, Eric
    Blaquiere, Yves
    IEEE ACCESS, 2024, 12 : 189574 - 189589
  • [9] Machine learning based fast and accurate High Level Synthesis design space exploration: From graph to synthesis
    Goswami, Pingakshya
    Schaefer, Benjamin Carrion
    Bhatia, Dinesh
    INTEGRATION-THE VLSI JOURNAL, 2023, 88 : 116 - 124
  • [10] Design space exploration of neural network accelerator based on transfer learning
    吴豫章
    ZHI Tian
    SONG Xinkai
    LI Xi
    High Technology Letters, 2023, 29 (04) : 416 - 426