Fair and Comprehensive Benchmarking of Machine Learning Processing Chips

被引:13
|
作者
Burr, Geoffrey W. [1 ]
Lim, SukHwan [2 ]
Murmann, Boris [3 ]
Venkatesan, Rangharajan [4 ]
Verhelst, Marian [5 ,6 ]
机构
[1] IBM Res Almaden, Cupertino, CA 95014 USA
[2] Samsung, Hwaseong Si 18448, South Korea
[3] Stanford Univ, Stanford, CA 94305 USA
[4] NVIDIA Corp, Santa Clara, CA 95051 USA
[5] MICAS KU Leuven, B-3001 Heverlee, Belgium
[6] IMEC, B-3001 Heverlee, Belgium
关键词
YY Benchmark testing; Computer architecture; Measurement; Integrated circuit modeling; Best practices; Computational modeling; AI processing; ML accelerator; chip evaluation; benchmarking; deep learning; architecture; circuit; ACCELERATOR;
D O I
10.1109/MDAT.2021.3063366
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This article provides an overview of benchmarking strategies at a different set of abstraction levels and related best practices in each, while working to also give an overall view of impact. © 2013 IEEE.
引用
收藏
页码:18 / 27
页数:10
相关论文
共 50 条
  • [31] A dataset of oracle characters for benchmarking machine learning algorithms
    Wang, Mei
    Deng, Weihong
    SCIENTIFIC DATA, 2024, 11 (01)
  • [32] Benchmarking econometric and machine learning methodologies in nowcasting GDP
    Daniel Hopp
    Empirical Economics, 2024, 66 : 2191 - 2247
  • [33] Benchmarking adversarially robust quantum machine learning at scale
    West, Maxwell T.
    Erfani, Sarah M.
    Leckie, Christopher
    Sevior, Martin
    Hollenberg, Lloyd C. L.
    Usman, Muhammad
    PHYSICAL REVIEW RESEARCH, 2023, 5 (02):
  • [34] Benchmarking Machine Learning Models to Assist in the Prognosis of Tuberculosis
    Lino Ferreira da Silva Barros, Maicon Herverton
    Oliveira Alves, Geovanne
    Morais Florencio Souza, Lubnnia
    da Silva Rocha, Elisson
    Lorenzato de Oliveira, Joao Fausto
    Lynn, Theo
    Sampaio, Vanderson
    Endo, Patricia Takako
    INFORMATICS-BASEL, 2021, 8 (02):
  • [35] Benchmarking machine learning models for quantum state classification
    Pedicillo, Edoardo
    Pasquale, Andrea
    Carrazza, Stefano
    26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023, 2024, 295
  • [36] Benchmarking econometric and machine learning methodologies in nowcasting GDP
    Hopp, Daniel
    EMPIRICAL ECONOMICS, 2024, 66 (05) : 2191 - 2247
  • [37] ClimateLearn: Benchmarking Machine Learning for Weather and Climate Modeling
    Tung Nguyen
    Jewik, Jason
    Bansal, Hritik
    Sharma, Prakhar
    Grover, Aditya
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [38] Benchmarking quantum tomography completeness and fidelity with machine learning
    Teo, Yong Siah
    Shin, Seongwook
    Jeong, Hyunseok
    Kim, Yosep
    Kim, Yoon-Ho
    Struchalin, Gleb, I
    Kovlakov, Egor, V
    Straupe, Stanislav S.
    Kulik, Sergei P.
    Leuchs, Gerd
    Sanchez-Soto, Luis L.
    NEW JOURNAL OF PHYSICS, 2021, 23 (10):
  • [39] Summit: Benchmarking Machine Learning Methods for Reaction Optimisation
    Felton, Kobi C.
    Rittig, Jan G.
    Lapkin, Alexei A.
    CHEMISTRYMETHODS, 2021, 1 (02): : 116 - 122
  • [40] Benchmarking and Feasibility Aspects of Machine Learning in Space Systems
    Raoofy, Amir
    Dax, Gabriel
    Serra, Vittorio
    Ghiglione, Max
    Werner, Martin
    Trinitis, Carsten
    PROCEEDINGS OF THE 19TH ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS 2022 (CF 2022), 2022, : 225 - 226