Prediction of Optimal Solvers for Sparse Linear Systems Using Deep Learning

被引:0
|
作者
Funk, Yannick [1 ]
Goetz, Markus [2 ,3 ]
Anzt, Hartwig [3 ,4 ]
机构
[1] Karlsruhe Inst Technol KIT, Karlsruhe, Germany
[2] Karlsruhe Inst Technol KIT, Helmholtz AI, Karlsruhe, Germany
[3] Karlsruhe Inst Technol KIT, Steinbuch Ctr Comp SCC, Karlsruhe, Germany
[4] Univ Tennessee, Innovat Comp Lab ICL, Knoxville, TN USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Solving sparse linear systems is a key task in a number of computational problems, such as data analysis and simulations, and majorly determines overall execution time. Choosing a suitable iterative solver algorithm, however, can significantly improve time-to-completion. We present a deep learning approach designed to predict the optimal iterative solver for a given sparse linear problem. For this, we detail useful linear system features to drive the prediction process, the metrics we use to quantify the iterative solvers' time-to-approximation performance and a comprehensive experimental evaluation of the prediction quality of the neural network. Using a hyperparameter optimization and an ablation study on the SuiteSparse matrix collection we have inferred the importance of distinct features, achieving a top1 classification accuracy of 60%.
引用
收藏
页码:14 / 24
页数:11
相关论文
共 50 条
  • [41] Sparse vector linear prediction with near-optimal matrix structures
    Petrinovic, D
    Petrinovic, D
    IWISPA 2000: PROCEEDINGS OF THE FIRST INTERNATIONAL WORKSHOP ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, 2000, : 235 - 240
  • [42] Sparse Coding and Dictionary Learning with Linear Dynamical Systems
    Huang, Wenbing
    Sun, Fuchun
    Cao, Lele
    Zhao, Deli
    Liu, Huaping
    Harandi, Mehrtash
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3938 - 3947
  • [43] Deep Learning-Enabled Sparse Industrial Crowdsensing and Prediction
    Wang, En
    Zhang, Mijia
    Cheng, Xiaochun
    Yang, Yongjian
    Liu, Wenbin
    Yu, Huaizhi
    Wang, Liang
    Zhang, Jian
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (09) : 6170 - 6181
  • [44] Learning Mixtures of Sparse Linear Regressions Using Sparse Graph Codes
    Yin, Dong
    Pedarsani, Ramtin
    Chen, Yudong
    Ramchandran, Kannan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (03) : 1430 - 1451
  • [45] Learning Mixtures of Sparse Linear Regressions Using Sparse Graph Codes
    Yin, Dong
    Pedarsani, Ramtin
    Chen, Yudong
    Ramchandran, Kannan
    2017 55TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2017, : 588 - 595
  • [46] Nonstationary and Sparse Linear Regression for State Prediction of Artificial Systems
    Takayama, Ryosuke
    Yairi, Takehisa
    Tamai, Nana
    2022 61ST ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS (SICE), 2022, : 553 - 558
  • [47] Probabilistic Linear Solvers for Machine Learning
    Wenger, Jonathan
    Hennig, Philipp
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [48] Spectrum Occupancy Prediction in Coexisting Wireless Systems using Deep Learning
    Omotere, Oluwaseyi
    Fuller, John
    Qian, Lijun
    Han, Zhu
    2018 IEEE 88TH VEHICULAR TECHNOLOGY CONFERENCE (VTC-FALL), 2018,
  • [49] Using Deep Learning for Positive Reviews Prediction in Explainable Recommendation Systems
    Zarzour, Hafed
    Alsmirat, Mohammad
    Jararweh, Yaser
    2022 13TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2022, : 358 - +
  • [50] Optimal Sparse Linear Encoders and Sparse PCA
    Magdon-Ismail, Malik
    Boutsidis, Christos
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29