Efficient methods for out-of-core sparse Cholesky factorization

被引:22
|
作者
Rothberg, E
Schreiber, R
机构
[1] ILOG Inc, Mountain View, CA 94043 USA
[2] Hewlett Packard Corp, Palo Alto, CA 94304 USA
来源
SIAM JOURNAL ON SCIENTIFIC COMPUTING | 1999年 / 21卷 / 01期
关键词
out-of-core methods; Cholesky factorization; sparse matrices;
D O I
10.1137/S1064827597322975
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the problem of sparse Cholesky factorization with limited main memory. The goal is to efficiently factor matrices whose Cholesky factors essentially fill the available disk storage, using very little memory (as little as 16 Megabytes (MBytes)). This would enable very large industrial problems to be solved with workstations of very modest cost. We consider three candidate algorithms. Each is based on a partitioning of the matrix into panels, The first is a robust, out-of-core multifrontal method chat keeps the factor, the stack, and the large frontal matrices on disk. The others are left-looking methods. We find that straightforward implementations of all of them suffer from excessive disk I/O for large problems that arise in interior-point algorithms for linear programming. We introduce several improvements to these simple out-of-core methods and find that a left-looking method that nevertheless uses the multifrontal algorithm for portions of the matrix (subtrees of the supernodal elimination tree whose multifrontal stack fits in memory) is very effective. With 32 Mbytes of main memory, it achieves over 77% of its in-core performance on all but one of our 12 test matrices (67% in that one case), even though the size of the factor is, in all cases, hundreds of millions or even billions of bytes.
引用
收藏
页码:129 / 144
页数:16
相关论文
共 50 条
  • [41] Efficient view-dependent out-of-core visualization
    Guthe, M
    Borodin, P
    Klein, R
    [J]. FOURTH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND ITS APPLICATIONS IN INDUSTRY, 2004, 5444 : 428 - 438
  • [42] LIMITING COMMUNICATION IN PARALLEL SPARSE CHOLESKY FACTORIZATION
    HULBERT, L
    ZMIJEWSKI, E
    [J]. SIAM JOURNAL ON SCIENTIFIC AND STATISTICAL COMPUTING, 1991, 12 (05): : 1184 - 1197
  • [43] THE MULTIFRONTAL METHOD AND PAGING IN SPARSE CHOLESKY FACTORIZATION
    LIU, JWH
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1989, 15 (04): : 310 - 325
  • [44] ON THE MINIMUM FLOPS PROBLEM IN THE SPARSE CHOLESKY FACTORIZATION
    Luce, Robert
    Ng, Esmond G.
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2014, 35 (01) : 1 - 21
  • [45] Reducing overhead in Sparse Hypermatrix Cholesky factorization
    Herrero, JR
    Navarro, JJ
    [J]. HIGH PERFORMANCE COMPUTATIONAL SCIENCE AND ENGINEERING, 2004, 172 : 143 - 154
  • [46] A MAPPING ALGORITHM FOR PARALLEL SPARSE CHOLESKY FACTORIZATION
    POTHEN, A
    SUN, CG
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1993, 14 (05): : 1253 - 1257
  • [47] Parallelization of sparse Cholesky factorization on an SMP cluster
    Satoh, S
    Kusano, K
    Tanaka, Y
    Matsuda, M
    Sato, M
    [J]. HIGH-PERFORMANCE COMPUTING AND NETWORKING, PROCEEDINGS, 1999, 1593 : 211 - 220
  • [48] Parallel Sparse Cholesky Factorization on a Heterogeneous Platform
    Zou, Dan
    Dou, Yong
    Li, Rongchun
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2013, E96A (04) : 833 - 834
  • [49] Implementation of Parallel Sparse Cholesky Factorization on GPU
    Zou, Dan
    Dou, Yong
    [J]. PROCEEDINGS OF 2012 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2012), 2012, : 2228 - 2232
  • [50] Issues in the design of scalable out-of-core dense symmetric indefinite factorization algorithms
    Strazdins, PE
    [J]. COMPUTATIONAL SICENCE - ICCS 2003, PT III, PROCEEDINGS, 2003, 2659 : 715 - 724