Efficient methods for out-of-core sparse Cholesky factorization

被引:22
|
作者
Rothberg, E
Schreiber, R
机构
[1] ILOG Inc, Mountain View, CA 94043 USA
[2] Hewlett Packard Corp, Palo Alto, CA 94304 USA
来源
SIAM JOURNAL ON SCIENTIFIC COMPUTING | 1999年 / 21卷 / 01期
关键词
out-of-core methods; Cholesky factorization; sparse matrices;
D O I
10.1137/S1064827597322975
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the problem of sparse Cholesky factorization with limited main memory. The goal is to efficiently factor matrices whose Cholesky factors essentially fill the available disk storage, using very little memory (as little as 16 Megabytes (MBytes)). This would enable very large industrial problems to be solved with workstations of very modest cost. We consider three candidate algorithms. Each is based on a partitioning of the matrix into panels, The first is a robust, out-of-core multifrontal method chat keeps the factor, the stack, and the large frontal matrices on disk. The others are left-looking methods. We find that straightforward implementations of all of them suffer from excessive disk I/O for large problems that arise in interior-point algorithms for linear programming. We introduce several improvements to these simple out-of-core methods and find that a left-looking method that nevertheless uses the multifrontal algorithm for portions of the matrix (subtrees of the supernodal elimination tree whose multifrontal stack fits in memory) is very effective. With 32 Mbytes of main memory, it achieves over 77% of its in-core performance on all but one of our 12 test matrices (67% in that one case), even though the size of the factor is, in all cases, hundreds of millions or even billions of bytes.
引用
收藏
页码:129 / 144
页数:16
相关论文
共 50 条
  • [1] A Cholesky out-of-core factorization
    Castellanos, J. A.
    Larrazabal, G.
    [J]. MATHEMATICAL AND COMPUTER MODELLING, 2013, 57 (9-10) : 2207 - 2222
  • [2] AN ADAPTIVE GENERAL SPARSE OUT-OF-CORE CHOLESKY FACTORIZATION SCHEME
    LIU, JWH
    [J]. SIAM JOURNAL ON SCIENTIFIC AND STATISTICAL COMPUTING, 1987, 8 (04): : 585 - 599
  • [3] The design and implementation of a new out-of-core sparse Cholesky factorization method
    Rotkin, V
    Toledo, S
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2004, 30 (01): : 19 - 46
  • [4] An Out-of-Core Sparse Cholesky Solver
    Reid, John K.
    Scott, Jennifer A.
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2009, 36 (02):
  • [5] An out-of-core sparse symmetric-indefinite factorization method
    Meshar, Omer
    Irony, Dror
    Toledo, Sivan
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2006, 32 (03): : 445 - 471
  • [6] ON THE STORAGE REQUIREMENT IN THE OUT-OF-CORE MULTIFRONTAL METHOD FOR SPARSE FACTORIZATION
    LIU, JWH
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1986, 12 (03): : 249 - 264
  • [7] The design and implementation of the parallel out-of-core ScaLAPACK LU, QR, and Cholesky factorization routines
    D'Azevedo, E
    Dongarra, J
    [J]. CONCURRENCY-PRACTICE AND EXPERIENCE, 2000, 12 (15): : 1481 - 1493
  • [8] OUT-OF-CORE IMPLEMENTATIONS OF CHOLESKY FACTORIZATION: LOOP-BASED VERSUS RECURSIVE ALGORITHMS
    Bereux, Natacha
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2008, 30 (04) : 1302 - 1319
  • [9] Locality of reference in sparse Cholesky factorization methods
    Rozin, E
    Toledo, S
    [J]. ELECTRONIC TRANSACTIONS ON NUMERICAL ANALYSIS, 2005, 21 : 81 - 106
  • [10] On the performance of parallel factorization of out-of-core matrices
    Caron, E
    Utard, G
    [J]. PARALLEL COMPUTING, 2004, 30 (03) : 357 - 375