Computing Krylov iterates in the time of matrix multiplication

被引:0
|
作者
Neiger, Vincent [1 ]
Pernet, Clement [2 ]
Villard, Gilles [3 ]
机构
[1] Sorbonne Univ, CNRS, LIP6, F-75005 Paris, France
[2] Univ Grenoble Alpes, Grenoble INP, CNRS, LJK UMR 5224, Grenoble, France
[3] Univ Lyon, CNRS, ENS Lyon, Inria,UCBL,LIP UMR 5668, Lyon, France
基金
奥地利科学基金会;
关键词
Krylov iteration; Frobenius normal form; Polynomial linear algebra; DETERMINISTIC COMPUTATION; ALGORITHMS;
D O I
10.1145/3666000.3669715
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Krylov methods rely on iterated matrix-vector products A(k)u(j) for an n x n matrix A and vectors u(1),...,u(m). The space spanned by all iterates A(k)u(j) admits a particular basis - the maximal Krylov basis - which consists of iterates of the first vector u(1), Au-1, A(2)u(1),..., until reaching linear dependency, then iterating similarly the subsequent vectors until a basis is obtained. Finding minimal polynomials and Frobenius normal forms is closely related to computing maximal Krylov bases. The fastest way to produce these bases was, until this paper, Keller-Gehrig's 1985 algorithm whose complexity bound O(n(omega) log(n)) comes from repeated squarings of A and logarithmically many Gaussian eliminations. Here omega > 2 is a feasible exponent for matrix multiplication over the base field. We present an algorithm computing the maximal Krylov basis in O(n(omega) log log(n)) field operations when m is an element of O(n), and even O(n(omega)) as soon as m is an element of O(n/log(n)(c)) for some fixed real c>0. As a consequence, we show that the Frobenius normal form together with a transformation matrix can be computed deterministically in O(n(omega)(log log(n))(2)), and therefore matrix exponentiation A(k) can be performed in the latter complexity if log(k)is an element of O(n(omega-1-epsilon)) for some fixed epsilon>0. A key idea for these improvements is to rely on fast algorithms for m x m polynomial matrices of average degree n/m, involving high-order lifting and minimal kernel bases.
引用
收藏
页码:419 / 428
页数:10
相关论文
共 50 条
  • [21] The Time Complexity of Fully Sparse Matrix Multiplication
    Abboud, Amir
    Bringmann, Karl
    Fischer, Nick
    Kuennemann, Marvin
    PROCEEDINGS OF THE 2024 ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, SODA, 2024, : 4670 - 4703
  • [22] Inexact Sparse Matrix Vector Multiplication in Krylov Subspace Methods: An Application-Oriented Reduction Method
    Mansour, Ahmad
    Goetze, Juergen
    PARALLEL PROCESSING AND APPLIED MATHEMATICS (PPAM 2013), PT I, 2014, 8384 : 534 - 544
  • [23] Coded Real Number Matrix Multiplication for On-Device Edge Computing
    Tan, Zhiquan
    Yuan, Dingli
    Zhang, Yifan
    Huang, Zhongyi
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1572 - 1576
  • [24] H-SIMD machine: Configurable parallel computing for matrix multiplication
    Xu, XZ
    Ziavras, SG
    2005 IEEE International Conference on Computer Design: VLSI in Computers & Processors, Proceedings, 2005, : 671 - 676
  • [25] Secure Coded Matrix Multiplication against Cooperative Attack in Edge Computing
    Zhu, Luqi
    Wang, Jin
    Shi, Lianmin
    Zhou, Jingya
    Lu, Kejie
    Wang, Jianping
    2020 IEEE 19TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2020), 2020, : 547 - 556
  • [26] Lower bounds for depth 4 formulas computing iterated matrix multiplication
    Fournier, Herve
    Limaye, Nutan
    Malod, Guillaume
    Srinivasan, Srikanth
    STOC'14: PROCEEDINGS OF THE 46TH ANNUAL 2014 ACM SYMPOSIUM ON THEORY OF COMPUTING, 2014, : 128 - 135
  • [27] Comparing the performance of general matrix multiplication routine on heterogeneous computing systems
    Sorokin, Aleksei
    Malkovsky, Sergey
    Tsoy, Georgiy
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2022, 160 : 39 - 48
  • [28] IMPROVED TIME AND SPACE BOUNDS FOR BOOLEAN MATRIX MULTIPLICATION
    ADLEMAN, L
    BOOTH, KS
    PREPARATA, FP
    RUZZO, WL
    ACTA INFORMATICA, 1978, 11 (01) : 61 - 70
  • [29] A time-space tradeoff for Boolean matrix multiplication
    Abrahamson, Karl
    IEEE Transactions on Industry Applications, 1991, 27 (1 pt 1) : 412 - 419
  • [30] Area and time efficient implementations of matrix multiplication on FPGAs
    Jang, JW
    Choi, S
    Prasanna, VK
    2002 IEEE INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (FPT), PROCEEDINGS, 2002, : 93 - 100