Computing Krylov iterates in the time of matrix multiplication

被引:0
|
作者
Neiger, Vincent [1 ]
Pernet, Clement [2 ]
Villard, Gilles [3 ]
机构
[1] Sorbonne Univ, CNRS, LIP6, F-75005 Paris, France
[2] Univ Grenoble Alpes, Grenoble INP, CNRS, LJK UMR 5224, Grenoble, France
[3] Univ Lyon, CNRS, ENS Lyon, Inria,UCBL,LIP UMR 5668, Lyon, France
基金
奥地利科学基金会;
关键词
Krylov iteration; Frobenius normal form; Polynomial linear algebra; DETERMINISTIC COMPUTATION; ALGORITHMS;
D O I
10.1145/3666000.3669715
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Krylov methods rely on iterated matrix-vector products A(k)u(j) for an n x n matrix A and vectors u(1),...,u(m). The space spanned by all iterates A(k)u(j) admits a particular basis - the maximal Krylov basis - which consists of iterates of the first vector u(1), Au-1, A(2)u(1),..., until reaching linear dependency, then iterating similarly the subsequent vectors until a basis is obtained. Finding minimal polynomials and Frobenius normal forms is closely related to computing maximal Krylov bases. The fastest way to produce these bases was, until this paper, Keller-Gehrig's 1985 algorithm whose complexity bound O(n(omega) log(n)) comes from repeated squarings of A and logarithmically many Gaussian eliminations. Here omega > 2 is a feasible exponent for matrix multiplication over the base field. We present an algorithm computing the maximal Krylov basis in O(n(omega) log log(n)) field operations when m is an element of O(n), and even O(n(omega)) as soon as m is an element of O(n/log(n)(c)) for some fixed real c>0. As a consequence, we show that the Frobenius normal form together with a transformation matrix can be computed deterministically in O(n(omega)(log log(n))(2)), and therefore matrix exponentiation A(k) can be performed in the latter complexity if log(k)is an element of O(n(omega-1-epsilon)) for some fixed epsilon>0. A key idea for these improvements is to rely on fast algorithms for m x m polynomial matrices of average degree n/m, involving high-order lifting and minimal kernel bases.
引用
收藏
页码:419 / 428
页数:10
相关论文
共 50 条
  • [41] Distributed Matrix Multiplication Performance Estimator for Machine Learning Jobs in Cloud Computing
    Son, Myungjun
    Lee, Kyungyong
    PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, : 638 - 645
  • [42] Digital in-memory stochastic computing architecture for vector-matrix multiplication
    Agwa, Shady
    Prodromakis, Themis
    FRONTIERS IN NANOTECHNOLOGY, 2023, 5
  • [43] Matrix Multiplication with Straggler Tolerance in Coded Elastic Computing via Lagrange Code
    Zhong, Xi
    Kliewer, Jorg
    Ji, Mingyue
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 136 - 141
  • [44] Coded Computing for Resilient, Secure, and Privacy-Preserving Distributed Matrix Multiplication
    Yu, Qian
    Avestimehr, A. Salman
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (01) : 59 - 72
  • [45] BISMO: A Scalable Bit-Serial Matrix Multiplication Overlay for Reconfigurable Computing
    Umuroglu, Yaman
    Rasnayake, Lahiru
    Sjalander, Magnus
    2018 28TH INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS (FPL), 2018, : 307 - 314
  • [46] Tensor Decompositions and Adiabatic Quantum Computing for Discovering Practical Matrix Multiplication Algorithms
    Uotila, Valter
    2024 IEEE INTERNATIONAL CONFERENCE ON QUANTUM COMPUTING AND ENGINEERING, QCE, VOL 1, 2024, : 390 - 401
  • [47] LOWER BOUNDS FOR DEPTH-4 FORMULAS COMPUTING ITERATED MATRIX MULTIPLICATION
    Fournier, Herve
    Limaye, Nutan
    Malod, Guillaume
    Srinivasan, Srikanth
    SIAM JOURNAL ON COMPUTING, 2015, 44 (05) : 1173 - 1201
  • [48] Distributed Matrix Multiplication Using Group Algebra for On-Device Edge Computing
    Son, Kyungrak
    Ramamoorthy, Aditya
    Choi, Wan
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 2097 - 2101
  • [49] Algorithms for Matrix Multiplication via Sampling and Opportunistic Matrix Multiplication
    Harris, David G.
    ALGORITHMICA, 2024, 86 (09) : 2822 - 2844
  • [50] A Deterministic Linear Program Solver in Current Matrix Multiplication Time
    van den Brand, Jan
    PROCEEDINGS OF THE THIRTY-FIRST ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS (SODA'20), 2020, : 259 - 278