Folded Polynomial Codes for Coded Distributed AAinverted perpendicular-Type Matrix Multiplication

被引:0
|
作者
Xu, Jingke [1 ]
Zhang, Yaqian [2 ]
Wang, Libo [3 ]
机构
[1] Shandong Agr Univ, Sch Informat Sci & Engn ing, Tai An 271018, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[3] Hubei Univ, Sch Cyber Sci & Technol, Wuhan 430062, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Coded distributed computing; matrix multiplication; recovery threshold; folded polynomials;
D O I
10.1109/TCOMM.2023.3286420
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, due to the important value in practical applications, we consider the coded distributed matrix multiplication problem of computing AA(inverted perpendicular) in a distributed computing system with N worker nodes and a master node, where the input matrices A and A(inverted perpendicular) are partitioned into m-by-p and p-by-m blocks of equal-size sub-matrices respectively. For effective straggler mitigation, we propose a novel computation strategy, named folded polynomial code, which is obtained by modifying the entangled polynomial codes. Moreover, we characterize a lower bound on the optimal recovery threshold among all linear computation strategies when the underlying field is the real number field, and our folded polynomial codes can achieve this bound in the case of m = 1. Compared with all known computation strategies for coded distributed matrix multiplication, our folded polynomial codes outperform them in terms of recovery threshold, download cost, and decoding complexity.
引用
收藏
页码:5051 / 5064
页数:14
相关论文
共 43 条
  • [1] Bivariate Polynomial Codes for Secure Distributed Matrix Multiplication
    Hasircioglu, Burak
    Gomez-Vilardebo, Jesus
    Gunduz, Deniz
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (03) : 955 - 967
  • [2] Modular Polynomial Codes for Secure and Robust Distributed Matrix Multiplication
    Karpuk, David
    Tajeddine, Razane
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (06) : 4396 - 4413
  • [3] Squeezed Polynomial Codes: Communication-Efficient Coded Computation in Straggler-Exploiting Distributed Matrix Multiplication
    Hong, Sangwoo
    Yang, Heecheol
    Lee, Jungwoo
    [J]. IEEE ACCESS, 2020, 8 : 190516 - 190528
  • [4] Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication
    Yu, Qian
    Maddah-Ali, Mohammad Ali
    Avestimehr, A. Salman
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [5] Accelerating Distributed Matrix Multiplication with 4-Dimensional Polynomial Codes
    Nissim, Roy
    Schwartz, Oded
    [J]. SIAM CONFERENCE ON APPLIED AND COMPUTATIONAL DISCRETE ALGORITHMS, ACDA23, 2023, : 134 - 146
  • [6] Generalized Cross Subspace Alignment Codes for Coded Distributed Batch Matrix Multiplication
    Jia, Zhuqing
    Jafar, Syed A.
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [7] Speeding Up Private Distributed Matrix Multiplication via Bivariate Polynomial Codes
    Hasircioglu, Burak
    Gomez-Vilardebo, Jesus
    Gunduz, Deniz
    [J]. 2021 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2021, : 1853 - 1858
  • [8] Chebyshev Polynomial Codes: Task Entanglement-based Coding for Distributed Matrix Multiplication
    Hong, Sangwoo
    Yang, Heecheol
    Yoon, Youngseok
    Cho, Taehyun
    Lee, Jungwoo
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [9] RANDOM SAMPLING FOR DISTRIBUTED CODED MATRIX MULTIPLICATION
    Chang, Wei-Ting
    Tandon, Ravi
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 8187 - 8191
  • [10] GASP Codes for Secure Distributed Matrix Multiplication
    D'Oliveira, Rafael G. L.
    El Rouayheb, Salim
    Karpuk, David
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 1107 - 1111