Folded Polynomial Codes for Coded Distributed AAinverted perpendicular-Type Matrix Multiplication

被引:0
|
作者
Xu, Jingke [1 ]
Zhang, Yaqian [2 ]
Wang, Libo [3 ]
机构
[1] Shandong Agr Univ, Sch Informat Sci & Engn ing, Tai An 271018, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[3] Hubei Univ, Sch Cyber Sci & Technol, Wuhan 430062, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Coded distributed computing; matrix multiplication; recovery threshold; folded polynomials;
D O I
10.1109/TCOMM.2023.3286420
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, due to the important value in practical applications, we consider the coded distributed matrix multiplication problem of computing AA(inverted perpendicular) in a distributed computing system with N worker nodes and a master node, where the input matrices A and A(inverted perpendicular) are partitioned into m-by-p and p-by-m blocks of equal-size sub-matrices respectively. For effective straggler mitigation, we propose a novel computation strategy, named folded polynomial code, which is obtained by modifying the entangled polynomial codes. Moreover, we characterize a lower bound on the optimal recovery threshold among all linear computation strategies when the underlying field is the real number field, and our folded polynomial codes can achieve this bound in the case of m = 1. Compared with all known computation strategies for coded distributed matrix multiplication, our folded polynomial codes outperform them in terms of recovery threshold, download cost, and decoding complexity.
引用
收藏
页码:5051 / 5064
页数:14
相关论文
共 43 条
  • [31] GCSA Codes with Noise Alignment for Secure Coded Multi-Party Batch Matrix Multiplication
    Chen, Zhen
    Jia, Zhuqing
    Wang, Zhiying
    Jafar, Syed A.
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 227 - 232
  • [32] Dual Entangled Polynomial Code: Three-Dimensional Coding for Distributed Matrix Multiplication
    Soto, Pedro
    Li, Jun
    Fan, Xiaodi
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [33] FAST AND EFFICIENT DISTRIBUTED MATRIX-VECTOR MULTIPLICATION USING RATELESS FOUNTAIN CODES
    Mallick, Ankur
    Chaudhari, Malhar
    Joshi, Gauri
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 8192 - 8196
  • [34] Factored LT and Factored Raptor Codes for Large-Scale Distributed Matrix Multiplication
    Pradhan, Asit Kumar
    Heidarzadeh, Anoosheh
    Narayanan, Krishna R.
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 239 - 244
  • [35] Distributed Matrix Multiplication with MDS Array BP-XOR Codes for Scaling Clusters
    Arslan, Suayb S.
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 1792 - 1796
  • [36] Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-Vector Multiplication
    Mallick, Ankur
    Chaudhari, Malhar
    Sheth, Utsav
    Palanikumar, Ganesh
    Joshi, Gauri
    [J]. COMMUNICATIONS OF THE ACM, 2022, 65 (05) : 111 - 118
  • [37] Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-Vector Multiplication
    Mallick, Ankur
    Chaudhari, Malhar
    Sheth, Utsav
    Palanikumar, Ganesh
    Joshi, Gauri
    [J]. PROCEEDINGS OF THE ACM ON MEASUREMENT AND ANALYSIS OF COMPUTING SYSTEMS, 2019, 3 (03)
  • [38] Multi-Cell Mobile Edge Coded Computing: Trading Communication and Computing for Distributed Matrix Multiplication
    Li, Kuikui
    Tao, Meixia
    Zhang, Jingjing
    Simeone, Osvaldo
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 215 - 220
  • [39] Random Khatri-Rao-Product Codes for Numerically-Stable Distributed Matrix Multiplication
    Subramaniam, Adarsh M.
    Heidarzadeh, Anoosheh
    Narayanan, Krishna R.
    [J]. 2019 57TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2019, : 253 - 259
  • [40] Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-Vector Multiplication
    Mallick, Ankur
    Chaudhari, Malhar
    Sheth, Utsav
    Palanikumar, Ganesh
    Joshi, Gauri
    [J]. Performance Evaluation Review, 2020, 48 (01): : 95 - 96