On the Optimal Recovery Threshold of Coded Matrix Multiplication

被引:0
|
作者
Fahim, Mohammad [1 ]
Jeong, Haewon [2 ]
Haddadpour, Farzin [1 ]
Dutta, Sanghamitra [2 ]
Cadambe, Viveck [1 ]
Grover, Pulkit [2 ]
机构
[1] Penn State Univ, University Pk, PA 16802 USA
[2] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We provide novel coded computation strategies for distributed matrix-matrix products that outperform the recent "Polynomial code" constructions in recovery threshold, i. e., the required number of successful workers. When m-th fraction of each matrix can be stored in each worker node, polynomial codes require m(2) successful workers, while our novel MatDot codes only require 2m - 1 successful workers, albeit at a higher communication cost from each worker to the fusion node. Further, we propose " PolyDot" coding that interpolates between Polynomial codes and MatDot codes. Finally, we demonstrate an application of PolyDot codes to multiplying multiple (> 2) matrices.
引用
收藏
页码:1264 / 1270
页数:7
相关论文
共 50 条
  • [1] On the Optimal Recovery Threshold of Coded Matrix Multiplication
    Dutta, Sanghamitra
    Fahim, Mohammad
    Haddadpour, Farzin
    Jeong, Haewon
    Cadambe, Viveck
    Grover, Pulkit
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (01) : 278 - 301
  • [2] Matrix Sparsification for Coded Matrix Multiplication
    Suh, Geewon
    Lee, Kangwook
    Suh, Changho
    [J]. 2017 55TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2017, : 1271 - 1278
  • [3] Coded Sparse Matrix Multiplication
    Wang, Sinong
    Liu, Jiashang
    Shroff, Ness
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [4] Private Coded Matrix Multiplication
    Kim, Minchul
    Yang, Heecheol
    Lee, Jungwoo
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 : 1434 - 1443
  • [5] Hierarchical coded matrix multiplication
    Kiani, Shahrzad
    Ferdinand, Nuwan
    Draper, Stark C.
    [J]. 2019 16TH CANADIAN WORKSHOP ON INFORMATION THEORY (CWIT), 2019,
  • [6] Coded Matrix Chain Multiplication
    Fan, Xiaodi
    Saldivia, Angel
    Soto, Pedro
    Li, Jun
    [J]. 2021 IEEE/ACM 29TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2021,
  • [7] Hierarchical Coded Matrix Multiplication
    Kianidehkordi, Shahrzad
    Ferdinand, Nuwan
    Draper, Stark C.
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2021, 67 (02) : 726 - 754
  • [8] Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication
    Yu, Qian
    Maddah-Ali, Mohammad Ali
    Avestimehr, A. Salman
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [9] Locally Recoverable Coded Matrix Multiplication
    Jeong, Haewon
    Ye, Fangwei
    Grover, Pulkit
    [J]. 2018 56TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2018, : 715 - 722
  • [10] Variable Coded Batch Matrix Multiplication
    Tauz, Lev
    Dolecek, Lara
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,