Communication-Efficient Quantum Algorithm for Distributed Machine Learning

被引:4
|
作者
Tang, Hao [1 ]
Li, Boning [2 ,3 ]
Wang, Guoqing [2 ,4 ]
Xu, Haowei [4 ]
Li, Changhao [2 ,4 ]
Barr, Ariel [1 ]
Cappellaro, Paola [2 ,3 ,4 ]
Li, Ju [1 ,4 ]
机构
[1] MIT, Dept Mat Sci & Engn, Massachusetts, MA 02139 USA
[2] MIT, Res Lab Elect, Cambridge, MA 02139 USA
[3] MIT, Dept Phys, Massachusetts, MA 02139 USA
[4] MIT, Dept Nucl Sci & Engn, Cambridge, MA 02139 USA
关键词
723.4 Artificial Intelligence - 723.4.2 Machine Learning - 931.4 Quantum Theory; Quantum Mechanics;
D O I
10.1103/PhysRevLett.130.150602
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The growing demands of remote detection and an increasing amount of training data make distributed machine learning under communication constraints a critical issue. This work provides a communication -efficient quantum algorithm that tackles two traditional machine learning problems, the least-square fitting and softmax regression problems, in the scenario where the dataset is distributed across two parties. Our quantum algorithm finds the model parameters with a communication complexity of O(log2(N)/e), where N is the number of data points and e is the bound on parameter errors. Compared to classical and other quantum methods that achieve the same goal, our methods provide a communication advantage in the scaling with data volume. The core of our methods, the quantum bipartite correlator algorithm that estimates the correlation or the Hamming distance of two bit strings distributed across two parties, may be further applied to other information processing tasks.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] CE-SGD: Communication-Efficient Distributed Machine Learning
    Tao, Zeyi
    Xia, Qi
    Li, Qun
    Cheng, Songqing
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [2] Communication-efficient distributed EM algorithm
    Liu, Xirui
    Wu, Mixia
    Xu, Liwen
    [J]. STATISTICAL PAPERS, 2024,
  • [3] Fast and Communication-Efficient Algorithm for Distributed Support Vector Machine Training
    Dass, Jyotikrishna
    Sarin, Vivek
    Mahapatra, Rabi N.
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (05) : 1065 - 1076
  • [4] Communication-Efficient Distributed Learning: An Overview
    Cao, Xuanyu
    Basar, Tamer
    Diggavi, Suhas
    Eldar, Yonina C.
    Letaief, Khaled B.
    Poor, H. Vincent
    Zhang, Junshan
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 851 - 873
  • [5] CREDO : A Communication-Efficient Distributed Estimation Algorithm
    Sahu, Anit Kumar
    Jakovetic, Dusan
    Kar, Soummya
    [J]. 2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 516 - 520
  • [6] Guest Editorial Introduction to the Special Section on Communication-Efficient Distributed Machine Learning
    Chu, Xiaowen
    Giunchiglia, Fausto
    Neglia, Giovanni
    Gregg, David
    Liu, Jiangchuang
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04): : 1949 - 1950
  • [7] More communication-efficient distributed sparse learning
    Zhou, Xingcai
    Yang, Guang
    [J]. INFORMATION SCIENCES, 2024, 668
  • [8] More communication-efficient distributed sparse learning
    Zhou, Xingcai
    Yang, Guang
    [J]. Information Sciences, 2024, 668
  • [9] A Flexible Framework for Communication-Efficient Machine Learning
    Khirirat, Sarit
    Magnusson, Sindri
    Aytekin, Arda
    Johansson, Mikael
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 8101 - 8109
  • [10] Communication-Efficient Frank-Wolfe Algorithm for Nonconvex Decentralized Distributed Learning
    Xian, Wenhan
    Huang, Feihu
    Huang, Heng
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10405 - 10413