Communication-Efficient Quantum Algorithm for Distributed Machine Learning

被引:4
|
作者
Tang, Hao [1 ]
Li, Boning [2 ,3 ]
Wang, Guoqing [2 ,4 ]
Xu, Haowei [4 ]
Li, Changhao [2 ,4 ]
Barr, Ariel [1 ]
Cappellaro, Paola [2 ,3 ,4 ]
Li, Ju [1 ,4 ]
机构
[1] MIT, Dept Mat Sci & Engn, Massachusetts, MA 02139 USA
[2] MIT, Res Lab Elect, Cambridge, MA 02139 USA
[3] MIT, Dept Phys, Massachusetts, MA 02139 USA
[4] MIT, Dept Nucl Sci & Engn, Cambridge, MA 02139 USA
关键词
723.4 Artificial Intelligence - 723.4.2 Machine Learning - 931.4 Quantum Theory; Quantum Mechanics;
D O I
10.1103/PhysRevLett.130.150602
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The growing demands of remote detection and an increasing amount of training data make distributed machine learning under communication constraints a critical issue. This work provides a communication -efficient quantum algorithm that tackles two traditional machine learning problems, the least-square fitting and softmax regression problems, in the scenario where the dataset is distributed across two parties. Our quantum algorithm finds the model parameters with a communication complexity of O(log2(N)/e), where N is the number of data points and e is the bound on parameter errors. Compared to classical and other quantum methods that achieve the same goal, our methods provide a communication advantage in the scaling with data volume. The core of our methods, the quantum bipartite correlator algorithm that estimates the correlation or the Hamming distance of two bit strings distributed across two parties, may be further applied to other information processing tasks.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] ALS Algorithm for Robust and Communication-Efficient Federated Learning
    Hurley, Neil
    Duriakova, Erika
    Geraci, James
    O'Reilly-Morgan, Diarmuid
    Tragos, Elias
    Smyth, Barry
    Lawlor, Aonghus
    [J]. PROCEEDINGS OF THE 2024 4TH WORKSHOP ON MACHINE LEARNING AND SYSTEMS, EUROMLSYS 2024, 2024, : 56 - 64
  • [22] Guest Editorial Communication-Efficient Distributed Learning Over Networks
    Cao, Xuanyu
    Basar, Tamer
    Diggavi, Suhas
    Eldar, Yonina C.
    Letaief, Khaled B.
    Poor, H. Vincent
    Zhang, Junshan
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 845 - 850
  • [23] LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning
    Chen, Tianyi
    Giannakis, Georgios B.
    Sun, Tao
    Yin, Wotao
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [24] Communication-Efficient Distributed Deep Metric Learning with Hybrid Synchronization
    Su, Yuxin
    Lyu, Michael
    King, Irwin
    [J]. CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 1463 - 1472
  • [25] Communication-Efficient Coded Distributed Multi-Task Learning
    Tang, Hua
    Hu, Haoyang
    Yuan, Kai
    Wu, Youlong
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [26] FedBCD: A Communication-Efficient Collaborative Learning Framework for Distributed Features
    Liu, Yang
    Zhang, Xinwei
    Kang, Yan
    Li, Liping
    Chen, Tianjian
    Hong, Mingyi
    Yang, Qiang
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2022, 70 : 4277 - 4290
  • [27] Intermittent Pulling With Local Compensation for Communication-Efficient Distributed Learning
    Wang, Haozhao
    Qu, Zhihao
    Guo, Song
    Gao, Xin
    Li, Ruixuan
    Ye, Baoliu
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2022, 10 (02) : 779 - 791
  • [28] Communication-Efficient Gradient Coding for Straggler Mitigation in Distributed Learning
    Kadhe, Swanand
    Koyluoglu, O. Ozan
    Ramchandran, Kannan
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 2634 - 2639
  • [29] A Communication-Efficient Multi-Agent Actor-Critic Algorithm for Distributed Reinforcement Learning
    Lin, Yixuan
    Zhang, Kaiqing
    Yang, Zhuoran
    Wang, Zhaoran
    Basar, Tamer
    Sandhu, Romeil
    Liu, Ji
    [J]. 2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 5562 - 5567
  • [30] Communication-efficient Decentralized Machine Learning over Heterogeneous Networks
    Zhou, Pan
    Lin, Qian
    Loghin, Dumitrel
    Ooi, Beng Chin
    Wu, Yuncheng
    Yu, Hongfang
    [J]. 2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 384 - 395