Finite Rate Quantized Distributed Optimization with Geometric Convergence

被引:0
|
作者
Lee, Chang-Shen [1 ]
Michelusi, Nicolo [1 ]
Scutari, Gesualdo [2 ]
机构
[1] Purdue Univ, Sch Elect & Comp Engn, W Lafayette, IN 47907 USA
[2] Purdue Univ, Sch Ind Engn, W Lafayette, IN 47907 USA
基金
美国国家科学基金会;
关键词
CONSENSUS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper studies distributed (strongly convex) optimization over multi-agent networks, subject to finite rate communications. We propose the first distributed algorithm achieving geometric convergence to the exact solution of the problem, matching thus the rate of the centralized gradient algorithm (although with different constants). The algorithm combines gradient tracking with a quantized perturbed consensus scheme. The impact on the convergence (rate) of design and network parameters, such as number of bits, algorithm step-size, and network connectivity, is also investigated. Finally, numerical results validate our theoretical findings. They demonstrate the existence of an interesting trade-off among solution accuracy, convergence time and communication cost, defined as the total number of bits transmitted on one link to achieve a target solution error.
引用
收藏
页码:1876 / 1880
页数:5
相关论文
共 50 条
  • [21] Achieving geometric convergence for distributed optimization with Barzilai-Borwein step sizes
    Gao, Juan
    Liu, Xin-Wei
    Dai, Yu-Hong
    Huang, Yakui
    Yang, Peng
    SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (04)
  • [22] ACHIEVING GEOMETRIC CONVERGENCE FOR DISTRIBUTED OPTIMIZATION OVER TIME-VARYING GRAPHS
    Nedic, Angelia
    Olshevsky, Alex
    Shi, Wei
    SIAM JOURNAL ON OPTIMIZATION, 2017, 27 (04) : 2597 - 2633
  • [23] Rate of convergence of geometric symmetrizations
    B. Klartag
    Geometric & Functional Analysis GAFA, 2004, 14 : 1322 - 1338
  • [24] Rate of convergence of geometric symmetrizations
    Klartag, B
    GEOMETRIC AND FUNCTIONAL ANALYSIS, 2004, 14 (06) : 1322 - 1338
  • [25] Distributed Optimization with Finite-Time Convergence via Discontinuous Dynamics
    Pan, Xiaowei
    Liu, Zhongxin
    Chen, Zengqiang
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 6665 - 6669
  • [26] DISTRIBUTED AGGREGATIVE OPTIMIZATION WITH QUANTIZED COMMUNICATION
    Chen, Ziqin
    Liang, Shu
    KYBERNETIKA, 2022, 58 (01) : 123 - 144
  • [27] Quantized incremental algorithms for distributed optimization
    Rabbat, MG
    Nowak, RD
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2005, 23 (04) : 798 - 808
  • [28] Convergence Rate For Distributed Optimization Methods: Novel Bounds and Distributed Step Size Computation
    Sun, Yu
    Speranzon, Alberto
    Mehta, Prashant G.
    2012 AMERICAN CONTROL CONFERENCE (ACC), 2012, : 3712 - 3717
  • [29] On the Convergence Time of Asynchronous Distributed Quantized Averaging Algorithms
    Zhu, Minghui
    Martinez, Sonia
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2011, 56 (02) : 386 - 390
  • [30] Linear Convergence Rate for Distributed Optimization with the Alternating Direction Method of Multipliers
    Iutzeler, F.
    Bianchi, P.
    Ciblat, Ph.
    Hachem, W.
    2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 5046 - 5051