Distributed Constrained Optimization With Delayed Subgradient Information Over Time-Varying Network Under Adaptive Quantization

被引:7
|
作者
Liu, Jie [1 ]
Yu, Zhan [2 ]
Ho, Daniel W. C. [1 ]
机构
[1] City Univ Hong Kong, Dept Math, Hong Kong, Peoples R China
[2] City Univ Hong Kong, Sch Data Sci, Hong Kong, Peoples R China
关键词
Quantization (signal); Optimization; Mirrors; Convergence; Communication networks; Delay effects; Communication channels; Adaptive quantization; delayed subgradient information; distributed optimization; mirror descent algorithm; MIRROR-DESCENT ALGORITHM; MULTIAGENT OPTIMIZATION; CONSENSUS;
D O I
10.1109/TNNLS.2022.3172450
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, we consider a distributed constrained optimization problem with delayed subgradient information over the time-varying communication network, where each agent can only communicate with its neighbors and the communication channel has a limited data rate. We propose an adaptive quantization method to address this problem. A mirror descent algorithm with delayed subgradient information is established based on the theory of Bregman divergence. With a non-Euclidean Bregman projection-based scheme, the proposed method essentially generalizes many previous classical Euclidean projection-based distributed algorithms. Through the proposed adaptive quantization method, the optimal value without any quantization error can be obtained. Furthermore, comprehensive analysis on the convergence of the algorithm is carried out and our results show that the optimal convergence rate O(1/(T)(1/2)) can be obtained under appropriate conditions. Finally, numerical examples are presented to demonstrate the effectiveness of our results.
引用
收藏
页码:143 / 156
页数:14
相关论文
共 50 条
  • [41] Neurodynamic algorithms for constrained distributed convex optimization over fixed or switching topology with time-varying communication delay
    Luan, Linhua
    Qin, Sitian
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (20): : 17761 - 17781
  • [42] ACHIEVING GEOMETRIC CONVERGENCE FOR DISTRIBUTED OPTIMIZATION OVER TIME-VARYING GRAPHS
    Nedic, Angelia
    Olshevsky, Alex
    Shi, Wei
    SIAM JOURNAL ON OPTIMIZATION, 2017, 27 (04) : 2597 - 2633
  • [43] A Geometrically Convergent Method for Distributed Optimization over Time-Varying Graphs
    Nedich, Angelia
    Olshevsky, Alex
    Shi, Wei
    2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 1023 - 1029
  • [44] A subgradient-based neural network to constrained distributed convex optimization
    Wei, Zhe
    Jia, Wenwen
    Bian, Wei
    Qin, Sitian
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (14): : 9961 - 9971
  • [45] A subgradient-based neural network to constrained distributed convex optimization
    Zhe Wei
    Wenwen Jia
    Wei Bian
    Sitian Qin
    Neural Computing and Applications, 2023, 35 : 9961 - 9971
  • [46] Distributed Stochastic Mirror Descent Algorithm Over Time-varying Network
    Wang, Yinghui
    Zhou, Hongbing
    Hong, Yiguang
    2018 IEEE 14TH INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2018, : 716 - 721
  • [47] Distributed continuous-time constrained convex optimization with general time-varying cost functions
    Huang, Bomin
    Zou, Yao
    Meng, Ziyang
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2021, 31 (06) : 2222 - 2236
  • [48] Projective synchronization of time-varying delayed neural network with adaptive scaling factors
    Ghosh, Dibakar
    Banerjee, Santo
    CHAOS SOLITONS & FRACTALS, 2013, 53 : 1 - 9
  • [49] Asynchronous Delayed Optimization with Time-Varying Minibatches
    Al-Lawati H.
    Adikari T.B.
    Draper S.C.
    IEEE Journal on Selected Areas in Information Theory, 2021, 2 (02): : 784 - 801
  • [50] An Adaptive Primal-Dual Subgradient Algorithm for Online Distributed Constrained Optimization
    Yuan, Deming
    Ho, Daniel W. C.
    Jiang, Guo-Ping
    IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (11) : 3045 - 3055