Consensus-based distributed learning for robust convex optimization with a scenario approach

被引:0
|
作者
Cao, Feilong [1 ]
Feng, Fan [1 ]
机构
[1] China Jiliang Univ, Dept Appl Math, Hangzhou 310018, Peoples R China
来源
关键词
alternating direction method of multipliers; consensus computation; distributed learning; robust convex optimization;
D O I
10.1002/cpe.5049
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper aims to solve the robust convex optimization (RCO) problem, where the constraints of RCO are parameterized with uncertainties, and the scenario approach is applied to transform RCO into standard convex optimization with a finite number of constraints through probabilistic approximation. The transformed problem is called a scenario problem (SP). Two consensus-based distributed learning algorithms for SP are designed in consideration of a large number of sampled constraints. One is based on the distributed average consensus (DAC), and the other is based on the alternating direction method of multipliers (ADMM). It has regulated that data distributed to nodes are not allowed to communicate. Simulation results indicate that the proposed algorithms are suitable for handling large-scale data and achieve excellent performance, with the ADMM-based algorithm performing the best. Furthermore, the DAC-based algorithm has certain advantages in terms of computational time and complexity. In addition, to improve the communicative efficiency based on a DAC, an efficient distributed average consensus (EDAC) is put forward. The average time for every node when using an EDAC is less than that of a DAC, despite the exact same performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Consensus-based Parallel Algorithm for Robust Convex Optimization with Scenario Approach in Colored Network
    Feng, Fan
    Cao, Feilong
    [J]. INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2017, 2017, 10585 : 222 - 231
  • [2] A Consensus-Based Approach to the Distributed Learning
    Czarnowski, Ireneusz
    Jedrzejowicz, Piotr
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2011, : 936 - 941
  • [3] Distributed Algorithms for Robust Convex Optimization via the Scenario Approach
    You, Keyou
    Tempo, Roberto
    Xie, Pei
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (03) : 880 - 895
  • [4] Primal Recovery from Consensus-Based Dual Decomposition for Distributed Convex Optimization
    Simonetto, Andrea
    Jamali-Rad, Hadi
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 168 (01) : 172 - 197
  • [5] Primal Recovery from Consensus-Based Dual Decomposition for Distributed Convex Optimization
    Andrea Simonetto
    Hadi Jamali-Rad
    [J]. Journal of Optimization Theory and Applications, 2016, 168 : 172 - 197
  • [6] A RESILIENT CONVEX COMBINATION FOR CONSENSUS-BASED DISTRIBUTED ALGORITHMS
    Wang, Xuan
    Mou, Shaoshuai
    Sundaram, Shreyas
    [J]. NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2019, 9 (03): : 269 - 281
  • [7] Consensus-based iterative learning of heterogeneous agents with application to distributed optimization
    Song, Qiang
    Meng, Deyuan
    Liu, Fang
    [J]. AUTOMATICA, 2022, 137
  • [8] Consensus-Based Distributed Online Prediction and Optimization
    Tsianos, Konstantinos I.
    Rabbat, Michael G.
    [J]. 2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, : 807 - 810
  • [9] Consensus-Based Distributed Optimization with Malicious Nodes
    Sundaram, Shreyas
    Gharesifard, Bahman
    [J]. 2015 53RD ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2015, : 244 - 249
  • [10] A CONSENSUS-BASED DECENTRALIZED ALGORITHM FOR NON-CONVEX OPTIMIZATION WITH APPLICATION TO DICTIONARY LEARNING
    Wai, Hoi-To
    Chang, Tsung-Hui
    Scaglione, Anna
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 3546 - 3550