Decentralized Statistical Inference with Unrolled Graph Neural Networks

被引:1
|
作者
Wang, He [1 ,2 ,3 ]
Shen, Yifei [4 ]
Wang, Ziyuan [1 ]
Li, Dongsheng [5 ]
Zhang, Jun [6 ]
Letaief, Khaled B. [4 ]
Lu, Jie [1 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
[5] Microsoft Res Asia, Shanghai, Peoples R China
[6] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Decentralized optimization; graph neural networks; algorithm unrolling; interpretable deep learning; PROXIMAL GRADIENT ALGORITHM;
D O I
10.1109/CDC45484.2021.9682857
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination. Existing optimization-based algorithms suffer from issues of model mismatches and poor convergence speed, and thus their performance would be degraded provided that the number of communication rounds is limited. This motivates us to propose a learning-based framework, which unrolls well-noted decentralized optimization algorithms (e.g., Prox-DGD and PG-EXTRA) into graph neural networks (GNNs). By minimizing the recovery error via end-to-end training, this learning-based framework resolves the model mismatch issue. Our convergence analysis (with PG-EXTRA as the base algorithm) reveals that the learned model parameters may accelerate the convergence and reduce the recovery error to a large extent. The simulation results demonstrate that the proposed GNN-based learning methods prominently outperform several state-of-the-art optimization-based algorithms in convergence speed and recovery error.
引用
收藏
页码:2634 / 2640
页数:7
相关论文
共 50 条
  • [1] Decentralized Inference With Graph Neural Networks in Wireless Communication Systems
    Lee, Mengyuan
    Yu, Guanding
    Dai, Huaiyu
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (05) : 2582 - 2598
  • [2] Design of Retransmission Mechanism for Decentralized Inference with Graph Neural Networks
    Zhang, Haying
    Jiang, Yutong
    Liu, Xingyu
    Lee, Mengyuan
    Gao, Huiguo
    Yu, Guanding
    [J]. 2022 27TH ASIA PACIFIC CONFERENCE ON COMMUNICATIONS (APCC 2022): CREATING INNOVATIVE COMMUNICATION TECHNOLOGIES FOR POST-PANDEMIC ERA, 2022, : 515 - 519
  • [3] Privacy-Preserving Decentralized Inference With Graph Neural Networks in Wireless Networks
    Lee, Mengyuan
    Yu, Guanding
    Dai, Huaiyu
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (01) : 543 - 558
  • [4] GRAPH NEURAL NETWORKS FOR DECENTRALIZED CONTROLLERS
    Gama, Fernando
    Tolstaya, Ekaterina
    Ribeiro, Alejandro
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 5260 - 5264
  • [5] Inference Attacks Against Graph Neural Networks
    Zhang, Zhikun
    Chen, Min
    Backes, Michael
    Shen, Yun
    Zhang, Yang
    [J]. PROCEEDINGS OF THE 31ST USENIX SECURITY SYMPOSIUM, 2022, : 4543 - 4560
  • [6] Membership Inference Attack on Graph Neural Networks
    Olatunji, Iyiola E.
    Nejdl, Wolfgang
    Khosla, Megha
    [J]. 2021 THIRD IEEE INTERNATIONAL CONFERENCE ON TRUST, PRIVACY AND SECURITY IN INTELLIGENT SYSTEMS AND APPLICATIONS (TPS-ISA 2021), 2021, : 11 - 20
  • [7] Power Flow Balancing With Decentralized Graph Neural Networks
    Hansen, Jonas Berg
    Anfinsen, Stian Normann
    Bianchi, Filippo Maria
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2023, 38 (03) : 2423 - 2433
  • [8] Decentralized Wireless Resource Allocation with Graph Neural Networks
    Wang, Zhiyang
    Eisen, Mark
    Ribeiro, Alejandro
    [J]. 2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 299 - 303
  • [9] Decentralized Channel Management in WLANs with Graph Neural Networks
    Gao, Zhan
    Shao, Yulin
    Gunduz, Deniz
    Prorok, Amanda
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 3072 - 3077
  • [10] Statistical inference: learning in artificial neural networks
    Yang, HH
    Murata, N
    Amari, S
    [J]. TRENDS IN COGNITIVE SCIENCES, 1998, 2 (01) : 4 - 10