Decentralized Statistical Inference with Unrolled Graph Neural Networks

被引:1
|
作者
Wang, He [1 ,2 ,3 ]
Shen, Yifei [4 ]
Wang, Ziyuan [1 ]
Li, Dongsheng [5 ]
Zhang, Jun [6 ]
Letaief, Khaled B. [4 ]
Lu, Jie [1 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
[5] Microsoft Res Asia, Shanghai, Peoples R China
[6] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Decentralized optimization; graph neural networks; algorithm unrolling; interpretable deep learning; PROXIMAL GRADIENT ALGORITHM;
D O I
10.1109/CDC45484.2021.9682857
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination. Existing optimization-based algorithms suffer from issues of model mismatches and poor convergence speed, and thus their performance would be degraded provided that the number of communication rounds is limited. This motivates us to propose a learning-based framework, which unrolls well-noted decentralized optimization algorithms (e.g., Prox-DGD and PG-EXTRA) into graph neural networks (GNNs). By minimizing the recovery error via end-to-end training, this learning-based framework resolves the model mismatch issue. Our convergence analysis (with PG-EXTRA as the base algorithm) reveals that the learned model parameters may accelerate the convergence and reduce the recovery error to a large extent. The simulation results demonstrate that the proposed GNN-based learning methods prominently outperform several state-of-the-art optimization-based algorithms in convergence speed and recovery error.
引用
收藏
页码:2634 / 2640
页数:7
相关论文
共 50 条
  • [21] COVID-19 infection inference with graph neural networks
    Song, Kyungwoo
    Park, Hojun
    Lee, Junggu
    Kim, Arim
    Jung, Jaehun
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01)
  • [22] A graph neural network framework for causal inference in brain networks
    Wein, S.
    Malloni, W. M.
    Tome, A. M.
    Frank, S. M.
    Henze, G-, I
    Wuest, S.
    Greenlee, M. W.
    Lang, E. W.
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [23] Knowledge-Driven Resource Allocation for Wireless Networks: A WMMSE Unrolled Graph Neural Network Approach
    Yang, Hao
    Cheng, Nan
    Sun, Ruijin
    Quan, Wei
    Chai, Rong
    Aldubaikhy, Khalid
    Alqasir, Abdullah
    Shen, Xuemin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 18902 - 18916
  • [24] Unboxing the graph: Towards interpretable graph neural networks for transport prediction through neural relational inference
    Tygesen, Mathias Niemann
    Pereira, Francisco Camara
    Rodrigues, Filipe
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 146
  • [25] Spatial Temporal Graph Neural Networks for Decentralized Control of Robot Swarms
    Chen, Siji
    Sun, Yanshen
    Li, Peihan
    Zhou, Lifeng
    Lu, Chang-Tien
    [J]. 31ST ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS, ACM SIGSPATIAL GIS 2023, 2023, : 450 - 453
  • [26] Graph Neural Networks for Decentralized Multi-Robot Path Planning
    Li, Qingbiao
    Gama, Fernando
    Ribeiro, Alejandro
    Prorok, Amanda
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 11785 - 11792
  • [27] Graph Neural Networks for Decentralized Multi-Robot Target Tracking
    Zhou, Lifeng
    Sharma, Vishnu D.
    Li, Qingbiao
    Prorok, Amanda
    Ribeiro, Alejandro
    Tokekar, Pratap
    Kumar, Vijay
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON SAFETY, SECURITY, AND RESCUE ROBOTICS (SSRR), 2022, : 195 - 202
  • [28] Decentralized Training of Graph Neural Networks in Mobile Systems for Power Control
    Zhao, Jianyu
    Ling, Hao
    Yang, Chenyang
    Liu, Tingting
    [J]. 2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [29] GROWS - Improving Decentralized Resource Allocation in Wireless Networks through Graph Neural Networks
    Randall, Martin
    Belzarena, Pablo
    Larroca, Federico
    Casas, Pedro
    [J]. PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON GRAPH NEURAL NETWORKING, GNNET 2022, 2022, : 24 - 29
  • [30] Defense against membership inference attack in graph neural networks through graph perturbation
    Kai Wang
    Jinxia Wu
    Tianqing Zhu
    Wei Ren
    Ying Hong
    [J]. International Journal of Information Security, 2023, 22 : 497 - 509