Federated Multi-Output Gaussian Processes

被引:1
|
作者
Chung, Seokhyun [1 ]
Al Kontar, Raed [2 ]
机构
[1] Univ Virginia, Syst & Informat Engn, Charlottesville, VA USA
[2] Univ Michigan, Ind & Operat Engn, Ann Arbor, MI 48109 USA
关键词
Federated analytics; Internet of federated things; Multi-output Gaussian processes; Variational inference; VARIATIONAL INFERENCE; MODELS;
D O I
10.1080/00401706.2023.2238834
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Multi-output Gaussian process (MGP) regression plays an important role in the integrative analysis of different but interrelated systems/units. Existing MGP approaches assume that data from all units is collected and stored at a central location. This requires massive computing and storage power at the central location, induces significant communication traffic due to raw data exchange, and comprises privacy of units. However, recent advances in Internet of Things technologies, which have tremendously increased edge computing power, pose a significant opportunity to address such challenges. In this article, we propose FedMGP, a general federated analytics (FA) framework to learn an MGP in a decentralized manner that uses edge computing power to distribute model learning efforts. Specifically, we propose a hierarchical modeling approach where an MGP is built upon shared global latent functions. We then develop a variational inference FA algorithm that overcomes the need to share raw data. Instead, collaborative learning is achieved by only sharing global latent function statistics. Comprehensive simulation studies and a case study on battery degradation data highlight the superior predictive performance and versatility of FedMGP, achieved while distributing computing and storage demands, reducing communication burden, fostering privacy, and personalizing analysis.
引用
收藏
页码:90 / 103
页数:14
相关论文
共 50 条
  • [1] Collaborative Multi-output Gaussian Processes
    Nguyen, Trung V.
    Bonilla, Edwin V.
    [J]. UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2014, : 643 - 652
  • [2] Multi-output Infinite Horizon Gaussian Processes
    Lim, Jaehyun
    Park, Jehyun
    Nah, Sungjae
    Choi, Jongeun
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 1542 - 1549
  • [3] Scalable Exact Inference in Multi-Output Gaussian Processes
    Bruinsma, Wessel P.
    Perim, Eric
    Tebbutt, Will
    Hosking, J. Scott
    Solin, Arno
    Turner, Richard E.
    [J]. 25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [4] Spectral Mixture Kernels for Multi-Output Gaussian Processes
    Parra, Gabriel
    Tobar, Felipe
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [5] Safe Active Learning for Multi-Output Gaussian Processes
    Li, Cen-You
    Rakitsch, Barbara
    Zimmer, Christoph
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [6] Scalable Exact Inference in Multi-Output Gaussian Processes
    Bruinsma, Wessel P.
    Perim, Eric
    Tebbutt, Will
    Hosking, J. Scott
    Solin, Arno
    Turner, Richard E.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [7] Multi-output Gaussian processes for species distribution modelling
    Ingram, Martin
    Vukcevic, Damjan
    Golding, Nick
    [J]. METHODS IN ECOLOGY AND EVOLUTION, 2020, 11 (12): : 1587 - 1598
  • [8] Bayesian Alignments of Warped Multi-Output Gaussian Processes
    Kaiser, Markus
    Otte, Clemens
    Runkler, Thomas
    Ek, Carl Henrik
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [9] Multi-output Gaussian processes for multi-population longevity modelling
    Huynh, Nhan
    Ludkovski, Mike
    [J]. ANNALS OF ACTUARIAL SCIENCE, 2021, 15 (02) : 318 - 345
  • [10] Modeling Neonatal EEG Using Multi-Output Gaussian Processes
    Caro, Victor
    Ho, Jou-Hui
    Witting, Scarlet
    Tobar, Felipe
    [J]. IEEE ACCESS, 2022, 10 : 32912 - 32927