Learning Graphons via Structured Gromov-Wasserstein Barycenters

被引:0
|
作者
Xu, Hongteng [1 ,2 ]
Luo, Dixin [3 ]
Carin, Lawrence [4 ]
Zha, Hongyuan [5 ]
机构
[1] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing, Peoples R China
[2] Beijing Key Lab Big Data Management & Anal Method, Beijing, Peoples R China
[3] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[4] Duke Univ, Dept Elect & Comp Engn, Durham, NC USA
[5] Chinese Univ Hong Kong, Sch Data Sci, Shenzhen Res Inst Big Data, Shenzhen, Peoples R China
关键词
MATRICES;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a novel and principled method to learn a non-parametric graph model called graphon, which is defined in an infinite-dimensional space and represents arbitrary-size graphs. Based on the weak regularity lemma from the theory of graphons, we leverage a step function to approximate a graphon. We show that the cut distance of graphons can be relaxed to the Gromov-Wasserstein distance of their step functions. Accordingly, given a set of graphs generated by an underlying graphon, we learn the corresponding step function as the Gromov-Wasserstein barycenter of the given graphs. Furthermore, we develop several enhancements and extensions of the basic algorithm, e:g:, the smoothed Gromov-Wasserstein barycenter for guaranteeing the continuity of the learned graphons and the mixed Gromov-Wasserstein barycenters for learning multiple structured graphons. The proposed approach overcomes drawbacks of prior state-of-the-art methods, and outperforms them on both synthetic and real-world data. The code is available at https://github.com/HongtengXu/SGWB-Graphon.
引用
收藏
页码:10505 / 10513
页数:9
相关论文
共 50 条
  • [1] Learning to Predict Graphs with Fused Gromov-Wasserstein Barycenters
    Brogat-Motte, Luc
    Flamary, Remi
    Brouard, Celine
    Rousu, Juho
    d'Alche-Buc, Florence
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [2] Generalized Spectral Clustering via Gromov-Wasserstein Learning
    Chowdhury, Samir
    Needham, Tom
    Proceedings of Machine Learning Research, 2021, 130 : 712 - 720
  • [3] Generalized Spectral Clustering via Gromov-Wasserstein Learning
    Chowdhury, Samir
    Needham, Tom
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130 : 712 - +
  • [4] Fused Gromov-Wasserstein Distance for Structured Objects
    Vayer, Titouan
    Chapel, Laetitia
    Flamary, Remi
    Tavenard, Romain
    Courty, Nicolas
    ALGORITHMS, 2020, 13 (09)
  • [5] Representing Graphs via Gromov-Wasserstein Factorization
    Xu, Hongteng
    Liu, Jiachang
    Luo, Dixin
    Carin, Lawrence
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) : 999 - 1016
  • [6] Sliced Gromov-Wasserstein
    Vayer, Titouan
    Flamary, Remi
    Tavenard, Romain
    Chapel, Laetitia
    Courty, Nicolas
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [7] Hybrid Gromov-Wasserstein Embedding for Capsule Learning
    Shamsolmoali, Pourya
    Zareapoor, Masoumeh
    Das, Swagatam
    Granger, Eric
    Garcia, Salvador
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15
  • [8] Quantized Gromov-Wasserstein
    Chowdhury, Samir
    Miller, David
    Needham, Tom
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2021: RESEARCH TRACK, PT III, 2021, 12977 : 811 - 827
  • [9] On a linear fused Gromov-Wasserstein distance for graph structured data
    Nguyen, Dai Hai
    Tsuda, Koji
    PATTERN RECOGNITION, 2023, 138
  • [10] The Ultrametric Gromov-Wasserstein Distance
    Memoli, Facundo
    Munk, Axel
    Wan, Zhengchao
    Weitkamp, Christoph
    DISCRETE & COMPUTATIONAL GEOMETRY, 2023, 70 (04) : 1378 - 1450