Unbiased sampling of network ensembles

被引:58
|
作者
Squartini, Tiziano [1 ,2 ]
Mastrandrea, Rossana [3 ,4 ,5 ]
Garlaschelli, Diego [1 ]
机构
[1] Leiden Univ, Inst Lorentz Theoret Phys, NL-2333 CA Leiden, Netherlands
[2] Univ Roma La Sapienza, Inst Complex Syst UOS Sapienza, I-00185 Rome, Italy
[3] Scuola Super Sant Anna, Inst Econ, I-56127 Pisa, Italy
[4] Scuola Super Sant Anna, LEM, I-56127 Pisa, Italy
[5] Univ Toulon & Var, Aix Marseille Univ, CNRS, CPT,UMR7332, F-13288 Marseille, France
来源
NEW JOURNAL OF PHYSICS | 2015年 / 17卷
关键词
complex networks; maximum entropy principle; null models of graphs; sampling network ensembles; ensemble nonequivalence; RANDOM GRAPHS;
D O I
10.1088/1367-2630/17/2/023052
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Sampling random graphs with given properties is a key step in the analysis of networks, as random ensembles represent basic null models required to identify patterns such as communities and motifs. An important requirement is that the sampling process is unbiased and efficient. The main approaches are microcanonical, i.e. they sample graphs that match the enforced constraints exactly. Unfortunately, when applied to strongly heterogeneous networks (like most real-world examples), the majority of these approaches become biased and/or time-consuming. Moreover, the algorithms defined in the simplest cases, such as binary graphs with given degrees, are not easily generalizable to more complicated ensembles. Here we propose a solution to the problem via the introduction of a 'Maximize and Sample' ('Max & Sam' for short) method to correctly sample ensembles of networks where the constraints are 'soft', i.e. realized as ensemble averages. Our method is based on exact maximum-entropy distributions and is therefore unbiased by construction, even for strongly heterogeneous networks. It is also more computationally efficient than most microcanonical alternatives. Finally, it works for both binary and weighted networks with a variety of constraints, including combined degree-strength sequences and full reciprocity structure, for which no alternative method exists. Our canonical approach can in principle be turned into an unbiased microcanonical one, via a restriction to the relevant subset. Importantly, the analysis of the fluctuations of the constraints suggests that the microcanonical and canonical versions of all the ensembles considered here are not equivalent. We show various real-world applications and provide a code implementing all our algorithms.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Unbiased sampling of lattice Hamilton path ensembles
    Mansfield, Marc L.
    [J]. JOURNAL OF CHEMICAL PHYSICS, 2006, 125 (15):
  • [2] Unbiased sampling technologies on online social network
    Wang D.
    Li Z.
    Xie G.
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2016, 53 (05): : 949 - 967
  • [3] Censoring Unbiased Regression Trees and Ensembles
    Steingrimsson, Jon Arni
    Diao, Liqun
    Strawderman, Robert L.
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2019, 114 (525) : 370 - 383
  • [4] UNBIASED PASSIVE SAMPLING
    UNDERHILL, DW
    [J]. AMERICAN INDUSTRIAL HYGIENE ASSOCIATION JOURNAL, 1983, 44 (03): : 237 - 239
  • [5] A COMPARATIVE STUDY OF DATA SAMPLING TECHNIQUES FOR CONSTRUCTING NEURAL NETWORK ENSEMBLES
    Akhand, M. A. H.
    Islam, M. D. Monirul
    Murase, Kazuyuki
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2009, 19 (02) : 67 - 89
  • [6] Sampling unitary ensembles
    Olver, Sheehan
    Nadakuditi, Raj Rao
    Trogdon, Thomas
    [J]. RANDOM MATRICES-THEORY AND APPLICATIONS, 2015, 4 (01)
  • [7] Unbiased and efficient sampling of timeseries reveals redundancy of brain network and gradient structure
    Nanda, Aditya
    Rubinov, Mikail
    [J]. NEUROIMAGE, 2023, 274
  • [8] ON CLASSES OF UNBIASED SAMPLING STRATEGIES
    Bhushan, Shashi
    Katara, Shubhra
    [J]. JOURNAL OF RELIABILITY AND STATISTICAL STUDIES, 2010, 3 (02): : 93 - 101
  • [9] Towards Unbiased BFS Sampling
    Kurant, Maciej
    Markopoulou, Athina
    Thiran, Patrick
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2011, 29 (09) : 1799 - 1809
  • [10] AN ALGORITHM FOR UNBIASED RANDOM SAMPLING
    ERNVALL, J
    NEVALAINEN, O
    [J]. COMPUTER JOURNAL, 1982, 25 (01): : 45 - 47