Estimation in the spiked Wigner model: A short proof of the replica formula

被引:0
|
作者
El Alaoui, Ahmed [1 ]
Krzakala, Florent [2 ,3 ]
机构
[1] Univ Calif Berkeley, Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[2] CNRS, UPMC, PSL, LPS,ENS, Paris, France
[3] Sorbonne Univ, Paris, France
关键词
LARGEST EIGENVALUE;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider the problem of estimating the rank-one perturbation of a Wigner matrix in a setting of low signal-to-noise ratio. This serves as a simple model for principal component analysis in high dimensions. The mutual information per variable between the spike and the observed matrix, or equivalently, the normalized Kullback-Leibler divergence between the planted and null models are known to converge to the so-called replica-symmetric formula, the properties of which determine the fundamental limits of estimation in this model. We provide in this note a short and transparent proof of this formula, based on simple executions of Gaussian interpolations and standard concentration-of-measure arguments. The Franz-Parisi potential, that is, the free entropy at a fixed overlap, plays an important role in our proof. Furthermore, our proof can be generalized straightforwardly to spiked tensor models of even order.
引用
下载
收藏
页码:1874 / 1878
页数:5
相关论文
共 50 条
  • [1] Weak Detection in the Spiked Wigner Model
    Chung, Hye Won
    Lee, Ji Oon
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (11) : 7427 - 7453
  • [2] Mutual information for symmetric rank-one matrix estimation: A proof of the replica formula
    Barbier, Jean
    Dia, Mohamad
    Macris, Nicolas
    Krzakala, Florent
    Lesieur, Thibault
    Zdeborova, Lenka
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [3] FUNDAMENTAL LIMITS OF DETECTION IN THE SPIKED WIGNER MODEL
    El Alaoui, Ahmed
    Krzakala, Florent
    Jordan, Michael
    ANNALS OF STATISTICS, 2020, 48 (02): : 863 - 885
  • [4] Optimal Algorithms for the Inhomogeneous Spiked Wigner model
    Ko, Justin
    Krzakala, Florent
    Pak, Aleksandr
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] Weak Detection of Signal in the Spiked Wigner Model
    Chung, Hye Won
    Lee, Ji Oon
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [6] Short Proof of Formula for Composed Layer
    Antyufeev V.S.
    Journal of Mathematical Sciences, 2017, 221 (6) : 772 - 777
  • [7] SHORT PROOF OF FOURIER INVERSION FORMULA
    ROBERT, A
    PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY, 1976, 59 (02) : 287 - 288
  • [8] A short proof of Green's formula
    Ruan, Shiquan
    JOURNAL OF ALGEBRA, 2021, 581 : 45 - 49
  • [9] A VERY SHORT PROOF OF STIRLINGS FORMULA
    PATIN, JM
    AMERICAN MATHEMATICAL MONTHLY, 1989, 96 (01): : 41 - 42
  • [10] A Short Proof of Stirling's Formula
    Lou, Hongwei
    AMERICAN MATHEMATICAL MONTHLY, 2014, 121 (02): : 154 - 157