Learning Tree Structures from Noisy Data

被引:0
|
作者
Nikolakakis, Konstantinos E. [1 ]
Kalogerias, Dionysios S. [2 ]
Sarwate, Anand D. [1 ]
机构
[1] Rutgers State Univ, New Brunswick, NJ 08901 USA
[2] Princeton Univ, Princeton, NJ 08544 USA
关键词
INVERSE COVARIANCE ESTIMATION; ISING-MODEL SELECTION; GRAPHICAL LASSO; LIKELIHOOD-ESTIMATION; DISTRIBUTIONS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We provide high-probability sample complexity guarantees for exact structure recovery of tree-structured graphical models, when only noisy observations of the respective vertex emissions are available. We assume that the hidden variables follow either an Ising model or a Gaussian graphical model, and the observables are noise-corrupted versions of the hidden variables: We consider multiplicative 1 binary noise for Ising models, and additive Gaussian noise for Gaussian models. Such hidden models arise naturally in a variety of applications such as physics, biology, computer science, and finance. We study the impact of measurement noise on the task of learning the underlying tree structure via the well-known Chow-Liu algorithm, and provide formal sample complexity guarantees for exact recovery. In particular, for a tree with p vertices and probability of failure delta > 0, we show that the number of necessary samples for exact structure recovery is of the order of O(log(p/delta)) for Ising models (which remains the same as in the noiseless case), and O(polylog(p/delta)) for Gaussian models.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Reinforcement Learning for Relation Classification from Noisy Data
    Feng, Jun
    Huang, Minlie
    Zhao, Li
    Yang, Yang
    Zhu, Xiaoyan
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 5779 - 5786
  • [22] Learning MDL Logic Programs from Noisy Data
    Hocquette, Celine
    Niskanen, Andreas
    Jarvisalo, Matti
    Cropper, Andrew
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 9, 2024, : 10553 - 10561
  • [23] Guest Editorial Learning From Noisy Multimedia Data
    Zhang, Jian
    Hanjalic, Alan
    Jain, Ramesh
    Hua, Xiansheng
    Satoh, Shin'ichi
    Yao, Yazhou
    Zeng, Dan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1247 - 1252
  • [24] An algorithm of wavelet network learning from noisy data
    Zhang, Zhiguo
    San, Ye
    WCICA 2006: SIXTH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-12, CONFERENCE PROCEEDINGS, 2006, : 2746 - +
  • [25] A filtered no arbitrage model for term structures from noisy data
    Gombani, A
    Jaschke, SR
    Runggaldier, WJ
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2005, 115 (03) : 381 - 400
  • [26] Online Learning of Noisy Data
    Cesa-Bianchi, Nicolo
    Shalev-Shwartz, Shai
    Shamir, Ohad
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2011, 57 (12) : 7907 - 7931
  • [27] Active Learning for Graphs with Noisy Structures
    Chi, Hongliang
    Qi, Cong
    Wang, Suhang
    Ma, Yao
    PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2024, : 262 - 270
  • [28] Learning Explanatory Rules from Noisy Data (Extended Abstract)
    Evans, Richard
    Grefenstette, Edward
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 5598 - 5602
  • [29] Controlled Hallucinations: Learning to Generate Faithfully from Noisy Data
    Fillippova, Katja
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 864 - 870
  • [30] Learning to Continually Learn Rapidly from Few and Noisy Data
    Kuo, Nicholas I-Hsien
    Harandi, Mehrtash
    Fourrier, Nicolas
    Walder, Christian
    Ferraro, Gabriela
    Suominen, Hanna
    AAAI WORKSHOP ON META-LEARNING AND METADL CHALLENGE, VOL 140, 2021, 140 : 65 - 76