Rate of convergence in density estimation using neural networks

被引:8
|
作者
Modha, DS
Masry, E
机构
[1] Dept. of Elec. and Comp. Engineering, Univ. of California at San Diego, San Diego, CA 92093-0407
关键词
D O I
10.1162/neco.1996.8.5.1107
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given Ni.i.d. observations {X(i)}(N)(i=1) taking values in a compact subset of R(d), such that p* denotes their common probability density function, we estimate p* from an exponential family of densities based on single hidden layer sigmoidal networks using a certain minimum complexity density estimation scheme. Assuming that p* possesses a certain exponential representation, we establish a rate of convergence, independent of the dimension d, for the expected Hellinger distance between the proposed minimum complexity density estimator and the true underlying density p*.
引用
收藏
页码:1107 / 1122
页数:16
相关论文
共 50 条
  • [1] Convergence rate of Artificial Neural Networks for estimation in software
    Rankovic, Dragica
    Rankovic, Nevena
    Ivanovic, Mirjana
    Lazic, Ljubomir
    [J]. INFORMATION AND SOFTWARE TECHNOLOGY, 2021, 138
  • [3] Rain rate estimation using neural networks
    Miller, SW
    [J]. AI APPLICATIONS, 1997, 11 (01): : 95 - 98
  • [4] On convergence rate of projection neural networks
    Xia, YS
    Feng, G
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2004, 49 (01) : 91 - 96
  • [5] Density estimation using deep generative neural networks
    Liu, Qiao
    Xu, Jiaze
    Jiang, Rui
    Wong, Wing Hung
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (15)
  • [6] Conditionally Tractable Density Estimation using Neural Networks
    Dong, Hailiang
    Roy, Chiradeep
    Rahman, Tahrima
    Gogate, Vibhav
    Ruozzi, Nicholas
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [7] Probability density estimation using artificial neural networks
    Likas, A
    [J]. COMPUTER PHYSICS COMMUNICATIONS, 2001, 135 (02) : 167 - 175
  • [8] Stability analysis and estimation of convergence rate for second order Hopfield neural networks
    Xu, Bing-Ji
    Liao, Xiao-Xin
    Liu, Xin-Zhi
    Chen, Qin-Sheng
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2003, 31 (01): : 63 - 67
  • [9] An estimation of the domain of attraction and convergence rate for Hopfield continuous feedback neural networks
    Cao, JD
    [J]. PHYSICS LETTERS A, 2004, 325 (5-6) : 370 - 374
  • [10] Estimation on domain of attraction and convergence rate of Hopfield continuous feedback neural networks
    Cao, JD
    Tao, Q
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2001, 62 (03) : 528 - 534