Neural networks and statistical inference: seeking robust and efficient learning

被引:4
|
作者
Capobianco, E
机构
[1] Univ Padua, Dept Stat Sci, I-35121 Padua, Italy
[2] Stanford Univ, Parallel Distributed Proc Lab, Stanford, CA 94305 USA
关键词
D O I
10.1016/S0167-9473(99)00089-4
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Semiparametric statistical inference concepts are briefly reviewed and applied to artificial neural networks. We deal with asymptotic efficiency and robustness aspects of learning, two properties which represent key factors for the quality of the estimates that statisticians obtain. In particular, the accuracy of the estimates in the presence of outlying observations is an important goal since it is a well-known fact that between efficiency and robustness one seeks the best compromise. With that scope in mind, we analyze possible ways of building up net architectures without relying on strong assumptions about the functional components in the model. (C) 2000 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:443 / 454
页数:12
相关论文
共 50 条
  • [1] Statistical inference: learning in artificial neural networks
    Yang, HH
    Murata, N
    Amari, S
    [J]. TRENDS IN COGNITIVE SCIENCES, 1998, 2 (01) : 4 - 10
  • [2] From statistical inference to a differential learning rule for stochastic neural networks
    Saglietti, Luca
    Gerace, Federica
    Ingrosso, Alessandro
    Baldassi, Carlo
    Zecchina, Riccardo
    [J]. INTERFACE FOCUS, 2018, 8 (06)
  • [3] Efficient and Robust Supervised Learning Algorithm for Spiking Neural Networks
    Zhang Y.
    Geng T.
    Zhang M.
    Wu X.
    Zhou J.
    Qu H.
    [J]. Sensing and Imaging, 2018, 19 (1):
  • [4] Adaptive Neural Networks for Efficient Inference
    Bolukbasi, Tolga
    Wang, Joseph
    Dekel, Ofer
    Saligrama, Venkatesh
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [5] Statistical Inference and Analysis for Efficient Modeling of Environmental Pollution using Deep Neural Networks
    Sravani, Chilukuri Lakshmi
    Miriyala, Srinivas Soumitri
    Mitra, Kishalay
    [J]. 2022 EIGHTH INDIAN CONTROL CONFERENCE, ICC, 2022, : 385 - 390
  • [6] Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks
    Hoefler, Torsten
    Alistarh, Dan
    Ben-Nun, Tal
    Dryden, Nikoli
    Peste, Alexandra
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 23
  • [7] Sparsity in deep learning: Pruning and growth for efficient inference and training in neural networks
    Hoefler, Torsten
    Alistarh, Dan
    Ben-Nun, Tal
    Dryden, Nikoli
    Peste, Alexandra
    [J]. Journal of Machine Learning Research, 2021, 22
  • [8] Efficient learning of robust quadruped bounding using pretrained neural networks
    Wang, Zhicheng
    Li, Anqiao
    Zheng, Yixiao
    Xie, Anhuan
    Li, Zhibin
    Wu, Jun
    Zhu, Qiuguo
    [J]. IET CYBER-SYSTEMS AND ROBOTICS, 2022, 4 (04) : 331 - 338
  • [9] Weightless Neural Networks for Efficient Edge Inference
    Susskind, Zachary
    Arora, Aman
    Miranda, Igor D. S.
    Villon, Luis A. Q.
    Katopodis, Rafael F.
    de Araujo, Leandro S.
    Dutra, Diego L. C.
    Lima, Priscila M. V.
    Franca, Felipe M. G.
    Breternitz, Mauricio, Jr.
    John, Lizy K.
    [J]. PROCEEDINGS OF THE 2022 31ST INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES, PACT 2022, 2022, : 279 - 290
  • [10] Probabilistic Bayesian Neural Networks for Efficient Inference
    Ishak, Md
    Alawad, Mohammed
    [J]. PROCEEDING OF THE GREAT LAKES SYMPOSIUM ON VLSI 2024, GLSVLSI 2024, 2024, : 724 - 729