Risk-averting criteria for training neural networks

被引:0
|
作者
Lo, JTH [1 ]
机构
[1] Univ Maryland Baltimore Cty, Dept Math & Stat, Baltimore, MD 21228 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper shows that when a risk-averting error criterion is used to train a neural network or estimate a nonlinear regression model, as the risk-sensitivity index of the criterion increases. the domain on which the criterion is convex increases monotonically to the entire weight or parameter vector space R-N except the union of a finite number of manifolds whose dimensions are less than N. This paper also shows that inreasing the risk-sensitivity index reduces the maximum deviation of the outputs of the trained neural network or estimated regression model from the corresponding output measurements.
引用
收藏
页码:476 / 481
页数:6
相关论文
共 50 条
  • [1] Adaptive Normalized Risk-Averting Training for Deep Neural Networks
    Wang, Zhiguang
    Oates, Tim
    Lo, James
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 2201 - 2207
  • [2] The normalized risk-averting error criterion for avoiding nonglobal local minima in training neural networks
    Lo, James Ting-Ho
    Gui, Yichuan
    Peng, Yun
    NEUROCOMPUTING, 2015, 149 : 3 - 12
  • [3] Distributed Robust Training of Multilayer Neural Netwroks Using Normalized Risk-Averting Error
    Ninomiya, Hiroshi
    2014 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE, COGNITIVE ALGORITHMS, MIND, AND BRAIN (CCMB), 2014, : 134 - 140
  • [4] A Pairwise Algorithm for Training Multilayer Perceptrons with the Normalized Risk-Averting Error Criterion
    Gui, Yichuan
    Lo, James Ting-Ho
    Peng, Yun
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 344 - 351
  • [5] Migrant organisations, belonging and social protection. The role of migrant organisations in migrants' social risk-averting strategies
    Barglowski, Karolina
    Bonfert, Lisa
    INTERNATIONAL MIGRATION, 2023, 61 (04) : 72 - 87
  • [6] Integration of Unsupervised and Supervised Criteria for Deep Neural Networks Training
    Zamora-Martinez, Francisco
    Munoz-Almaraz, Javier
    Pardo, Juan
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2016, PT II, 2016, 9887 : 55 - 62
  • [7] THE RISK-AVERTING GAME OF TRANSPORT PUBLIC-PRIVATE PARTNERSHIP Lessons from the Adventure of California's State Route 91 Express Lanes
    Ni, Anna Ya
    PUBLIC PERFORMANCE & MANAGEMENT REVIEW, 2012, 36 (02) : 253 - 274
  • [8] A FAMILY OF DISCRIMINATIVE TRAINING CRITERIA BASED ON THE F-DIVERGENCE FOR DEEP NEURAL NETWORKS
    Nussbaum-Thom, Markus
    Cui, Xiaodong
    Schlueter, Ralf
    Goel, Vaibhava
    Ney, Hermann
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [9] Stability criteria for delayed neural networks
    Lu, HT
    PHYSICAL REVIEW E, 2001, 64 (05): : 13
  • [10] neuralnet: Training of Neural Networks
    Guenther, Frauke
    Fritsch, Stefan
    R JOURNAL, 2010, 2 (01): : 30 - 38