Augmented Efficient BackProp for Backpropagation Learning in Deep Autoassociative Neural Networks

被引:0
|
作者
Embrechts, Mark J. [1 ]
Hargis, Blake J. [1 ]
Linton, Jonathan D. [2 ]
机构
[1] Rensselaer Polytech Inst, Dept Ind & Syst Engn, Troy, NY 12180 USA
[2] Univ Ottawa, Sch Management, Ottawa, ON K1N 6N5, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
PRINCIPAL COMPONENT ANALYSIS; NONLINEAR PCA; ALGORITHM;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce Augmented Efficient BackProp as a strategy for applying the backpropagation algorithm to deep autoencoders, i.e., autoassociators with many hidden layers, without relying on a weight initialization using restricted Boltzmann machines. This training method is an extension of Efficient BackProp, first proposed by LeCun et al. [1], and is benchmarked on three different types of application datasets.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] AUTOASSOCIATIVE MEMORY CELLULAR NEURAL NETWORKS
    Itoh, Makoto
    Chua, Leon O.
    INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2010, 20 (10): : 3225 - 3266
  • [42] AUTOASSOCIATIVE NEURAL NETWORKS FOR IMAGE COMPRESSION
    BASSO, A
    KUNT, M
    EUROPEAN TRANSACTIONS ON TELECOMMUNICATIONS, 1992, 3 (06): : 593 - 598
  • [43] Noise discrimination and autoassociative neural networks
    Santa Cruz, C
    Dorronsoro, JR
    Siguenza, JA
    Lopez, V
    BIOLOGICAL AND ARTIFICIAL COMPUTATION: FROM NEUROSCIENCE TO TECHNOLOGY, 1997, 1240 : 1213 - 1220
  • [44] Multi-way backpropagation networks for training compact deep neural networks
    Guo, Yong
    Chen, Jian
    Du, Qing
    Van Den Hengel, Anton
    Shi, Qinfeng
    Tan, Mingkui
    NEURAL NETWORKS, 2020, 126 : 250 - 261
  • [45] Manipulation of attractors in feed-forward autoassociative neural networks for robust learning
    Amini, Nima
    Seyyedsalehi, Seyyed Ali
    2017 25TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2017, : 29 - 33
  • [46] Predicting International Roughness Index by Deep Neural Networks with Levenberg-Marquardt backpropagation learning algorithm
    Fiorentini, Nicholas
    Leandri, Pietro
    Losa, Massimo
    EARTH RESOURCES AND ENVIRONMENTAL REMOTE SENSING/GIS APPLICATIONS XII, 2021, 11863
  • [47] Backpropagation Learning Algorithm for Multi layer Phasor Neural Networks
    Tanaka, Gouhei
    Aihara, Kazuyuki
    NEURAL INFORMATION PROCESSING, PT 1, PROCEEDINGS, 2009, 5863 : 484 - 493
  • [48] Neural networks with modified backpropagation learning applied to structural optimization
    Kodiyalam, S
    Gurumoorthy, R
    AIAA JOURNAL, 1996, 34 (02) : 408 - 412
  • [49] Analog Backpropagation Learning Circuits for Memristive Crossbar Neural Networks
    Krestinskaya, Olga
    Salama, Khaled Nabil
    James, Alex Pappachen
    2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [50] A backpropagation learning algorithm with graph regularization for feedforward neural networks
    Fan, Yetian
    Yang, Wenyu
    INFORMATION SCIENCES, 2022, 607 : 263 - 277