Backpropagation through Time Algorithm for Training Recurrent Neural Networks using Variable Length Instances

被引:0
|
作者
Grau, Isel [1 ]
Napoles, Gonzalo [1 ]
Bonet, Isis [2 ]
Garcia, Maria Matilde [1 ]
机构
[1] Univ Cent Marta Abreu Las Villas, Ctr Estudios Informat, Las Villas, Cuba
[2] Escuela Ingn Antioquia, Antioquia, Colombia
来源
COMPUTACION Y SISTEMAS | 2013年 / 17卷 / 01期
关键词
Recurrent neural networks; backpropagation through time; sequence analysis; bioinformatics; artificial earthquakes;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial Neural Networks (ANNs) are grouped within connectionist techniques of Artificial Intelligence. In particular, Recurrent Neural Networks are a type of ANN which is widely used in signal reproduction tasks and sequence analysis, where causal relationships in time and space take place. On the other hand, in many problems of science and engineering, signals or sequences under analysis do not always have the same length, making it difficult to select a computational technique for information processing. This article presents a flexible implementation of Recurrent Neural Networks which allows designing the desired topology based on specific application problems. Furthermore, the proposed model is capable of learning to use knowledge bases with instances of variable length in an efficient manner. The performance of the suggested implementation is evaluated through a study case of bioinformatics sequence classification. We also mention its application in obtaining artificial earthquakes from seismic scenarios similar to Cuba.
引用
收藏
页码:15 / 24
页数:10
相关论文
共 50 条
  • [1] ON TRAINING RECURRENT NETWORKS WITH TRUNCATED BACKPROPAGATION THROUGH TIME IN SPEECH RECOGNITION
    Tang, Hao
    Glass, James
    2018 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2018), 2018, : 48 - 55
  • [2] Recurrent neural network with backpropagation through time algorithm for arabic recognition
    Ismail, S
    bin Ahmad, AM
    ESM'2004: 18TH EUROPEAN SIMULATION MULTICONFERENCE: NETWORKED SIMULATIONS AND SIMULATED NETWORKS, 2004, : 29 - 33
  • [3] AN ADAPTIVE TRAINING ALGORITHM FOR BACKPROPAGATION NEURAL NETWORKS
    HSIN, HC
    LI, CC
    SUN, MG
    SCLABASSI, RJ
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1995, 25 (03): : 512 - 514
  • [4] A stochastic backpropagation algorithm for training neural networks
    Chen, YQ
    Yin, T
    Babri, HA
    ICICS - PROCEEDINGS OF 1997 INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS AND SIGNAL PROCESSING, VOLS 1-3: THEME: TRENDS IN INFORMATION SYSTEMS ENGINEERING AND WIRELESS MULTIMEDIA COMMUNICATIONS, 1997, : 703 - 707
  • [5] IMPROVEMENT OF THE BACKPROPAGATION ALGORITHM FOR TRAINING NEURAL NETWORKS
    LEONARD, J
    KRAMER, MA
    COMPUTERS & CHEMICAL ENGINEERING, 1990, 14 (03) : 337 - 341
  • [6] Recurrent neural networks trained with backpropagation through time algorithm to estimate nonlinear load harmonic currents
    Mazumdar, Joy
    Harley, Ronald G.
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2008, 55 (09) : 3484 - 3491
  • [7] A Modified Backpropagation Training Algorithm for Feedforward Neural Networks*
    T. Kathirvalavakumar
    P. Thangavel
    Neural Processing Letters, 2006, 23 : 111 - 119
  • [8] A modified backpropagation training algorithm for feedforward neural networks
    Kathirvalavakumar, T
    Thangavel, P
    NEURAL PROCESSING LETTERS, 2006, 23 (02) : 111 - 119
  • [9] Evolving Deep Recurrent Neural Networks Using A New Variable-Length Genetic Algorithm
    Viswambaran, Ramya Anasseriyil
    Chen, Gang
    Xue, Bing
    Nekooei, Mohammad
    2020 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2020,
  • [10] Training recurrent neural networks using a hybrid algorithm
    Ben Nasr, Mounir
    Chtourou, Mohamed
    NEURAL COMPUTING & APPLICATIONS, 2012, 21 (03): : 489 - 496