Backpropagation through Time Algorithm for Training Recurrent Neural Networks using Variable Length Instances

被引:0
|
作者
Grau, Isel [1 ]
Napoles, Gonzalo [1 ]
Bonet, Isis [2 ]
Garcia, Maria Matilde [1 ]
机构
[1] Univ Cent Marta Abreu Las Villas, Ctr Estudios Informat, Las Villas, Cuba
[2] Escuela Ingn Antioquia, Antioquia, Colombia
来源
COMPUTACION Y SISTEMAS | 2013年 / 17卷 / 01期
关键词
Recurrent neural networks; backpropagation through time; sequence analysis; bioinformatics; artificial earthquakes;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial Neural Networks (ANNs) are grouped within connectionist techniques of Artificial Intelligence. In particular, Recurrent Neural Networks are a type of ANN which is widely used in signal reproduction tasks and sequence analysis, where causal relationships in time and space take place. On the other hand, in many problems of science and engineering, signals or sequences under analysis do not always have the same length, making it difficult to select a computational technique for information processing. This article presents a flexible implementation of Recurrent Neural Networks which allows designing the desired topology based on specific application problems. Furthermore, the proposed model is capable of learning to use knowledge bases with instances of variable length in an efficient manner. The performance of the suggested implementation is evaluated through a study case of bioinformatics sequence classification. We also mention its application in obtaining artificial earthquakes from seismic scenarios similar to Cuba.
引用
收藏
页码:15 / 24
页数:10
相关论文
共 50 条
  • [21] Generalized backpropagation algorithm for training second-order neural networks
    Fan, Fenglei
    Cong, Wenxiang
    Wang, Ge
    INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING, 2018, 34 (05)
  • [22] A MODIFIED BACKPROPAGATION ALGORITHM FOR TRAINING NEURAL NETWORKS ON DATA WITH ERROR BARS
    GERNOTH, KA
    CLARK, JW
    COMPUTER PHYSICS COMMUNICATIONS, 1995, 88 (01) : 1 - 22
  • [23] Efficient training of backpropagation neural networks
    Otair, Mohammed A.
    Salameh, Walid A.
    NEURAL NETWORK WORLD, 2006, 16 (04) : 291 - 311
  • [24] Fuzzy backpropagation training of neural networks
    Gerke, M
    Hoyer, H
    COMPUTATIONAL INTELLIGENCE: THEORY AND APPLICATIONS, 1997, 1226 : 416 - 427
  • [25] Improved variable-step backpropagation training method for feedforward neural networks
    Cogswell, R
    INTERNATIONAL SOCIETY FOR COMPUTERS AND THEIR APPLICATIONS 13TH INTERNATIONAL CONFERENCE ON COMPUTERS AND THEIR APPLICATIONS, 1998, : 330 - 335
  • [26] Training fuzzy number neural networks using constrained backpropagation
    Dunyak, J
    Guven, M
    Wunsch, D
    1998 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AT THE IEEE WORLD CONGRESS ON COMPUTATIONAL INTELLIGENCE - PROCEEDINGS, VOL 1-2, 1998, : 1142 - 1146
  • [27] Training of photonic neural networks through in situ backpropagation and gradient measurement
    Hughes, Tyler W.
    Minkov, Momchil
    Shi, Yu
    Fan, Shanhui
    OPTICA, 2018, 5 (07): : 864 - 871
  • [28] Remarks on System Identification Using a Quaternion Recurrent Neural Network Trained by Backpropagation through Time
    Takahashi, Kazuhiko
    Shibata, Sora
    Hashimoto, Masafumi
    2021 AUSTRALIAN & NEW ZEALAND CONTROL CONFERENCE (ANZCC), 2021, : 122 - 125
  • [29] Training of Recurrent Internal Symmetry Networks by Backpropagation
    Blair, Alan
    Li, Guanzhong
    IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 2027 - 2032
  • [30] ON FUZZY MODELING USING FUZZY NEURAL NETWORKS WITH THE BACKPROPAGATION ALGORITHM
    HORIKAWA, S
    FURUHASHI, T
    UCHIKAWA, Y
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (05): : 801 - 806