Unsupervised learning in LSTM recurrent neural networks

被引：0

作者：

Klapper-Rybicka, M

Schraudolph, NN

Schmidhuber, J

机构：

[1] Stanislaw Staszic Univ Min & Met, Inst Comp Sci, PL-30059 Krakow, Poland

[2] Swiss Fed Inst Technol, Inst Computat Sci, CH-8092 Zurich, Switzerland

[3] IDSIA, CH-6928 Manno, Switzerland

来源：

ARTIFICIAL NEURAL NETWORKS-ICANN 2001, PROCEEDINGS | 2001年 / 2130卷

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

While much work has been done on unsupervised learning in feedforward neural network architectures, its potential with (theoretically more powerful) recurrent networks and time-varying inputs has rarely been explored. Here we train Long Short-Term Memory (LSTM) recurrent networks to maximize two in formation-theoretic objectives for unsupervised learning: Binary Information Gain Optimization (BINGO) and Nonparametric Entropy Optimization (NEO). LSTM learns to discriminate different types of temporal sequences and group them according to a variety of features.

引用

页码：684 / 691

页数：8

共 50 条

[21] UNSUPERVISED DYNAMIC LEARNING IN LAYERED NEURAL NETWORKS
JONKER, HJJ
COOLEN, ACC
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1991, 24 (17): : 4219 - 4234
[22] Theories of neural networks leading to unsupervised learning
Szu, Harold
2007 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-6, 2007, : 3121 - 3128
[23] LSTM Recurrent Neural Networks for Cybersecurity Named Entity Recognition
Gasmi, Houssem
Bouras, Abdelaziz
Laval, Jannik
THIRTEENTH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING ADVANCES (ICSEA 2018), 2018, : 1 - 6
[24] Tweet Modeling with LSTM Recurrent Neural Networks for Hashtag Recommendation
Li, Jia
Xu, Hua
He, Xingwei
Deng, Junhui
Sun, Xiaomin
2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1570 - 1577
[25] Learning Queuing Networks by Recurrent Neural Networks
Garbi, Giulio
Incerto, Emilio
Tribastone, Mirco
PROCEEDINGS OF THE ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE'20), 2020, : 56 - 66
[26] LSTM Recurrent Neural Networks for Short Text and Sentiment Classification
Nowak, Jakub
Taspinar, Ahmet
Scherer, Rafal
ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2017, PT II, 2017, 10246 : 553 - 562
[27] From feedforward to recurrent LSTM neural networks for language modeling
Sundermeyer, Martin
Ney, Hermann
Schluter, Ralf
IEEE Transactions on Audio, Speech and Language Processing, 2015, 23 (03): : 517 - 529
[28] Towards traffic matrix prediction with LSTM recurrent neural networks
Zhao, Jianlong
Qu, Hua
Zhao, Jihong
Jiang, Dingchao
ELECTRONICS LETTERS, 2018, 54 (09) : 566 - 567
[29] Predicting Activities in Business Processes with LSTM Recurrent Neural Networks
Tello-Leal, Edgar
Roa, Jorge
Rubiolo, Mariano
Ramirez-Alcocer, Ulises M.
2018 ITU KALEIDOSCOPE: MACHINE LEARNING FOR A 5G FUTURE (ITU K), 2018,
[30] From Feedforward to Recurrent LSTM Neural Networks for Language Modeling
Sundermeyer, Martin
Ney, Hermann
Schlueter, Ralf
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2015, 23 (03) : 517 - 529

← 1 2 3 4 5 →