FAST GRAPH CONVOLUTIONAL RECURRENT NEURAL NETWORKS

被引:0
|
作者
Kadambari, Sai Kiran [1 ]
Chepuri, Sundeep Prabhakar [1 ]
机构
[1] Indian Inst Sci, Bangalore, Karnataka, India
关键词
Deep learning; Graph neural networks; graph signal processing; recurrent neural networks;
D O I
10.1109/ieeeconf44664.2019.9048829
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a Fast Graph Convolutional Neural Network (FGRNN) architecture to predict sequences with an underlying graph structure. The proposed architecture addresses the limitations of the standard recurrent neural network (RNN), namely, vanishing and exploding gradients, causing numerical instabilities during training. State-of-the-art architectures that combine gated RNN architectures, such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) with graph convolutions are known to improve the numerical stability during the training phase, but at the expense of the model size involving a large number of training parameters. FGRNN addresses this problem by adding a weighted residual connection with only two extra training parameters as compared to the standard RNN. Numerical experiments on the real 3D point cloud dataset corroborates the proposed architecture.
引用
收藏
页码:467 / 471
页数:5
相关论文
共 50 条
  • [41] Recurrent convolutional neural networks for poet identification
    Salami, Dariush
    Momtazi, Saeedeh
    [J]. DIGITAL SCHOLARSHIP IN THE HUMANITIES, 2021, 36 (02) : 472 - 481
  • [42] CONVOLUTIONAL RECURRENT NEURAL NETWORKS FOR MUSIC CLASSIFICATION
    Choi, Keunwoo
    Fazekas, Gyorgy
    Sandler, Mark
    Cho, Kyunghyun
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2392 - 2396
  • [43] Convolutional Recurrent Neural Networks for Text Classification
    Lyu, Shengfei
    Liu, Jiaqi
    [J]. JOURNAL OF DATABASE MANAGEMENT, 2021, 32 (04) : 65 - 82
  • [44] Convolutional Neural Networks With Gated Recurrent Connections
    Wang, Jianfeng
    Hu, Xiaolin
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) : 3421 - 3435
  • [45] Recurrent Convolutional Neural Networks for Text Classification
    Lai, Siwei
    Xu, Liheng
    Liu, Kang
    Zhao, Jun
    [J]. PROCEEDINGS OF THE TWENTY-NINTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2015, : 2267 - 2273
  • [46] Convolutional Recurrent Neural Networks for Text Classification
    Wang, Ruishuang
    Li, Zhao
    Cao, Jian
    Chen, Tong
    Wang, Lei
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [47] Convolutional Recurrent Neural Networks for Electrocardiogram Classification
    Zihlmann, Martin
    Perekrestenko, Dmytro
    Tschannen, Michael
    [J]. 2017 COMPUTING IN CARDIOLOGY (CINC), 2017, 44
  • [48] Fast algorithm for recurrent neural networks
    Wang, Ju
    Liu, Heping
    [J]. Beijing Keji Daxue Xuebao/Journal of University of Science and Technology Beijing, 2000, 22 (01): : 89 - 92
  • [49] Fast Prediction of Quasi-Periodic Array Using Dynamical Graph Convolutional Neural Networks
    Xiang, Wei
    Zhang, Zhe
    Yang, Xiaolu
    Liu, Zhenguo
    Yang, Wu
    Li, Jiaqi
    Zheng, Wenming
    Lu, Weibing
    [J]. IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2022, 21 (05): : 893 - 897
  • [50] Fast and Accurate Predictions of Total Energy for Solid Solution Alloys with Graph Convolutional Neural Networks
    Pasini, Massimiliano Lupo
    Burcul, Marko
    Reeve, Samuel Temple
    Eisenbach, Markus
    Perotto, Simona
    [J]. DRIVING SCIENTIFIC AND ENGINEERING DISCOVERIES THROUGH THE INTEGRATION OF EXPERIMENT, BIG DATA, AND MODELING AND SIMULATION, 2022, 1512 : 79 - 98