FAST GRAPH CONVOLUTIONAL RECURRENT NEURAL NETWORKS

被引:0
|
作者
Kadambari, Sai Kiran [1 ]
Chepuri, Sundeep Prabhakar [1 ]
机构
[1] Indian Inst Sci, Bangalore, Karnataka, India
关键词
Deep learning; Graph neural networks; graph signal processing; recurrent neural networks;
D O I
10.1109/ieeeconf44664.2019.9048829
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a Fast Graph Convolutional Neural Network (FGRNN) architecture to predict sequences with an underlying graph structure. The proposed architecture addresses the limitations of the standard recurrent neural network (RNN), namely, vanishing and exploding gradients, causing numerical instabilities during training. State-of-the-art architectures that combine gated RNN architectures, such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) with graph convolutions are known to improve the numerical stability during the training phase, but at the expense of the model size involving a large number of training parameters. FGRNN addresses this problem by adding a weighted residual connection with only two extra training parameters as compared to the standard RNN. Numerical experiments on the real 3D point cloud dataset corroborates the proposed architecture.
引用
收藏
页码:467 / 471
页数:5
相关论文
共 50 条
  • [1] Gated Graph Convolutional Recurrent Neural Networks
    Ruiz, Luana
    Gama, Fernando
    Ribeiro, Alejandro
    [J]. 2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [2] Embedding Graph Convolutional Networks in Recurrent Neural Networks for Predictive Monitoring
    Rama-Maneiro, Efren
    Vidal, Juan C.
    Lama, Manuel
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (01) : 137 - 151
  • [3] Geometric Hawkes Processes with Graph Convolutional Recurrent Neural Networks
    Shang, Jin
    Sun, Mingxuan
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4878 - 4885
  • [4] Graph Convolutional Recurrent Neural Networks for Water Demand Forecasting
    Zanfei, Ariele
    Brentan, Bruno M.
    Menapace, Andrea
    Righetti, Maurizio
    Herrera, Manuel
    [J]. WATER RESOURCES RESEARCH, 2022, 58 (07)
  • [5] Convolutional Graph Neural Networks
    Gama, Fernando
    Marques, Antonio G.
    Leus, Geert
    Ribeiro, Alejandro
    [J]. CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 452 - 456
  • [6] Predicting Drug-Target Affinity Based on Recurrent Neural Networks and Graph Convolutional Neural Networks
    Tian, Qingyu
    Ding, Mao
    Yang, Hui
    Yue, Caibin
    Zhong, Yue
    Du, Zhenzhen
    Liu, Dayan
    Liu, Jiali
    Deng, Yufeng
    [J]. COMBINATORIAL CHEMISTRY & HIGH THROUGHPUT SCREENING, 2022, 25 (04) : 634 - 641
  • [7] Sequential Convolutional Recurrent Neural Networks for Fast Automatic Modulation Classification
    Liao, Kaisheng
    Zhao, Yaodong
    Gu, Jie
    Zhang, Yaping
    Zhong, Yi
    [J]. IEEE ACCESS, 2021, 9 : 27182 - 27188
  • [8] DIRECTION FINDING USING CONVOLUTIONAL NEURAL NETWORKS and CONVOLUTIONAL RECURRENT NEURAL NETWORKS
    Uckun, Fehmi Ayberk
    Ozer, Hakan
    Nurbas, Ekin
    Onat, Emrah
    [J]. 2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [9] Adaptive Graph Convolutional Neural Networks
    Li, Ruoyu
    Wang, Sheng
    Zhu, Feiyun
    Huang, Junzhou
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3546 - 3553
  • [10] Pooling in Graph Convolutional Neural Networks
    Cheung, Mark
    Shi, John
    Jiang, Lavender
    Wright, Oren
    Moura, Jose M. F.
    [J]. CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 462 - 466