Adaptive Multi-Channel Deep Graph Neural Networks

被引:0
|
作者
Wang, Renbiao [1 ,2 ]
Li, Fengtai [1 ]
Liu, Shuwei [1 ]
Li, Weihao [3 ]
Chen, Shizhan [1 ]
Feng, Bin [1 ]
Jin, Di [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Tianjin Univ Technol, Dept Comp Engn, Zhonghuan Informat Coll, Tianjin 300380, Peoples R China
[3] Commonwealth Sci & Ind Res Org CSIRO, Data61, Canberra, ACT 2601, Australia
来源
SYMMETRY-BASEL | 2024年 / 16卷 / 04期
关键词
graph neural networks; graph representation learning; over-smoothing;
D O I
10.3390/sym16040406
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Graph neural networks (GNNs) have shown significant success in graph representation learning. However, the performance of existing GNNs degrades seriously when their layers deepen due to the over-smoothing issue. The node embedding incline converges to a certain value when GNNs repeat, aggregating the representations of the receptive field. The main reason for over-smoothing is that the receptive field of each node tends to be similar as the layers increase, which leads to different nodes aggregating similar information. To solve this problem, we propose an adaptive multi-channel deep graph neural network (AMD-GNN) to adaptively and symmetrically aggregate information from the deep receptive field. The proposed model ensures that the receptive field of each node in the deep layer is different so that the node representations are distinguishable. The experimental results demonstrate that AMD-GNN achieves state-of-the-art performance on node classification tasks with deep models.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Multi-channel handwritten digit recognition using neural networks
    Chi, ZR
    Lu, ZK
    Chan, FH
    [J]. ISCAS '97 - PROCEEDINGS OF 1997 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS I - IV: CIRCUITS AND SYSTEMS IN THE INFORMATION AGE, 1997, : 625 - 628
  • [42] Efficient transfer learning for multi-channel convolutional neural networks
    de La Comble, Alois
    Prepin, Ken
    [J]. PROCEEDINGS OF 17TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA 2021), 2021,
  • [43] Quantum convolutional neural networks for multi-channel supervised learning
    Anthony M. Smaldone
    Gregory W. Kyro
    Victor S. Batista
    [J]. Quantum Machine Intelligence, 2023, 5
  • [44] Quantum convolutional neural networks for multi-channel supervised learning
    Smaldone, Anthony M.
    Kyro, Gregory W.
    Batista, Victor S.
    [J]. QUANTUM MACHINE INTELLIGENCE, 2023, 5 (02)
  • [45] Multi-channel coronal hole detection with convolutional neural networks
    Jarolim, R.
    Veronig, A. M.
    Hofmeister, S.
    Heinemann, S. G.
    Temmer, M.
    Podladchikova, T.
    Dissauer, K.
    [J]. ASTRONOMY & ASTROPHYSICS, 2021, 652
  • [46] Quaternion Neural Networks for Multi-channel Distant Speech Recognition
    Qiu, Xinchi
    Parcollet, Titouan
    Ravanelli, Mirco
    Lane, Nicholas D.
    Morchid, Mohamed
    [J]. INTERSPEECH 2020, 2020, : 329 - 333
  • [47] Dual-channel deep graph convolutional neural networks
    Ye, Zhonglin
    Li, Zhuoran
    Li, Gege
    Zhao, Haixing
    [J]. FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2024, 7
  • [48] An Adaptive Channel Reconfiguration Algorithm for Multi-Channel Multi-Radio Wireless Mesh Networks
    Kanagasabapathy, Arun A.
    Franklin, A. Antony
    Murthy, C. Siva Ram
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2010, 9 (10) : 3064 - 3071
  • [49] Sleep Stages Classification Using Neural Networks with Multi-channel Neural Data
    Ge, Zhenhao
    Sun, Yufang
    [J]. BRAIN INFORMATICS AND HEALTH (BIH 2015), 2015, 9250 : 306 - 316
  • [50] Heterogeneous Network Representation Learning Based on Adaptive Multi-channel Graph Convolution
    Du, Jingwei
    Zhou, Lihua
    Du, Guowang
    Wang, Lizhen
    Jiang, Yiting
    [J]. SPATIAL DATA AND INTELLIGENCE, SPATIALDI 2022, 2022, 13614 : 133 - 153