Survey on Graph Neural Network

被引:0
|
作者
Ma S. [1 ]
Liu J. [1 ]
Zuo X. [1 ]
机构
[1] College of Information Science and Engineering, China University of Petroleum (Beijing), Beijing
关键词
Graph convolutional neural network; Graph neural network; Graph structure data; Spatial domain and pooling; Spectral domain;
D O I
10.7544/issn1000-1239.20201055
中图分类号
学科分类号
摘要
In recent years, the application of deep learning related to graph structure data has attracted more and more attention. The emergence of graph neural network has made major breakthroughs in the above tasks, such as social networking, natural language processing, computer vision, even life sciences and other fields. The graph neural network can treat the actual problem as the connection between nodes in the graph and the message propagation problem, and the dependence between nodes can be modeled, so that the graph structure data can be handled well. In view of this, the graph neural network model and its application are systematically reviewed. Firstly, the graph convolutional neural network is explained from three aspects: spectral domain, spatial domain and pooling. Then, the graph neural network model based on the attention mechanism and autoencoder is described, and some graph neural network implemented by other methods are supplemented. Secondly, it summarizes the discussion and analysis on whether the graph neural network can be bigger and deeper. Furthermore, four frameworks of graph neural network are summarized. It also explains in detail the application of graph neural network in natural language processing and computer vision, etc. Finally, the future research of graph neural network is prospected and summarized. Compared with existing review articles on graph neural network, it elaborates the knowledge of spectral theory in detail, and comprehensively summarizes the development history of graph convolutional neural network based on the spectral domain. At the same time, a new classification standard, an improved model for the low efficiency of the spatial domain graph convolutional neural network, is given. And for the first time, it summarizes the discussion and analysis of graph neural network expression ability, theoretical guarantee, etc., and adds a new framework model. In the application part, the latest application of graph neural network is explained. © 2022, Science Press. All right reserved.
引用
收藏
页码:47 / 80
页数:33
相关论文
共 142 条
  • [1] Lecun Y, Bottou L, Bengio Y, Et al., Gradient-based learning applied to document recognition, Proceedings of the IEEE, 86, 11, pp. 2278-2324, (1998)
  • [2] Gu Jiuxiang, Wang Zhenhua, Kuen J, Et al., Recent advances in convolutional neural networks, Pattern Recognition, 77, pp. 354-377, (2018)
  • [3] Lawrence S, Giles C L, Tsoi A C, Et al., Face recognition: A convolutional neural-network approach, IEEE Transactions on Neural Networks, 8, 1, pp. 98-113, (1997)
  • [4] Ciresan D C, Meier U, Masci J, Et al., Flexible, high performance convolutional neural networks for image classification, Proc of the 22nd Int Joint Conf on Artificial Intelligence, pp. 1237-1242, (2011)
  • [5] Dalal N, Triggs B., Histograms of oriented gradients for humandetection, Proc of the IEEE Conf on Computer Vision and Pattern Recognition, pp. 886-893, (2005)
  • [6] Fan Jialue, Xu Wei, Wu Ying, Et al., Human tracking using convolutional neural networks, IEEE Transactions on Neural Networks, 21, 10, pp. 1610-1623, (2010)
  • [7] Huang Weilin, Qiao Yu, Tang Xiao'ou, Robust scene text detection with convolution neural network induced MSER trees, Proc of the European Conf on Computer Vision, pp. 497-511, (2014)
  • [8] Kim Y., Convolutional neural networks for sentence classification, (2014)
  • [9] Donahue J, Jia Yangqing, Vinyals O, Et al., DeCAF: A deep convolutional activation feature for generic visual recognition, Proc of the Int Conf on Machine Learning, pp. 647-655, (2014)
  • [10] Zhu Han, Li Xiang, Zhang Pengye, Et al., Learning tree-based deep model for recommender systems, Proc of the 24th ACM SIGKDD Int Conf on Knowledge Discovery and Data Mining, pp. 1079-1088, (2018)