Conditional Random Field Enhanced Graph Convolutional Neural Networks

被引:38
|
作者
Gao, Hongchang [1 ,2 ]
Pei, Jian [3 ,4 ]
Huang, Heng [1 ,2 ]
机构
[1] Univ Pittsburgh, Elect & Comp Engn, Pittsburgh, PA 15260 USA
[2] JD Finance America Corp, Beijing, Peoples R China
[3] Simon Fraser Univ, Sch Comp Sci, Burnaby, BC, Canada
[4] JD Com, Beijing, Peoples R China
关键词
Graph convolutional neural networks; Conditional random field; Similarity;
D O I
10.1145/3292500.3330888
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph convolutional neural networks have attracted increasing attention in recent years. Unlike the standard convolutional neural network, graph convolutional neural networks perform the convolutional operation on the graph data. Compared with the generic data, the graph data possess the similarity information between different nodes. Thus, it is important to preserve this kind of similarity information in the hidden layers of graph convolutional neural networks. However, existing works fail to do that. On the other hand, it is challenging to enforce the hidden layers to preserve the similarity relationship. To address this issue, we propose a novel CRF layer for graph convolutional neural networks to encourage similar nodes to have similar hidden features. In this way, the similarity information can be preserved explicitly. In addition, the proposed CRF layer is easy to compute and optimize. Therefore, it can be easily inserted into existing graph convolutional neural networks to improve their performance. At last, extensive experimental results have verified the effectiveness of our proposed CRF layer.
引用
收藏
页码:276 / 284
页数:9
相关论文
共 50 条
  • [21] Quantization in Graph Convolutional Neural Networks
    Ben Saad, Leila
    Beferull-Lozano, Baltasar
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 1855 - 1859
  • [22] Community enhanced graph convolutional networks
    Liu, Yanbei
    Wang, Qi
    Wang, Xiao
    Zhang, Fang
    Geng, Lei
    Wu, Jun
    Xiao, Zhitao
    PATTERN RECOGNITION LETTERS, 2020, 138 : 462 - 468
  • [23] Regional Semantic Learning and Mapping Based on Convolutional Neural Network and Conditional Random Field
    Li, Kai
    Qian, Kun
    Liu, Rui
    Fang, Fang
    Yu, Hai
    2020 IEEE INTERNATIONAL CONFERENCE ON REAL-TIME COMPUTING AND ROBOTICS (IEEE-RCAR 2020), 2020, : 14 - 19
  • [24] A unified convolutional neural network integrated with conditional random field for pipe defect segmentation
    Wang, Mingzhu
    Cheng, Jack C. P.
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (02) : 162 - 177
  • [25] Graph Convolutional Networks with Markov Random Field Reasoning for Social Spammer Detection
    Wu, Yongji
    Lian, Defu
    Xu, Yiheng
    Wu, Le
    Chen, Enhong
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 1054 - 1061
  • [26] Multiscale Conditional Regularization for Convolutional Neural Networks
    Lu, Yao
    Lu, Guangming
    Li, Jinxing
    Xu, Yuanrong
    Zhang, Zheng
    Zhang, David
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (01) : 444 - 458
  • [27] Markov Random Field Based Convolutional Neural Networks for Image Classification
    Peng, Yao
    Yin, Hujun
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2017, 2017, 10585 : 387 - 396
  • [28] Are Graph Convolutional Networks With Random Weights Feasible?
    Huang, Changqin
    Li, Ming
    Cao, Feilong
    Fujita, Hamido
    Li, Zhao
    Wu, Xindong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 2751 - 2768
  • [29] The Power of Graph Convolutional Networks to Distinguish Random Graph Models
    Magner, Abram
    Baranwal, Mayank
    Hero, Alfred O., III
    2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 2664 - 2669
  • [30] A Multi-Stream Graph Convolutional Networks-Hidden Conditional Random Field Model for Skeleton-Based Action Recognition
    Liu, Kai
    Gao, Lei
    Khan, Naimul Mefraz
    Qi, Lin
    Guan, Ling
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 64 - 76