Relation extraction for manufacturing knowledge graphs based on feature fusion of attention mechanism and graph convolution network

被引:16
|
作者
Du, Kaze [1 ]
Yang, Bo [1 ,2 ,4 ]
Wang, Shilong [1 ]
Chang, Yongsheng [3 ]
Li, Song [3 ]
Yi, Gang [3 ]
机构
[1] Chongqing Univ, State Key Lab Mech Transmiss, Chongqing 400044, Peoples R China
[2] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Peoples R China
[3] Chongqing Changan Automobile Co Ltd, Chongqing 401147, Peoples R China
[4] Chongqing Univ, State Key Lab Mech Transmiss, 174Shazheng St, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graph; Relation extraction; Graph convolution network (GCN); Attention mechanism; Manufacturing;
D O I
10.1016/j.knosys.2022.109703
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Relation extraction is a crucial step in the constructions of knowledge graphs (KGs). However, relation extraction is performed manually in the manufacturing field due to the sentence characteristics, which include weak correlation and high entity density. This approach has the disadvantages of low efficiency and high dependence on experts. At present, very few studies have been performed on relation extraction in the manufacturing field, so establishing a relation extraction model with high efficiency is an urgent need. Therefore, in this paper, a relation extraction model is proposed for manufacturing knowledge (MKREM), in which word embedding is obtained by the Bi-LSTM layer to improve robustness, and a Simplified Graph Convolution Network (SGC) layer is applied to quickly mine the entity information. Then, dependency and semantic features are extracted by the multi-head stacked GCN and relation attention mechanism, respectively. Finally, the dependency and semantic features are fused to generate the comprehensive features for relation extraction so that better performance on texts with weak correlation and high entity density can be obtained. The performance of MKREM is tested by experiments on the equipment maintenance dataset and the quality dataset from an automobile enterprise, and its effectiveness is verified in the automobile manufacture filed. The results show that the F1 scores obtained using MKREM are 2% higher than those of the commonly used models on both datasets, and the F1 scores when using Contextualized-MKREM are improved by 3%, so MKREM is very suitable for the automatic relation extraction during establishing manufacturing KGs. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Attention-Aware Path-Based Relation Extraction for Medical Knowledge Graph
    Wen, Desi
    Liu, Yong
    Yuan, Kaiqi
    Si, Shangchun
    Shen, Ying
    [J]. SMART COMPUTING AND COMMUNICATION, SMARTCOM 2017, 2018, 10699 : 321 - 331
  • [42] Adaptive Graph Convolutional Networks with Attention Mechanism for Relation Extraction
    Li, Zhixin
    Sun, Yaru
    Tang, Suqin
    Zhang, Canlong
    Ma, Huifang
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [43] A multi-stage feature fusion defogging network based on the attention mechanism
    Yuqin Song
    Jitao Zhao
    Chunliang Shang
    [J]. The Journal of Supercomputing, 2024, 80 (4) : 4577 - 4599
  • [44] Multi-label Feature Extraction With Distance-Based Graph Attention Network
    Peng, Yue
    Qian, Kun
    Song, Guojie
    Min, Fan
    [J]. ROUGH SETS, IJCRS 2022, 2022, 13633 : 203 - 216
  • [45] A multi-stage feature fusion defogging network based on the attention mechanism
    Song, Yuqin
    Zhao, Jitao
    Shang, Chunliang
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (04): : 4577 - 4599
  • [46] Tile Defect Recognition Network Based on Amplified Attention Mechanism and Feature Fusion
    Zhang, JiaMing
    Qiang, ZanXia
    Li, YuGang
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (05) : 58 - 65
  • [47] AFFNet: Attention Mechanism Network Based on Fusion Feature for Image Cloud Removal
    Shen, Runhan
    Zhang, Xiaofeng
    Xiang, Yonggang
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (08)
  • [48] Feature Extraction Network with Attention Mechanism for Data Enhancement and Recombination Fusion for Multimodal Sentiment Analysis
    Qi, Qingfu
    Lin, Liyuan
    Zhang, Rui
    [J]. INFORMATION, 2021, 12 (09)
  • [49] Heterogeneous Graph Neural Network Knowledge Graph Completion Model Based on Improved Attention Mechanism
    Shi, Junkang
    Li, Ming
    Zhao, Jing
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT IV, 2023, 14257 : 423 - 434
  • [50] Translating Embeddings for Knowledge Graph Completion with Relation Attention Mechanism
    Qian, Wei
    Fu, Cong
    Zhu, Yu
    Cai, Deng
    He, Xiaofei
    [J]. PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 4286 - 4292