Relation extraction for manufacturing knowledge graphs based on feature fusion of attention mechanism and graph convolution network

被引:16
|
作者
Du, Kaze [1 ]
Yang, Bo [1 ,2 ,4 ]
Wang, Shilong [1 ]
Chang, Yongsheng [3 ]
Li, Song [3 ]
Yi, Gang [3 ]
机构
[1] Chongqing Univ, State Key Lab Mech Transmiss, Chongqing 400044, Peoples R China
[2] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Peoples R China
[3] Chongqing Changan Automobile Co Ltd, Chongqing 401147, Peoples R China
[4] Chongqing Univ, State Key Lab Mech Transmiss, 174Shazheng St, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graph; Relation extraction; Graph convolution network (GCN); Attention mechanism; Manufacturing;
D O I
10.1016/j.knosys.2022.109703
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Relation extraction is a crucial step in the constructions of knowledge graphs (KGs). However, relation extraction is performed manually in the manufacturing field due to the sentence characteristics, which include weak correlation and high entity density. This approach has the disadvantages of low efficiency and high dependence on experts. At present, very few studies have been performed on relation extraction in the manufacturing field, so establishing a relation extraction model with high efficiency is an urgent need. Therefore, in this paper, a relation extraction model is proposed for manufacturing knowledge (MKREM), in which word embedding is obtained by the Bi-LSTM layer to improve robustness, and a Simplified Graph Convolution Network (SGC) layer is applied to quickly mine the entity information. Then, dependency and semantic features are extracted by the multi-head stacked GCN and relation attention mechanism, respectively. Finally, the dependency and semantic features are fused to generate the comprehensive features for relation extraction so that better performance on texts with weak correlation and high entity density can be obtained. The performance of MKREM is tested by experiments on the equipment maintenance dataset and the quality dataset from an automobile enterprise, and its effectiveness is verified in the automobile manufacture filed. The results show that the F1 scores obtained using MKREM are 2% higher than those of the commonly used models on both datasets, and the F1 scores when using Contextualized-MKREM are improved by 3%, so MKREM is very suitable for the automatic relation extraction during establishing manufacturing KGs. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Spatiotemporal convolution sleep network based on graph attention mechanism with automatic feature extraction
    Hu, Yidong
    Shi, Wenbin
    Yeh, Chien-Hung
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 244
  • [2] Geometric feature extraction in manufacturing based on a knowledge graph
    Kohler, Tobias
    Song, Buchao
    Bergmann, Jean Pierre
    Peters, Diana
    [J]. HELIYON, 2023, 9 (09)
  • [3] A Cross-Attention Fusion Based Graph Convolution Auto-Encoder for Open Relation Extraction
    Xie, Binhong
    Li, Yu
    Zhao, Hongyan
    Pan, Lihu
    Wang, Enhui
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 476 - 485
  • [4] Global Graph Attention Embedding Network for Relation Prediction in Knowledge Graphs
    Li, Qian
    Wang, Daling
    Feng, Shi
    Niu, Cheng
    Zhang, Yifei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6712 - 6725
  • [5] Research on Graph Feature Data Aggregation Algorithm Based on Graph Convolution and Attention Mechanism
    Lei, Wenhan
    Liu, Xinyuan
    Ye, Lin
    Hu, Tao
    Gong, Lei
    Luo, Junxia
    [J]. 2024 4TH INTERNATIONAL CONFERENCE ON ELECTRONIC MATERIALS AND INFORMATION ENGINEERING, EMIE 2024, 2024, : 146 - 150
  • [6] Temporal knowledge graph reasoning based on relation graphs and time-guided attention mechanism
    Hu, Jie
    Zhu, Yinglian
    Teng, Fei
    Li, Tianrui
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 301
  • [7] Knowledge graph attention mechanism for distant supervision neural relation extraction
    Liu, Meizhen
    Zhou, Fengyu
    He, Jiakai
    Yan, Xiaohui
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 256
  • [8] Event Temporal Relation Extraction with Attention Mechanism and Graph Neural Network
    Xu, Xiaoliang
    Gao, Tong
    Wang, Yuxiang
    Xuan, Xinle
    [J]. TSINGHUA SCIENCE AND TECHNOLOGY, 2022, 27 (01) : 79 - 90
  • [9] Event Temporal Relation Extraction with Attention Mechanism and Graph Neural Network
    Xiaoliang Xu
    Tong Gao
    Yuxiang Wang
    Xinle Xuan
    [J]. Tsinghua Science and Technology, 2022, 27 (01) : 79 - 90
  • [10] Text Classification Based on Graph Convolution Neural Network and Attention Mechanism
    Zhai, Sheping
    Zhang, Wenqing
    Cheng, Dabao
    Bai, Xiaoxia
    [J]. ACM International Conference Proceeding Series, 2022, : 137 - 142