A comprehensive exploration of semantic relation extraction via pre-trained CNNs

被引:32
|
作者
Li, Qing [1 ]
Li, Lili [2 ]
Wang, Weinan [3 ]
Li, Qi [4 ]
Zhong, Jiang [1 ,5 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing, Peoples R China
[2] Chongqing Univ, Sch Civil Engn, Chongqing, Peoples R China
[3] Peking Univ, Sch Math Sci, Beijing, Peoples R China
[4] Shaoxing Univ, Dept Comp Sci & Engn, Shaoxing, Peoples R China
[5] Chongqing Univ, Key Lab Dependable Serv Comp Cyber Phys Soc, Chongqing, Peoples R China
关键词
Relation extraction; Semantic relation; Natural language processing; Convolutional neural networks;
D O I
10.1016/j.knosys.2020.105488
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semantic relation extraction between entity pairs is a crucial task in information extraction from text. In this paper, we propose a new pre-trained network architecture for this task, and it is called the XM-CNN. The XM-CNN utilizes word embedding and position embedding information. It is designed to reinforce the contextual output from the MT-DNNKD pre-trained model. Our model effectively utilized an entity-aware attention mechanisms to detected the features and also adopts and applies more relation-specific pooling attention mechanisms applied to it. The experimental results show that the XM-CNN achieves state-of-the-art results on the SemEval-2010 task 8, and a thorough evaluation of the method is conducted. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Relation extraction method based on pre-trained model and bidirectional semantic union
    He, Xinyu
    Yan, Ge
    Han, Xue
    Kan, Manfei
    Ren, Yonggong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, : 1291 - 1302
  • [2] Glomerulosclerosis detection with pre-trained CNNs ensemble
    Santos, Justino
    Silva, Romuere
    Oliveira, Luciano
    Santos, Washington
    Aldeman, Nayze
    Duarte, Angelo
    Veras, Rodrigo
    COMPUTATIONAL STATISTICS, 2024, 39 (02) : 561 - 581
  • [3] ImageNet Pre-trained CNNs for JPEG Steganalysis
    Yousfi, Yassine
    Butora, Jan
    Khvedchenya, Eugene
    Fridrich, Jessica
    2020 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2020,
  • [4] Glomerulosclerosis detection with pre-trained CNNs ensemble
    Justino Santos
    Romuere Silva
    Luciano Oliveira
    Washington Santos
    Nayze Aldeman
    Angelo Duarte
    Rodrigo Veras
    Computational Statistics, 2024, 39 : 561 - 581
  • [5] Transgender Face Recognition with Off-the-shelf Pre-trained CNNs: A Comprehensive Study
    Raghavendra, R.
    Venkatesh, Sushma
    Raja, Kiran B.
    Busch, Christoph
    2018 6TH INTERNATIONAL WORKSHOP ON BIOMETRICS AND FORENSICS (IWBF), 2018,
  • [6] Unprecedented Usage of Pre-trained CNNs on Beauty Product
    Lim, Jian Han
    Japar, Nurul
    Ng, Chun Chet
    Chan, Chee Seng
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 2068 - 2072
  • [7] ABCD rule and pre-trained CNNs for melanoma diagnosis
    Nayara Moura
    Rodrigo Veras
    Kelson Aires
    Vinícius Machado
    Romuere Silva
    Flávio Araújo
    Maíla Claro
    Multimedia Tools and Applications, 2019, 78 : 6869 - 6888
  • [8] ABCD rule and pre-trained CNNs for melanoma diagnosis
    Moura, Nayara
    Veras, Rodrigo
    Aires, Kelson
    Machado, Vinicius
    Silva, Romuere
    Araujo, Flavio
    Claro, Maila
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (06) : 6869 - 6888
  • [9] Applicability of pre-trained CNNs in temperate deforestation detection
    Cotolan, Lucian
    Moldovan, Darie
    EUROPEAN JOURNAL OF REMOTE SENSING, 2024, 57 (01)
  • [10] Robustly Pre-Trained Neural Model for Direct Temporal Relation Extraction
    Guan, Hong
    Li, Jianfu
    Xu, Hua
    Devarakonda, Murthy
    2021 IEEE 9TH INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI 2021), 2021, : 501 - 502