SPBERE: Boosting span-based pipeline biomedical entity and relation extraction via entity information

被引:1
|
作者
Yang, Chenglin [1 ,2 ]
Deng, Jiamei [1 ]
Chen, Xianlai [1 ,3 ]
An, Ying [1 ]
机构
[1] Cent South Univ, Big Data Inst, Changsha 410083, Peoples R China
[2] Cent South Univ, Sch Life Sci, Changsha 410083, Peoples R China
[3] Cent South Univ, Key Lab Med Informat Res, Changsha 410083, Peoples R China
关键词
Biomedical triplet extraction; Pipeline; Pre-trained language model; Span-based approach; Entity information; JOINT ENTITY;
D O I
10.1016/j.jbi.2023.104456
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Triplet extraction is one of the fundamental tasks in biomedical text mining. Compared with traditional pipeline approaches, joint methods can alleviate the error propagation problem from entity recognition to relation classification. However, existing methods face challenges in detecting overlapping entities and overlapping relations, which are ubiquitous in biomedical texts. In this work, we propose a novel pipeline method of end-to -end biomedical triplet extraction. In particular, a span-based detection strategy is used to detect the overlapping triplets by enumerating possible candidate spans and entity pairs. The strategy is further used to capture different contextualized representations via an entity model and a relation model, respectively. Furthermore, to enhance interrelation between spans, entity information from the output of the entity model is used to construct the input for the relation model without utilizing any external knowledge. Our approach is evaluated on the drug-drug interaction (DDI) and chemical-protein interaction (CHEMPROT) datasets, exhibiting improvement of the absolute F1-score in relation extraction by 3.5%-3.7% compared prior work. The experimental results highlight the importance of overlapping triplet detection using the span-based approach, acquisition of various contextualized representations via different in-domain pre-trained language models, and early fusion of entity information in the relation model.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A Span-based Model for Joint Entity and Relation Extraction with Relational Graphs
    Wang, Xingang
    Wang, Dong
    Ji, Fengpo
    [J]. 2020 IEEE INTL SYMP ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, INTL CONF ON BIG DATA & CLOUD COMPUTING, INTL SYMP SOCIAL COMPUTING & NETWORKING, INTL CONF ON SUSTAINABLE COMPUTING & COMMUNICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2020), 2020, : 513 - 520
  • [2] Span-Based Joint Entity and Relation Extraction with Transformer Pre-Training
    Eberts, Markus
    Ulges, Adrian
    [J]. ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 2006 - 2013
  • [3] Span-based joint entity and relation extraction augmented with sequence tagging mechanism
    Bin JI
    Shasha LI
    Hao XU
    Jie YU
    Jun MA
    Huijun LIU
    Jing YANG
    [J]. Science China(Information Sciences), 2024, 67 (05) : 84 - 98
  • [4] Span-based joint entity and relation extraction augmented with sequence tagging mechanism
    Ji, Bin
    Li, Shasha
    Xu, Hao
    Yu, Jie
    Ma, Jun
    Liu, Huijun
    Yang, Jing
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (05)
  • [5] A Knowledge-Enriched and Span-Based Network for Joint Entity and Relation Extraction
    Ding, Kun
    Liu, Shanshan
    Zhang, Yuhao
    Zhang, Hui
    Zhang, Xiaoxiong
    Wu, Tongtong
    Zhou, Xiaolei
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (01): : 377 - 389
  • [7] Span-based single-stage joint entity-relation extraction model
    Han, Dongchen
    Zheng, Zhaoqian
    Zhao, Hui
    Feng, Shanshan
    Pang, Haiting
    [J]. PLOS ONE, 2023, 18 (02):
  • [8] Span-Based Fine-Grained Entity-Relation Extraction via Sub-Prompts Combination
    Yu, Ning
    Liu, Jianyi
    Shi, Yu
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [9] Span-based Named Entity Recognition by Generating and Compressing Information
    Nguyen, Nhung T. H.
    Miwa, Makoto
    Ananiadou, Sophia
    [J]. 17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1984 - 1996
  • [10] Constraint information extraction for 3D geological modelling using a span-based joint entity and relation extraction model
    Zhuang, Can
    Liu, Chunhua
    Zhu, Henghua
    Ma, Yuhong
    Shi, Guoping
    Liu, Zhizheng
    Liu, Bohan
    [J]. EARTH SCIENCE INFORMATICS, 2024, 17 (02) : 985 - 998