Tell me your position: Distantly supervised biomedical entity relation extraction using entity position marker

被引:2
|
作者
Zhu, Jiran [1 ]
Dong, Jikun [1 ]
Du, Hongyun [1 ]
Geng, Yanfang [1 ]
Fan, Shengyu [1 ]
Yu, Hui [1 ]
Shao, Zengzhen [2 ]
Wang, Xia [3 ]
Yang, Yaping [3 ]
Xu, Weizhi [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan, Peoples R China
[2] Shandong Womens Univ, Sch Data & Comp Sci, Jinan, Peoples R China
[3] AiLife Diagnost, Pearland, TX USA
基金
中国国家自然科学基金;
关键词
Deep neural network; Natural language processing; Distant supervision; Biomedical entity relation extraction; Position marker;
D O I
10.1016/j.neunet.2023.09.043
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A significant amount of textual data has been produced in the biomedical area recently as a result of the advancement of biomedical technologies. Large-scale biomedical data can be automatically obtained with the help of distant supervision. However, the noisy data brought by distant supervision methods makes relation extraction tasks more difficult. Previous work has focused more on how to restore mislabeled relationships, but little attention has been paid to the importance of labeled entity locations for relationship extraction tasks. In this paper, we present a "four-stage" model based on BioBERT and Multi-Instance Learning by using entity position markers. Firstly, the sentence is marked with position. Secondly, BioBERT, a biomedical pre-trained language model, is used in the final sentence feature vector representation not only with the global position marker but also with the start and end marker of both the head and tail entity. Thirdly, the aggregation of sentence vectors in the bag is used as the vector feature of the bag by three aggregation methods, and the performance of different sentence feature vectors combined with different bag encoding methods is discussed. At last, relation classification is performed at the bag level. According to experimental results, the presented model significantly outperforms all baseline models and contributes to noise reduction. In addition, different bag encoding methods need to match corresponding sentence encoding representation to achieve the best performance.
引用
收藏
页码:531 / 538
页数:8
相关论文
共 50 条
  • [1] Distantly Supervised Entity Relation Extraction with Adapted Manual Annotations
    Sun, Changzhi
    Wu, Yuanbin
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 7039 - 7046
  • [2] Integrating External Entity Knowledge for Distantly Supervised Relation Extraction
    Gao J.
    Wan H.
    Lin Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2022, 59 (12): : 2794 - 2802
  • [3] Distantly Supervised Biomedical Named Entity Recognition with Dictionary Expansion
    Wang, Xuan
    Zhang, Yu
    Li, Qi
    Ren, Xiang
    Shang, Jingbo
    Han, Jiawei
    2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 496 - 503
  • [4] Entity Type Enhanced Neural Model for Distantly Supervised Relation Extraction (Student Abstract)
    Bai, Long
    Jin, Xiaolong
    Zhuang, Chuanzhi
    Cheng, Xueqi
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13751 - 13752
  • [5] A gated piecewise CNN with entity-aware enhancement for distantly supervised relation extraction
    Wen, Haixu
    Zhu, Xinhua
    Zhang, Lanfang
    Li, Fei
    INFORMATION PROCESSING & MANAGEMENT, 2020, 57 (06)
  • [6] Reinforcement learning based distantly supervised biomedical named entity recognition
    Bali, Manish
    Anandaraj, S. P.
    INTELLIGENT DECISION TECHNOLOGIES-NETHERLANDS, 2023, 17 (02): : 317 - 330
  • [7] Joint entity and relation extraction with position-aware attention and relation embedding
    Chen, Tiantian
    Zhou, Lianke
    Wang, Nianbin
    Chen, Xirui
    APPLIED SOFT COMPUTING, 2022, 119
  • [8] A Entity Relation Extraction Model with Enhanced Position Attention in Food Domain
    Wang, Qingbang
    Zhang, Qingchuan
    Zuo, Min
    He, Siyu
    Zhang, Baoyu
    NEURAL PROCESSING LETTERS, 2022, 54 (02) : 1449 - 1464
  • [9] A Entity Relation Extraction Model with Enhanced Position Attention in Food Domain
    Qingbang Wang
    Qingchuan Zhang
    Min Zuo
    Siyu He
    Baoyu Zhang
    Neural Processing Letters, 2022, 54 : 1449 - 1464
  • [10] WRTRe: Weighted relative position transformer for joint entity and relation extraction
    Zheng, Wei
    Wang, Zhen
    Yao, Quanming
    Li, Xuelong
    NEUROCOMPUTING, 2021, 459 : 315 - 326