Named entity recognition of local adverse drug reactions in Xinjiang based on transfer learning

被引:3
|
作者
Kang, Keming [1 ]
Tian, Shengwei [1 ]
Yu, Long [2 ]
机构
[1] Xinjiang Univ, Sch Software, Key Lab Software Engn Technol, Urumqi 830008, Peoples R China
[2] Xinjiang Univ, Network Ctr, Urumqi, Peoples R China
基金
中国国家自然科学基金;
关键词
Transfer learning; self-Attention mechanism; IndRNN; named entity recognition of adverse drug reactions; deep learning;
D O I
10.3233/JIFS-201017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For deep learning's insufficient learning ability of a small amount of data in the Chinese named entity recognition based on deep learning, this paper proposes a named entity recognition of local adverse drug reactions based on Adversarial Transfer Learning, and constructs a neural network model ASAIBC consisting of Adversarial Transfer Learning, Self-Attention, independently recurrent neural network (IndRNN), Bi-directional long short-term memory (BiLSTM) and conditional random field (CRF). However, of the task of Chinese named entity recognition (NER), there are only few open labeled data sets. Therefore, this article introduces Adversarial Transfer Learning network to fully utilize the boundary of Chinese word segmentation tasks (CWS) and NER tasks for information sharing. Plus, the specific information in the CWS is also filtered. Combing with Self-Attention mechanism and IndRNN, this feature's expression ability is enhanced, thus allowing the model to concern the important information of different entities from different levels. Along with better capture of the dependence relations of long sentences, the recognition ability of the model is further strengthened. As all the results gained from WeiBoNER and MSRA data sets by ASAIBC model are better than traditional algorithms, this paper conducts an experiment on the data set of Xinjiang local named entity recognition of adverse drug reactions (XJADRNER) based on manual labeling, with the accuracy, precision, recall and F-Score value being 98.97%, 91.01%, 90.21% and 90.57% respectively. These experimental results have shown that ASAIBC model can significantly improve the NER performance of local adverse drug reactions in Xinjiang.
引用
收藏
页码:8899 / 8914
页数:16
相关论文
共 50 条
  • [1] Research on named entity recognition of adverse drug reactions based on NLP and deep learning
    Wei, Jianxiang
    Hu, Tianling
    Dai, Jimin
    Wang, Ziren
    Han, Pu
    Huang, Weidong
    [J]. FRONTIERS IN PHARMACOLOGY, 2023, 14
  • [2] Mining Adverse Drug Reactions in Social Media with Named Entity Recognition and Semantic Methods
    Chen, Xiaoyi
    Deldossi, Myrtille
    Aboukhamis, Rim
    Faviez, Carole
    Dahamna, Badisse
    Karapetiantz, Pierre
    Guenegou-Arnoux, Armelle
    Girardeau, Yannick
    Guillemin-Lanne, Sylvie
    Lillo-Le-Louet, Agnes
    Texier, Nathalie
    Burgun, Anita
    Katsahian, Sandrine
    [J]. MEDINFO 2017: PRECISION HEALTHCARE THROUGH INFORMATICS, 2017, 245 : 322 - 326
  • [3] Transfer Learning for Indonesian Named Entity Recognition
    Kosasih, Joshua Aditya
    Khodra, Masayu Leylia
    [J]. 2018 INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT INFORMATICS (SAIN), 2018, : 173 - 178
  • [4] A Research Toward Chinese Named Entity Recognition Based on Transfer Learning
    Hui Kang
    Jingwu Xiao
    Yunpeng Zhang
    Lei Zhang
    Xu Zhao
    Tie Feng
    [J]. International Journal of Computational Intelligence Systems, 16
  • [5] A Research Toward Chinese Named Entity Recognition Based on Transfer Learning
    Kang, Hui
    Xiao, Jingwu
    Zhang, Yunpeng
    Zhang, Lei
    Zhao, Xu
    Feng, Tie
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [6] Named entity recognition based on deep learning
    Ji, Zhenyan
    Kong, Deyan
    Liu, Wei
    Dong, Wei
    Sang, Yanjuan
    [J]. Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2022, 28 (06): : 1603 - 1615
  • [7] A system for named entity recognition based on local grammars
    Krstev, Cvetana
    Obradovic, Ivan
    Utvic, Milos
    Vitas, Dusko
    [J]. JOURNAL OF LOGIC AND COMPUTATION, 2014, 24 (02) : 473 - 489
  • [8] Transfer learning for biomedical named entity recognition with neural networks
    Giorgi, John M.
    Bader, Gary D.
    [J]. BIOINFORMATICS, 2018, 34 (23) : 4087 - 4094
  • [9] Transfer Learning for Named-Entity Recognition with Neural Networks
    Lee, Ji Young
    Dernoncourt, Franck
    Szolovits, Peter
    [J]. PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018), 2018, : 4470 - 4473
  • [10] Transfer learning for Turkish named entity recognition on noisy text
    Kagan Akkaya, Emre
    Can, Burcu
    [J]. NATURAL LANGUAGE ENGINEERING, 2021, 27 (01) : 35 - 64