Named entity recognition in the food field based on BERT and Adversarial training

被引:1
|
作者
Dong, Zhe [1 ]
Shao, RuoQi [1 ]
Chen, YuLiang [1 ]
Chen, JiaWei [1 ]
机构
[1] North China Univ Technol, Sch Elect & Control Engn, Beijing 100144, Peoples R China
基金
中国国家自然科学基金;
关键词
NER; BERT; BiLSTM and Adversarial Training;
D O I
10.1109/CCDC52312.2021.9601522
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at extracting effective entity information from unstructured corpus in the food field, a named entity recognition (NER) method based on BERT (Bidirectional Encoder Representations from Transformers) and Adversarial training is proposed. The task of NER requires both the identification of entity boundaries and entity types. In order to improve the precision of identifying entity boundaries, we use the BERT word embedding method to enhance the feature extraction ability of input information. To optimize the NER task, adversarial training is introduced, which not only use the shared information obtained from task training of Chinese word segmentation (CWS) and NER, but also prevent the private information of CWS task from generating noise. The experiment is based on the corpus of two categories which are Chinese food safety cases and People's Daily news, respectively. Among them, the Chinese food safety cases data set is used to train the NER task, and People's Daily news data set is used to train the CWS task. We use adversarial training to improve the precision of the NER task for entity recognition (including person, location, organization, food and toxic substance). The Precision rate, Recall rate and F1 score are 95.46%, 89.50% and 92.38% respectively. Experimental results show that this method has a high precision rate for Chinese NER task where the boundary of a specific domain is indistinct.
引用
收藏
页码:2219 / 2226
页数:8
相关论文
共 50 条
  • [41] Unsupervised cross-domain named entity recognition using entity-aware adversarial training
    Peng, Qi
    Zheng, Changmeng
    Cai, Yi
    Wang, Tao
    Xie, Haoran
    Li, Qing
    NEURAL NETWORKS, 2021, 138 (138) : 68 - 77
  • [42] Multifeature Named Entity Recognition in Information Security Based on Adversarial Learning
    Zhang, Han
    Guo, Yuanbo
    Li, Tao
    SECURITY AND COMMUNICATION NETWORKS, 2019,
  • [43] Named Entity Recognition on Morphologically Rich Language: Exploring the Performance of BERT with varying Training Levels
    Kilic, Yuksel Pelin
    Dinc, Duygu
    Karagoz, Pinar
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 4613 - 4619
  • [44] Using BERT and Augmentation in Named Entity Recognition for Cybersecurity Domain
    Tikhomirov, Mikhail
    Loukachevitch, N.
    Sirotina, Anastasiia
    Dobrov, Boris
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS (NLDB 2020), 2020, 12089 : 16 - 24
  • [45] Named Entity Recognition for Chinese Social Media with Domain Adversarial Training and Language Modeling
    Xu, Yong
    Lu, Qi
    Zhu, Muhua
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: DEEP LEARNING, PT II, 2019, 11728 : 687 - 699
  • [46] Arabic Named Entity Recognition: A BERT-BGRU Approach
    Alsaaran, Norah
    Alrabiah, Maha
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (01): : 471 - 485
  • [47] Named Entity Recognition for Drone Forensic Using BERT and DistilBERT
    Silalahi, Swardiantara
    Ahmad, Tohari
    Studiawan, Hudan
    2022 INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ITS APPLICATIONS (ICODSA), 2022, : 53 - 58
  • [48] Named Entity Recognition of Enterprise Annual Report Integrated with BERT
    Zhang J.
    He G.
    Dai Z.
    Liu Y.
    Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2021, 55 (02): : 117 - 123
  • [49] Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition
    Ghaddar, Abbas
    Langlais, Philippe
    Rashid, Ahmad
    Rezagholizadeh, Mehdi
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2021, 9 : 586 - 604
  • [50] Named entity recognition of agricultural based entity-level masking BERT and BiLSTM-CRF
    Wei Z.
    Song L.
    Hu X.
    Chen N.
    Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2022, 38 (15): : 195 - 203