A Model for Chinese Named Entity Recognition Based on Global Pointer and Adversarial Learning

被引:5
|
作者
Zhang Yangsen [1 ]
Li Jianlong [1 ]
Xin Yonghui [2 ]
Zhao Xiquan [1 ]
Liu Yang [2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Inst Intelligent Informat Proc, Beijing 100192, Peoples R China
[2] Coordinat Ctr China, Comp Network Emergency Response Tech Team, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Chinese named entity recognition (NER); Global pointer; RoBERTa-WWM model; Fast gradient method (FGM); BiGRU;
D O I
10.23919/cje.2022.00.279
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To solve the problem that the Chinese named entity recognition (NER) models have poor anti-interference ability and inaccurate entity boundary recognition, this paper proposes the RGP-with-FGM model which is based on global pointer and adversarial learning. Firstly, the RoBERTa-WWM model is used to optimize the semantic representation of the text, and fast gradient method is used to add perturbation to the word embedding layer to enhance the robustness of the model. Then, BiGRU is used to focus on the timing information of Chinese characters to enhance the semantic connection. Finally, the global pointer is constructed in the decoding layer to obtain more accurate entity boundary recognition results. In order to verify the effectiveness of the model proposed in this paper, we construct Uyghur names dataset (UHND) to train the Chinese NER model, and perform extensive experiments with public Chinese NER data sets. Experimental results show that for UHND, the F1 value is 95.12%, which is 3.09% higher than that of the RoBERTa-WWM-BiGRU-CRF model. For the Resume data set, the Precision and F1 value are 96.28% and 96.10% respectively.
引用
收藏
页码:854 / 867
页数:14
相关论文
共 50 条
  • [1] A Model for Chinese Named Entity Recognition Based on Global Pointer and Adversarial Learning
    ZHANG Yangsen
    LI Jianlong
    XIN Yonghui
    ZHAO Xiquan
    LIU Yang
    [J]. Chinese Journal of Electronics, 2023, 32 (04) : 854 - 867
  • [2] Named entity recognition for Chinese based on global pointer and adversarial training
    Li, Hongjun
    Cheng, Mingzhe
    Yang, Zelin
    Yang, Liqun
    Chua, Yansong
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01)
  • [3] Named entity recognition for Chinese based on global pointer and adversarial training
    Hongjun Li
    Mingzhe Cheng
    Zelin Yang
    Liqun Yang
    Yansong Chua
    [J]. Scientific Reports, 13
  • [4] RoBGP: A Chinese Nested Biomedical Named Entity Recognition ModelBased on RoBERTa and Global Pointer
    Cui, Xiaohui
    Song, Chao
    Li, Dongmei
    Qu, Xiaolong
    Long, Jiao
    Yang, Yu
    Zhang, Hanchao
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (03): : 3603 - 3618
  • [5] Named Entity Recognition Based on Reinforcement Learning and Adversarial Training
    Peng, Shi
    Zhang, Yong
    Yu, Yuanfang
    Zuo, Haoyang
    Zhang, Kai
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2021, 12815 : 191 - 202
  • [6] Lexicon enhanced Chinese named entity recognition with pointer network
    Guo, Qian
    Guo, Yi
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (17): : 14535 - 14555
  • [7] Lexicon enhanced Chinese named entity recognition with pointer network
    Qian Guo
    Yi Guo
    [J]. Neural Computing and Applications, 2022, 34 : 14535 - 14555
  • [8] Adversarial Multi-task Learning for Efficient Chinese Named Entity Recognition
    Yan, Yibo
    Zhu, Peng
    Cheng, Dawei
    Yang, Fangzhou
    Luo, Yifeng
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (07)
  • [9] Chinese Named Entity Recognition Model Based on Multi-Task Learning
    Fang, Qin
    Li, Yane
    Feng, Hailin
    Ruan, Yaoping
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (08):
  • [10] Chinese named entity recognition model based on BERT
    Liu, Hongshuai
    Jun, Ge
    Zheng, Yuanyuan
    [J]. 2020 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE COMMUNICATION AND NETWORK SECURITY (CSCNS2020), 2021, 336