Chinese Named Entity Recognition for Hazard And Operability Analysis Text Based on Albert

被引:0
|
作者
Wang, Zhenhua [1 ]
Zhang, Beike [1 ]
Gao, Dong [1 ]
机构
[1] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Chinese named entity recognition; HAZOP; Albert; BiLSTM-CRF;
D O I
10.1109/CAC51589.2020.9326618
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
HAZOP plays an important role in chemical safety, in the project of Chinese named entity recognition of HAZOP, In response to the problem of low accuracy of entity recognition and low efficiency of model training in the past methods, this paper proposes Albert-BiLSTM-CRF model. In the process of text pre-training, we use Albert model instead of word2vec, Bert, CNN and other traditional structures to train word vectors, and get word embedding at the character level related to context, which improves the ability of text feature extraction. The experiments show that: on the basis of the accuracy of entity recognition, the Fl-score of this model on HAZOP test corpus reaches 91.09%, which is 2.27% and 2.36% higher than that of BiLSTM-CRF model and CNN-BiLSTM-CRF model, and is equivalent to Bert-BiLSTM-CRF model, with Fl-score exceeding 90% on the basis of the speed of model training, the average training time of each epoch is only 162 seconds, which is faster than the training speed of other models under the same configuration environment. The results reflect that the Albert-BiLSTM-CRF model can better solve the shortcomings of the previous models, not only to ensure high accuracy of entity recognition, but also to improve the training speed of the model. This model is more suitable for HAZOP in named entity recognition project.
引用
收藏
页码:5641 / 5645
页数:5
相关论文
共 50 条
  • [1] Chinese Named Entity Recognition for Hazard And Operability Analysis Text
    Li, FangGuo
    Zhang, BeiKe
    Gao, Dong
    [J]. PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 374 - 378
  • [2] Named Entity Recognition of Chinese Text Based on Attention Mechanism
    Shen, Tong-Ping
    Dumlao, Menchita
    Meng, Qing-Quan
    Zhan, Zhong-Hua
    [J]. Journal of Network Intelligence, 2023, 8 (02): : 505 - 518
  • [3] Product named entity recognition in Chinese text
    Jun Zhao
    Feifan Liu
    [J]. Language Resources and Evaluation, 2008, 42 : 197 - 217
  • [4] Product named entity recognition in Chinese text
    Zhao, Jun
    Liu, Feifan
    [J]. LANGUAGE RESOURCES AND EVALUATION, 2008, 42 (02) : 197 - 217
  • [5] Chinese Named Entity Recognition in Football Based on ALBERT-BiLSTM Model
    An, Qi
    Pan, Bingyu
    Liu, Zhitong
    Du, Shutong
    Cui, Yixiong
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (19):
  • [6] Chinese Clinical Named Entity Recognition with ALBERT and MHA Mechanism
    Li, Dongmei
    Long, Jiao
    Qu, Jintao
    Zhang, Xiaoping
    [J]. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE, 2022, 2022
  • [7] Named Entity Recognition of Chinese Agricultural Text Based on Attention Mechanism
    Zhao, Pengfei
    Zhao, Chunjiang
    Wu, Huarui
    Wang, Wei
    [J]. Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2021, 52 (01): : 185 - 192
  • [8] A comprehensive study of named entity recognition in Chinese clinical text
    Lei, Jianbo
    Tang, Buzhou
    Lu, Xueqin
    Gao, Kaihua
    Jiang, Min
    Xu, Hua
    [J]. JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2014, 21 (05) : 808 - 814
  • [9] Low Resource Chinese Geological Text Named Entity Recognition Based on Prompt Learning
    He, Hang
    Ma, Chao
    Ye, Shan
    Tang, Wenqiang
    Zhou, Yuxuan
    Yu, Zhen
    Yi, Jiaxin
    Hou, Li
    Hou, Mingcai
    [J]. JOURNAL OF EARTH SCIENCE, 2024, 35 (03) : 1035 - 1043
  • [10] Named Entity Recognition in Chinese Rice Breeding Questions Based on Text Data Augmentation
    Niu, Peiyu
    Hou, Chen
    [J]. Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2024, 55 (08): : 333 - 343