Chinese Named Entity Recognition for Hazard And Operability Analysis Text Based on Albert

被引:0
|
作者
Wang, Zhenhua [1 ]
Zhang, Beike [1 ]
Gao, Dong [1 ]
机构
[1] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Chinese named entity recognition; HAZOP; Albert; BiLSTM-CRF;
D O I
10.1109/CAC51589.2020.9326618
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
HAZOP plays an important role in chemical safety, in the project of Chinese named entity recognition of HAZOP, In response to the problem of low accuracy of entity recognition and low efficiency of model training in the past methods, this paper proposes Albert-BiLSTM-CRF model. In the process of text pre-training, we use Albert model instead of word2vec, Bert, CNN and other traditional structures to train word vectors, and get word embedding at the character level related to context, which improves the ability of text feature extraction. The experiments show that: on the basis of the accuracy of entity recognition, the Fl-score of this model on HAZOP test corpus reaches 91.09%, which is 2.27% and 2.36% higher than that of BiLSTM-CRF model and CNN-BiLSTM-CRF model, and is equivalent to Bert-BiLSTM-CRF model, with Fl-score exceeding 90% on the basis of the speed of model training, the average training time of each epoch is only 162 seconds, which is faster than the training speed of other models under the same configuration environment. The results reflect that the Albert-BiLSTM-CRF model can better solve the shortcomings of the previous models, not only to ensure high accuracy of entity recognition, but also to improve the training speed of the model. This model is more suitable for HAZOP in named entity recognition project.
引用
收藏
页码:5641 / 5645
页数:5
相关论文
共 50 条
  • [31] Chinese mineral named entity recognition based on BERT model
    Yu, Yuqing
    Wang, Yuzhu
    Mua, Jingqin
    Li, Wei
    Jiao, Shoutao
    Wang, Zhenhua
    Lv, Pengfei
    Zhu, Yueqin
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 206
  • [32] A Hybrid Model Based on CRFs for Chinese Named Entity Recognition
    Li, Lishuang
    Ding, Zhuoye
    Huang, Degen
    Zhou, Huiwei
    [J]. ALPIT 2008: SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED LANGUAGE PROCESSING AND WEB INFORMATION TECHNOLOGY, PROCEEDINGS, 2008, : 127 - 132
  • [33] A Radical-Based Method for Chinese Named Entity Recognition
    Wu, Yuefei
    Wei, Xiao
    Qin, Yongbin
    Chen, Yanping
    [J]. PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON BIG DATA TECHNOLOGIES (ICBDT 2019), 2019, : 125 - 130
  • [34] Chinese Named Entity Recognition Based on Hierarchical Hybrid Model
    Liao, Zhihua
    Zhang, Zili
    Liu, Yang
    [J]. PRICAI 2010: TRENDS IN ARTIFICIAL INTELLIGENCE, 2010, 6230 : 620 - +
  • [35] Chinese Named Entity Recognition in the Geoscience Domain Based on BERT
    Lv, Xia
    Xie, Zhong
    Xu, Dexin
    Jin, Xiangguo
    Ma, Kai
    Tao, Liufeng
    Qiu, Qinjun
    Pan, Yongsheng
    [J]. EARTH AND SPACE SCIENCE, 2022, 9 (03)
  • [36] Fine-Grained Mechanical Chinese Named Entity Recognition Based on ALBERT-AttBiLSTM-CRF and Transfer Learning
    Yao, Liguo
    Huang, Haisong
    Wang, Kuan-Wei
    Chen, Shih-Huan
    Xiong, Qiaoqiao
    [J]. SYMMETRY-BASEL, 2020, 12 (12): : 1 - 21
  • [37] AN EFFICIENT FEATURE SELECTION METHOD USING NAMED ENTITY RECOGNITION FOR CHINESE TEXT CATEGORIZATION
    Liu, Bin
    Li, Chunping
    [J]. PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 3527 - +
  • [38] Deep learning-based methods for natural hazard named entity recognition
    Junlin Sun
    Yanrong Liu
    Jing Cui
    Handong He
    [J]. Scientific Reports, 12
  • [39] Deep learning-based methods for natural hazard named entity recognition
    Sun, Junlin
    Liu, Yanrong
    Cui, Jing
    He, Handong
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [40] An integrative approach to Chinese Named Entity recognition
    Huang, Degen
    Sun, Xiao
    [J]. ALPIT 2007: PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON ADVANCED LANGUAGE PROCESSING AND WEB INFORMATION TECHNOLOGY, 2007, : 171 - +