Recognition of the Agricultural Named Entities With Multifeature Fusion Based on ALBERT

被引:5
|
作者
Zhao, Pengfei [1 ]
Wang, Wei [1 ]
Liu, Hai [1 ]
Han, Mo [1 ]
机构
[1] Beijing Acad Agr & Forestry Sci, Natl Engn Res Ctr Informat Technol Agr, Beijing 100097, Peoples R China
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Feature extraction; Semantics; Task analysis; Hidden Markov models; Agriculture; Diseases; Convolutional neural networks; named entity recognition; self-attention; long short-term memory; conditional random field; NEURAL-NETWORK; ATTENTION;
D O I
10.1109/ACCESS.2022.3206017
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
High quality agricultural named entity recognition (NER) model can provide effective support for agricultural information extraction, semantic retrieval and other tasks. However, the existing models ignore the potential characteristics of Chinese characters, resulting in the lack of internal semantics. Moreover, the agricultural text sequence is long, which leads to the lack of long-distance dependence of model capture. In order to solve the above problems, a self-attention mechanism RSA-CANER agricultural named entity recognition model is proposed which incorporating the potential characteristics of Chinese characters. First, the model takes character features and potential features of Chinese characters as input to enrich semantic information. Among them, character features are obtained based on ALBERT pre training tool, radical features are extracted based on convolutional neural network (CNN), and stroke features are extracted based on bidirectional long short-term memory model (BiLSTM). Then, based on the BiLSTM, the sequence characteristic matrix is obtained, and the self-attention mechanism is used to further enhance the ability of the model to capture long-distance dependence. Finally, the global optimal sequence is generated based on conditional random field (CRF) model. It obtains an F-score of 95.56%. The experimental results show that the model learns semantic information at multiple fine-grained levels of radicals and strokes, enriches the vector expression of target words, and its recognition precision is better than other models, improving the generalization ability of the model.
引用
收藏
页码:98936 / 98943
页数:8
相关论文
共 50 条
  • [1] Recognition of the agricultural named entities with multi-feature fusion based on BERT
    Zhao, Pengfei
    Zhao, Chunjiang
    Wu, Huarui
    Wang, Wei
    [J]. Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2022, 38 (03): : 112 - 118
  • [2] MAF-CNER : A Chinese Named Entity Recognition Model Based on Multifeature Adaptive Fusion
    Han, Xuming
    Zhou, Feng
    Hao, Zhiyuan
    Liu, Qiaoming
    Li, Yong
    Qin, Qi
    [J]. COMPLEXITY, 2021, 2021
  • [3] A Face Recognition Method Based on Multifeature Fusion
    Ye, Shengxi
    [J]. JOURNAL OF SENSORS, 2022, 2022
  • [4] Human Action Recognition Based on Multifeature Fusion
    Zhang, Shasha
    Zhang, Weicun
    Li, Yunluo
    [J]. PROCEEDINGS OF 2016 CHINESE INTELLIGENT SYSTEMS CONFERENCE, VOL II, 2016, 405 : 183 - 192
  • [5] Multifeature Named Entity Recognition in Information Security Based on Adversarial Learning
    Zhang, Han
    Guo, Yuanbo
    Li, Tao
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2019,
  • [6] Prototype based on named entities recognition in the Spanish language
    Castillo Molina, Camilo Andres
    Gutierrez, Raul E.
    Solarte, Oswaldo
    [J]. 2015 10TH COMPUTING COLOMBIAN CONFERENCE (10CCC), 2015, : 364 - 371
  • [7] Multifeature fusion action recognition based on key frames
    Zhao, Yuerong
    Guo, Hongbo
    Gao, Ling
    Wang, Hai
    Zheng, Jie
    Zhang, Kan
    Zheng, Yong
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (21):
  • [8] A system for recognition of named entities in Greek
    Boutsis, S
    Demiros, I
    Giouli, V
    Liakata, M
    Papageorgiou, H
    Piperidis, S
    [J]. NATURAL LANGUAGE PROCESSING-NLP 2000, PROCEEDINGS, 2000, 1835 : 424 - 435
  • [9] Recognition of named entities in Spanish texts
    Galicia-Haro, SN
    Gelbukh, A
    Bolshakov, IA
    [J]. MICAI 2004: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2004, 2972 : 420 - 429
  • [10] Named Entities : Recognition, classification and use
    Charton, Eric
    [J]. TRAITEMENT AUTOMATIQUE DES LANGUES, 2010, 51 (03): : 155 - 157