Transfer Learning for Arabic Named Entity Recognition With Deep Neural Networks

被引:25
|
作者
Al-Smadi, Mohammad [1 ]
Al-Zboon, Saad [1 ]
Jararweh, Yaser [1 ,2 ]
Juola, Patrick [2 ]
机构
[1] Jordan Univ Sci & Technol, Comp Sci Dept, Irbid 22110, Jordan
[2] Duquesne Univ, Math & Comp Sci Dept, Pittsburgh, PA 15282 USA
关键词
Natural language processing; deep learning; transfer learning; ANER; universal sentence encoder; Bi-LSTM;
D O I
10.1109/ACCESS.2020.2973319
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The vast amount of unstructured data spread on a daily basis rises the need for developing effective information retrieval and extraction methods. Named Entity Recognition is a challenging classification task for structuring data into pre-defined labels, and is even more complicated when being applied on the Arabic language due to its special traits and complex nature. This article presents a novel Deep Learning approach for Standard Arabic Named Entity Recognition that proved its out-performance when being compared to previous works. The main aim of building a new model is to provide better fine-grained results for use in the Natural Language Processing fields. In our proposed methodology we utilized transfer learning with deep neural networks to build a Pooled-GRU model combined with the Multilingual Universal Sentence Encoder. Our proposed model scored about 17& x0025; enhancement when being compared to previous work.
引用
收藏
页码:37736 / 37745
页数:10
相关论文
共 50 条
  • [31] Named Entity Recognition with Gated Convolutional Neural Networks
    Wang, Chunqi
    Chen, Wei
    Xu, Bo
    [J]. CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA, CCL 2017, 2017, 10565 : 110 - 121
  • [32] Recurrent neural networks for Turkish named entity recognition
    Gungor, Onur
    Uskudarli, Suzan
    Gungor, Tunga
    [J]. 2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [33] Neural Networks for Featureless Named Entity Recognition in Czech
    Strakova, Jana
    Straka, Milan
    Hajic, Jan
    [J]. TEXT, SPEECH, AND DIALOGUE, 2016, 9924 : 173 - 181
  • [34] Named Entity Recognition for Amharic Using Deep Learning
    Gamback, Bjorn
    Sikdar, Utpal Kumar
    [J]. 2017 IST-AFRICA WEEK CONFERENCE (IST-AFRICA), 2017,
  • [35] Domain Specific Named Entity Recognition Referring to the Real World by Deep Neural Networks
    Tomori, Suzushi
    Ninomiya, Takashi
    Mori, Shinsuke
    [J]. PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2016), VOL 2, 2016, : 236 - 242
  • [36] Weakly Supervised Named Entity Recognition for Carbon Storage Using Deep Neural Networks
    Londono, Rene Gomez
    Wlodarczyk, Sylvain
    Arman, Molood
    Bugiotti, Francesca
    Seghouani, Nacera Bennacer
    [J]. DISCOVERY SCIENCE (DS 2022), 2022, 13601 : 227 - 242
  • [37] Deep Learning Architectures for Named Entity Recognition: A Survey
    Thomas, Anu
    Sangeetha, S.
    [J]. ADVANCED COMPUTING AND INTELLIGENT ENGINEERING, 2020, 1082 : 215 - 225
  • [38] Survey on Chinese named entity recognition with deep learning
    Kang, Yilin
    Sun, Lubing
    Zhu, Rongbo
    Li, Mengyao
    [J]. Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2022, 50 (11): : 44 - 53
  • [39] Multi-level transfer learning for improving the performance of deep neural networks: Theory and practice from the tasks of facial emotion recognition and named entity recognition
    Hung, Jason C.
    Chang, Jia-Wei
    [J]. APPLIED SOFT COMPUTING, 2021, 109
  • [40] A New Approach for Arabic Named Entity Recognition
    Karaa, Wahiba
    Slimani, Thabet
    [J]. INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2017, 14 (03) : 332 - 338