Named Entity Recognition on Code-Switched Data Using Conditional Random Fields

被引:0
|
作者
Sikdar, Utpal Kumar [1 ]
Barik, Biswanath [2 ]
Gamback, Bjorn [2 ]
机构
[1] Flytxt, Thiruvananthapuram, Kerala, India
[2] Norwegian Univ Sci & Technol, Dept Comp Sci, Trondheim, Norway
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Named Entity Recognition is an important information extraction task that identifies proper names in unstructured texts and classifies them into some pre-defined categories. Identification of named entities in code-mixed social media texts is a more difficult and challenging task as the contexts are short, ambiguous and often noisy. This work proposes a Conditional Random Fields based named entity recognition system to identify proper names in code-switched data and classify them into nine categories. The system ranked fifth among nine participant systems and achieved a 59.25% F1-score.
引用
收藏
页码:115 / 119
页数:5
相关论文
共 50 条
  • [1] Code-Switched Named Entity Recognition with Embedding Attention
    Wang, Changhan
    Cho, Kyunghyun
    Kiela, Douwe
    [J]. COMPUTATIONAL APPROACHES TO LINGUISTIC CODE-SWITCHING, 2018, : 154 - 158
  • [2] Named Entity Recognition using Conditional Random Fields
    Patil, Nita
    Patil, Ajay
    Pawar, B., V
    [J]. INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 : 1181 - 1188
  • [3] Named Entity Recognition Using Conditional Random Fields
    Khan, Wahab
    Daud, Ali
    Shahzad, Khurram
    Amjad, Tehmina
    Banjar, Ameen
    Fasihuddin, Heba
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (13):
  • [4] Simple Features for Strong Performance on Named Entity Recognition in Code-Switched Twitter Data
    Jain, Devanshu
    Kustikova, Marina
    Darbari, Mayank
    Gupta, Rishabh
    Mayhew, Stephen
    [J]. COMPUTATIONAL APPROACHES TO LINGUISTIC CODE-SWITCHING, 2018, : 103 - 109
  • [5] Named Entity Recognition on Code-Switched Data: Overview of the CALCS 2018 Shared Task
    Aguilar, Gustavo
    AlGhamdi, Fahad
    Soto, Victor
    Diab, Mona
    Hirschberg, Julia
    Solorio, Thamar
    [J]. COMPUTATIONAL APPROACHES TO LINGUISTIC CODE-SWITCHING, 2018, : 138 - 147
  • [6] A tool for the named entity recognition using conditional random fields
    do Amaral, Daniela Oliveira F.
    Vieira, Renata
    [J]. LINGUAMATICA, 2014, 6 (01): : 41 - 49
  • [7] A Malay Named Entity Recognition Using Conditional Random Fields
    Salleh, Muhammad Sharilazlan
    Asmai, Siti Azirah
    Basiron, Halizah
    Ahmad, Sabrina
    [J]. 2017 5TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY (ICOIC7), 2017,
  • [8] IIT (BHU) Submission for the ACL Shared Task on Named Entity Recognition on Code-switched Data
    Trivedi, Shashwat
    Rangwani, Harsh
    Singh, Anil Kumar
    [J]. COMPUTATIONAL APPROACHES TO LINGUISTIC CODE-SWITCHING, 2018, : 148 - 153
  • [9] Named entity recognition based on conditional random fields
    Song, Shengli
    Zhang, Nan
    Huang, Haitao
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 3): : S5195 - S5206
  • [10] Iterative Named Entity Recognition with Conditional Random Fields
    Alves-Pinto, Ana
    Demus, Christoph
    Spranger, Michael
    Labudde, Dirk
    Hobley, Eleanor
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (01):