Enhancing Legal Named Entity Recognition Using RoBERTa-GCN with CRF: A Nuanced Approach for Fine-Grained Entity Recognition

被引:0
|
作者
Jain, Arihant [1 ]
Sharma, Raksha [1 ]
机构
[1] Indian Inst Technol Roorkee, Roorkee, India
关键词
Legal Domain; Pretrained Language Models; Named Entity Recognition; Conditional Random Fields;
D O I
10.1007/978-3-031-56063-7_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate identification of named entities is pivotal for the advancement of sophisticated legal Artificial Intelligence (AI) applications. However, the legal domain presents distinct challenges due to the presence of fine-grained, domain-specific entities, including lawyers, judges, courts, and precedents. This necessitates a nuanced approach to Named Entity Recognition (NER). In this paper, we introduce a novel NER approach tailored to the legal domain. Our system combines Robustly Optimized BERT (RoBERTa) with a Graph Convolutional Network (GCN) to harness two distinct types of complementary information related to words in the data. Furthermore, the application of a Conditional Random Field (CRF) at the output layer ensures global consistency in data labeling by considering the entire sequence when predicting a named entity. RoBERTa captures contextual information about individual words, while GCN allows us to exploit the mutual relationships between words, resulting in more precise named entity identification. Our results indicate that RoBERTa-GCN (CRF) outperforms other standard settings, such as, RoBERTa, textGCN, and BiLSTM, including state-of-the-art for NER in the legal domain.
引用
收藏
页码:261 / 267
页数:7
相关论文
共 50 条
  • [1] Fine-Grained Named Entity Recognition for Sinhala
    Azeez, Rameela
    Ranathunga, Surangika
    MERCON 2020: 6TH INTERNATIONAL MULTIDISCIPLINARY MORATUWA ENGINEERING RESEARCH CONFERENCE (MERCON), 2020, : 295 - 300
  • [2] Multilingual Fine-Grained Named Entity Recognition
    Lupancu, Viorica-Camelia
    Iftene, Adrian
    COMPUTER SCIENCE JOURNAL OF MOLDOVA, 2023, 31 (03) : 321 - 339
  • [3] Fine-grained Dutch named entity recognition
    Desmet, Bart
    Hoste, Veronique
    LANGUAGE RESOURCES AND EVALUATION, 2014, 48 (02) : 307 - 343
  • [4] Fine-grained Dutch named entity recognition
    Bart Desmet
    Véronique Hoste
    Language Resources and Evaluation, 2014, 48 : 307 - 343
  • [5] FgER: Fine-Grained Entity Recognition
    Abhishek
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 8008 - 8009
  • [6] Chinese Fine-Grained Geological Named Entity Recognition With Rules and FLAT
    Chen, Siying
    Hua, Weihua
    Liu, Xiuguo
    Deng, Xiaotong
    Zeng, Xinling
    Duan, Jianchao
    EARTH AND SPACE SCIENCE, 2022, 9 (12)
  • [7] Fine-Grained Multimodal Named Entity Recognition and Grounding with a Generative Framework
    Wang, Jieming
    Li, Ziyan
    Yu, Jianfei
    Yang, Li
    Xia, Rui
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3934 - 3943
  • [8] Fine-Grained Chinese Named Entity Recognition Based on MacBERT-Attn-BiLSTM-CRF Model
    Wang, Jueyang
    Li, Shuzhen
    Agyemang-Duah, Edward
    Feng, Xingyu
    Xu, Chun
    Ji, Yuao
    Liu, Junqiang
    2022 IEEE 12TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE (CCWC), 2022, : 125 - 131
  • [9] Fine-grained Named Entity Recognition using Conditional Random Fields for Question Answering
    Lee, Changki
    Hwang, Yi-Gyu
    Oh, Hyo-Jung
    Lim, Soojong
    Heo, Jeong
    Lee, Chung-Hee
    Kim, Hyeon-Jin
    Wang, Ji-Hyun
    Jang, Myung-Gil
    INFORMATION RETRIEVAL TECHNOLOGY, PROCEEDINGS, 2006, 4182 : 581 - 587
  • [10] Fine-Grained Mechanical Chinese Named Entity Recognition Based on ALBERT-AttBiLSTM-CRF and Transfer Learning
    Yao, Liguo
    Huang, Haisong
    Wang, Kuan-Wei
    Chen, Shih-Huan
    Xiong, Qiaoqiao
    SYMMETRY-BASEL, 2020, 12 (12): : 1 - 21