A Transformer-based Prior Legal Case Retrieval Method

被引:0
|
作者
Ozturk, Ceyhun E. [1 ]
Ozcelik, S. Baris [2 ]
Koc, Aykut [3 ]
机构
[1] Bilkent Univ, Elekt & Elekt Muhendisligi Bolumu, ASELSAN Res Ctr, Ankara, Turkiye
[2] Bilkent Univ, Hukuk Fak, Ankara, Turkiye
[3] Bilkent Univ, Elekt & Elekt Muhendisligi Bolumu, Ulusal Manyet Rezonans Arastirma Merkezi, Ankara, Turkiye
关键词
Natural language processing; legal tech; deep learning; prior legal case retrieval; legal NLP; Turkish NLP;
D O I
10.1109/SIU59756.2023.10223938
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, BERTurk-Legal, a transformer-based language model, is introduced to retrieve prior legal cases. BERTurk-Legal is pre-trained on a dataset from the Turkish legal domain. This dataset does not contain any labels related to the prior court case retrieval task. Masked language modeling is used to train BERTurk-Legal in a self-supervised manner. With zero-shot classification, BERTurk-Legal provides state-of-the-art results on the dataset consisting of legal cases of the Court of Cassation of Turkey. The results of the experiments show the necessity of developing language models specific to the Turkish law domain.
引用
收藏
页数:4
相关论文
共 50 条
  • [21] AiPE: A Novel Transformer-Based Pose Estimation Method
    Lu, Kai
    Min, Dugki
    ELECTRONICS, 2024, 13 (05)
  • [22] A transformer-based method for vessel traffic flow forecasting
    Mandalis, Petros
    Chondrodima, Eva
    Kontoulis, Yannis
    Pelekis, Nikos
    Theodoridis, Yannis
    GEOINFORMATICA, 2024, : 149 - 173
  • [23] A TRANSFORMER-BASED CROSS-MODAL IMAGE-TEXT RETRIEVAL METHOD USING FEATURE DECOUPLING AND RECONSTRUCTION
    Zhang, Huan
    Sun, Yingzhi
    Liao, Yu
    Xu, SiYuan
    Yang, Rui
    Wang, Shuang
    Hou, Biao
    Jiao, Licheng
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1796 - 1799
  • [24] Vision Transformer-Based Video Hashing Retrieval for Tracing the Source of Fake Videos
    Pei, Pengfei
    Zhao, Xianfeng
    Li, Jinchuan
    Cao, Yun
    Lai, Xuyuan
    Security and Communication Networks, 2023, 2023
  • [25] Panini: a transformer-based grammatical error correction method for Bangla
    Nahid Hossain
    Mehedi Hasan Bijoy
    Salekul Islam
    Swakkhar Shatabda
    Neural Computing and Applications, 2024, 36 : 3463 - 3477
  • [26] MVCformer: A transformer-based multi-view clustering method
    Zhao, Mingyu
    Yang, Weidong
    Nie, Feiping
    INFORMATION SCIENCES, 2023, 649
  • [27] An efficient swin transformer-based method for underwater image enhancement
    Rong Wang
    Yonghui Zhang
    Jian Zhang
    Multimedia Tools and Applications, 2023, 82 : 18691 - 18708
  • [28] TRANSFORMER-BASED METHOD FOR SEMANTIC SEGMENTATION AND RECONSTRUCTION OF THE MARTIAN SURFACE
    Li, Z.
    Wu, B.
    Chen, Z.
    Ma, Y.
    GEOSPATIAL WEEK 2023, VOL. 48-1, 2023, : 1643 - 1649
  • [29] Transformer-Based Deep Learning Method for the Prediction of Ventilator Pressure
    Fan, Ruizhe
    2022 IEEE 2ND INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SOFTWARE ENGINEERING (ICICSE 2022), 2022, : 25 - 28
  • [30] HTrans: Transformer-based Method for Hardware Trojan Detection and Localization
    Li, Yilin
    Li, Shan
    Shen, Haihua
    2023 IEEE 32ND ASIAN TEST SYMPOSIUM, ATS, 2023, : 31 - 36