Neural Legal Outcome Prediction with Partial Least Squares Compression

被引:2
|
作者
Condevaux, Charles [1 ]
机构
[1] Univ Nimes, CHROME, F-30021 Nimes, France
来源
STATS | 2020年 / 3卷 / 03期
关键词
NLP; text classification; legal knowledge; transformer; PLS regression;
D O I
10.3390/stats3030025
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Predicting the outcome of a case from a set of factual data is a common goal in legal knowledge discovery. In practice, solving this task is most of the time difficult due to the scarcity of labeled datasets. Additionally, processing long documents often leads to sparse data, which adds another layer of complexity. This paper presents a study focused on the french decisions of the European Court of Human Rights (ECtHR) for which we build various classification tasks. These tasks consist first of all in the prediction of the potential violation of an article of the convention, using extracted facts. A multiclass problem is also created, with the objective of determining whether an article is relevant to plead given some circumstances. We solve these tasks by comparing simple linear models to an attention-based neural network. We also take advantage of a modified partial least squares algorithm that we integrate in the aforementioned models, capable of effectively dealing with classification problems and scale with sparse inputs coming from natural language tasks.
引用
收藏
页码:396 / 411
页数:16
相关论文
共 50 条
  • [1] The application of neural networks and partial least squares in Korea weather prediction
    Hwang, D
    Han, MS
    [J]. PROGRESS IN CONNECTIONIST-BASED INFORMATION SYSTEMS, VOLS 1 AND 2, 1998, : 988 - 991
  • [2] Prediction intervals in partial least squares
    Denham, MC
    [J]. JOURNAL OF CHEMOMETRICS, 1997, 11 (01) : 39 - 52
  • [3] Deep network compression based on partial least squares
    Jordao, Artur
    Yamada, Fernando
    Schwartz, William Robson
    [J]. NEUROCOMPUTING, 2020, 406 : 234 - 243
  • [4] Big data and partial least-squares prediction
    Cook, R. Dennis
    Forzani, Liliana
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2018, 46 (01): : 62 - 78
  • [5] Prediction for Biodegradability of Chemicals by Kernel Partial Least Squares
    Hiromatsu, Koichi
    Takahara, Jun-ichi
    Nishihara, Tsutomu
    Okamoto, Kousuke
    Yasunaga, Teruo
    Ohmayu, Yoshihiro
    Takagi, Tatsuya
    Nakazono, Kingo
    [J]. JOURNAL OF COMPUTER AIDED CHEMISTRY, 2009, 10 : 1 - 9
  • [6] Prediction of selectivity coefficients of medicine electrode using artificial neural networks and partial least squares
    Xing, WL
    Zhang, CX
    He, XW
    [J]. CHEMISTRY LETTERS, 1997, (03) : 207 - 208
  • [7] Prediction of color and moisture content in coffee fruits by neural networks and partial least squares regression
    Castro Silupu, Wilson Manuel
    Yoplac Tafur, Ives Julian
    Lopez Portocarrero, Cesar Augusto
    [J]. CIENCIA AMAZONICA, 2015, 5 (02): : 91 - 103
  • [8] Prediction of tail biting in pigs using partial least squares regression and artificial neural networks
    Drexl, Veronika
    Dittrich, Imme
    Wilder, Thore
    Diers, Sophie
    Janssen, Heiko
    Krieter, Joachim
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 216
  • [9] Partial least squares
    Vinzi, VE
    Lauro, C
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2005, 48 (01) : 1 - 4
  • [10] Bankruptcy prediction using Partial Least Squares Logistic Regression
    Ben Jabeur, Sami
    [J]. JOURNAL OF RETAILING AND CONSUMER SERVICES, 2017, 36 : 197 - 202