A Discriminative Latent-Variable Model for Bilingual Lexicon Induction

被引:0
|
作者
Ruder, Sebastian [1 ,2 ]
Cotterell, Ryan [3 ,4 ]
Kementchedjhieva, Yova [5 ]
Sogaard, Anders [5 ]
机构
[1] Natl Univ Ireland, Insight Res Ctr, Galway, Ireland
[2] Aylien Ltd, Dublin, Ireland
[3] Univ Cambridge, Comp Lab, Cambridge, England
[4] Johns Hopkins Univ, Dept Comp Sci, Baltimore, MD 21218 USA
[5] Univ Copenhagen, Dept Comp Sci, Copenhagen, Denmark
基金
爱尔兰科学基金会;
关键词
ALGORITHM; SPARSE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a novel discriminative latent-variable model for the task of bilingual lexicon induction. Our model combines the bipartite matching dictionary prior of Haghighi et al. (2008) with a state-of-the-art embeddingbased approach. To train the model, we derive an efficient Viterbi EM algorithm. We provide empirical improvements on six language pairs under two metrics and show that the prior theoretically and empirically helps to mitigate the hubness problem. We also demonstrate how previous work may be viewed as a similarly fashioned latent-variable model, albeit with a different prior.
引用
收藏
页码:458 / 468
页数:11
相关论文
共 50 条
  • [1] Unsupervised Bilingual Lexicon Induction via Latent Variable Models
    Dou, Zi-Yi
    Zhou, Zhi-Hao
    Huang, Shujian
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 621 - 626
  • [2] A LATENT-VARIABLE MODEL OF QUALITY DETERMINATION
    GERTLER, PJ
    [J]. JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 1988, 6 (01) : 97 - 104
  • [3] Deconvolutional Latent-Variable Model for Text Sequence Matching
    Shen, Dinghan
    Zhang, Yizhe
    Henao, Ricardo
    Su, Qinliang
    Carin, Lawrence
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 5438 - 5445
  • [4] A LATENT-VARIABLE CAUSAL MODEL OF FACULTY REPUTATIONAL RATINGS
    KING, S
    WOLFLE, LM
    [J]. RESEARCH IN HIGHER EDUCATION, 1987, 27 (02) : 99 - 106
  • [5] INFORMATION MATRICES IN LATENT-VARIABLE MODELS
    MISLEVY, RJ
    SHEEHAN, KM
    [J]. JOURNAL OF EDUCATIONAL STATISTICS, 1989, 14 (04): : 335 - 350
  • [6] Heterogenous data fusion via a probabilistic latent-variable model
    Yu, K
    Tresp, V
    [J]. ORGANIC AND PERVASIVE COMPUTING - ARCS 2004, 2004, 2981 : 20 - 30
  • [7] REVERSE REGRESSIONS FOR LATENT-VARIABLE MODELS
    LEVINE, DK
    [J]. JOURNAL OF ECONOMETRICS, 1986, 32 (02) : 291 - 292
  • [8] Deep Latent-Variable Kernel Learning
    Liu, Haitao
    Ong, Yew-Soon
    Jiang, Xiaomo
    Wang, Xiaofang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) : 10276 - 10289
  • [9] A Discriminative Latent Variable Model for Online Clustering
    Samdani, Rajhans
    Chang, Kai-Wei
    Roth, Dan
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 32 (CYCLE 1), 2014, 32
  • [10] LATENT-VARIABLE MODELS OF ATTRIBUTIONAL MEASUREMENT
    SMITH, ER
    MILLER, FD
    [J]. PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN, 1982, 8 (02) : 221 - 225