Collection and evaluation of lexical complexity data for Russian language using crowdsourcing

被引:2
|
作者
Abramov, Aleksei, V [1 ]
Ivanov, Vladimir V. [1 ]
机构
[1] Kazan Fed Univ, Kazan, Russia
来源
RUSSIAN JOURNAL OF LINGUISTICS | 2022年 / 26卷 / 02期
基金
俄罗斯科学基金会;
关键词
Lexical complexity; Russian language; annotation; corpora; Bible;
D O I
10.22363/2687-0088-30118
中图分类号
H [语言、文字];
学科分类号
05 ;
摘要
Estimating word complexity with binary or continuous scores is a challenging task that has been studied for several domains and natural languages. Commonly this task is referred to as Complex Word Identification (CWI) or Lexical Complexity Prediction (LCP). Correct evaluation of word complexity can be an important step in many Lexical Simplification pipelines. Earlier works have usually presented methodologies of lexical complexity estimation with several restrictions: hand-crafted features correlated with word complexity, performed feature engineering to describe target words with features such as number of hypernyms, count of consonants, Named Entity tag, and evaluations with carefully selected target audiences. Modern works investigated the use of transforner-based models that afford extracting features from surrounding context as well. However, the majority of papers have been devoted to pipelines for the English language and few translated them to other languages such as German, French, and Spanish. In this paper we present a dataset of lexical complexity in context based on the Russian Synodal Bible collected using a crowdsourcing platform. We describe a methodology for collecting the data using a 5-point Likert scale for annotation, present descriptive statistics and compare results with analogous work for the English language. We evaluate a linear regression model as a baseline for predicting word complexity on handcrafted features, fastText and ELMo embeddings of target words. The result is a corpus consisting of 931 distinct words that used in 3,364 different contexts.
引用
收藏
页码:409 / 425
页数:17
相关论文
共 50 条
  • [1] Lexical Complexity Evaluation based on Context for Russian Language
    Abramov, Aleksei V.
    Ivanov, Vladimir V.
    Solovyev, Valery D.
    [J]. COMPUTACION Y SISTEMAS, 2023, 27 (01): : 127 - 139
  • [2] Crowdsourcing in Evaluation Research: New Possibilities for Data Collection
    Mueller, Christoph E.
    Albrecht, Maria
    [J]. ZEITSCHRIFT FUR EVALUATION, 2019, 18 (01): : 134 - 139
  • [3] Design and Data Collection for the Accentological Corpus of the Russian Language
    Grishina, E.
    Savchuk, S.
    Poljakov, A.
    [J]. LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010,
  • [4] Lexical synonymy and lexical antonymy in the Russian Sign language
    Korol'kova, Ol'ga Olegovna
    Timofeeva, Mariya Kirillovna
    [J]. SIBIRSKII FILOLOGICHESKII ZHURNAL, 2013, (03): : 192 - 199
  • [5] THE SEMANTICS OF LEXICAL PLURALITY IN THE RUSSIAN LANGUAGE
    Rakhilina, E. V.
    Khen, Li. Su.
    [J]. VOPROSY YAZYKOZNANIYA, 2009, (04): : 13 - 40
  • [6] Reading Time and Vocabulary Rating in the Japanese Language: Large-Scale Reading Time Data Collection Using Crowdsourcing
    Asahara, Masayuki
    [J]. LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2022, : 5178 - 5187
  • [7] Transformers for Lexical Complexity Prediction in Spanish Language
    Ortiz-Zambrano, Jenny
    Espin-Riofrio, Cesar
    Montejo-Raez, Arturo
    [J]. PROCESAMIENTO DEL LENGUAJE NATURAL, 2022, (69): : 177 - 188
  • [8] Lexical Expressions of Time in Russian Sign Language
    Burkova, Svetlana
    Filimonova, Elizaveta
    Kimmelman, Vadim
    Kopylova, Viktoriia
    Semushina, Nina
    [J]. SIGN LANGUAGE STUDIES, 2018, 19 (02) : 175 - 203
  • [9] RUSSIAN LANGUAGE: CONSTRUCTIONAL AND LEXICAL SEMANTIC APPROACHES
    Ovsyannikova, M. A.
    Oskolskaya, S. A.
    Say, S. S.
    [J]. VOPROSY YAZYKOZNANIYA, 2011, (05): : 150 - 157
  • [10] Semantic shifts of lexical borrowings in the Russian language
    Nagel, Olga V.
    Volkova, Marina V.
    [J]. YAZYK I KULTURA-LANGUAGE AND CULTURE, 2023, (64): : 8 - 27