Semantic similarity and analysis of the word frequency dynamics

被引:1
|
作者
Bochkarev, V. V. [1 ]
Maslennikova, Yu S. [1 ]
Svetovidov, A. A. [1 ]
机构
[1] Kazan Fed Univ, Kremlevskaya Str 18, Kazan 420018, Russia
基金
俄罗斯基础研究基金会;
关键词
D O I
10.1088/1742-6596/936/1/012067
中图分类号
TB3 [工程材料学];
学科分类号
0805 ; 080502 ;
摘要
In this study a similarity in changes of frequencies dynamics for semantically related words was analyzed using word statistics extracted from more than 4 5 million books written over a period of 205 years. The approach is based on the correlation analysis of 1-grams frequency dynamics We analyzed the frequencies correlation of synonym pairs, their corresponding antonymous groups and random words pairs. Also, we compared several metrics to find the most effective for assessing the degree of similarity in the dynamics of use of different words. Comparing differences between logarithmic rank variations in pairs of synonyms and random word pairs, significant differences are found, though they are smaller than it could be expected.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Word frequency effects in latent semantic analysis
    Durda, Kevin
    Buchanan, Lori
    [J]. CANADIAN JOURNAL OF EXPERIMENTAL PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE EXPERIMENTALE, 2008, 62 (04): : 268 - 268
  • [2] A Semantic Set Theory for Word Semantic Similarity Assessment
    Wei, Yang
    Wei, Jinmao
    [J]. PROCEEDINGS 2013 INTERNATIONAL CONFERENCE ON MECHATRONIC SCIENCES, ELECTRIC ENGINEERING AND COMPUTER (MEC), 2013, : 2466 - 2471
  • [3] SEMANTIC SIMILARITY AND COMPARISON OF WORD MEANINGS
    SCHAEFFE.B
    WALLACE, R
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1969, 82 (02): : 343 - &
  • [4] Semantic Similarity Calculation of Chinese Word
    Pan, Liqiang
    Zhang, Pu
    Xiong, Anping
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2014, 5 (08) : 8 - 12
  • [6] Cluster analysis of word frequency dynamics
    Maslennikova, Yu. S.
    Bochkarev, V. V.
    Belashova, I. A.
    [J]. 3RD INTERNATIONAL CONFERENCE ON MATHEMATICAL MODELING IN PHYSICAL SCIENCES (IC-MSQUARE 2014), 2015, 574
  • [7] Comparative Analysis of Word Embeddings in Assessing Semantic Similarity of Complex Sentences
    Chandrasekaran, Dhivya
    Mago, Vijay
    [J]. IEEE ACCESS, 2021, 9 : 166395 - 166408
  • [8] Improving semantic similarity retrieval with word embeddings
    Yan, Fengqi
    Fan, Qiaoqing
    Lu, Mingming
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2018, 30 (23):
  • [9] Semantic Word Error Rate For Sentence Similarity
    Spiccia, Carmelo
    Augello, Agnese
    Pilato, Giovanni
    Vassallo, Giorgio
    [J]. 2016 IEEE TENTH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC), 2016, : 265 - 268
  • [10] Word Semantic Similarity for Morphologically Rich Languages
    Zervanou, Kalliopi
    Iosif, Elias
    Potamianos, Alexandros
    [J]. LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2014, : 1642 - 1648