Semantic similarity and analysis of the word frequency dynamics

被引：1
|
作者：
Bochkarev, V. V. [1 ]
Maslennikova, Yu S. [1 ]
Svetovidov, A. A. [1 ]
机构：
[1] Kazan Fed Univ, Kremlevskaya Str 18, Kazan 420018, Russia
来源：
6TH INTERNATIONAL CONFERENCE ON MATHEMATICAL MODELLING IN PHYSICAL SCIENCES (IC-MSQUARE 2017) | 2017年 / 936卷
基金：
俄罗斯基础研究基金会;
关键词：
D O I：
10.1088/1742-6596/936/1/012067
中图分类号：
TB3 [工程材料学];
学科分类号：
0805 ; 080502 ;
摘要：
In this study a similarity in changes of frequencies dynamics for semantically related words was analyzed using word statistics extracted from more than 4 5 million books written over a period of 205 years. The approach is based on the correlation analysis of 1-grams frequency dynamics We analyzed the frequencies correlation of synonym pairs, their corresponding antonymous groups and random words pairs. Also, we compared several metrics to find the most effective for assessing the degree of similarity in the dynamics of use of different words. Comparing differences between logarithmic rank variations in pairs of synonyms and random word pairs, significant differences are found, though they are smaller than it could be expected.
引用
收藏
页数：4
相关论文
共 50 条
  • [41] Measurement of Turkish Word Semantic Similarity and Text Categorization Application
    Amasyah, M. Fatih
    Beken, Aytunc
    [J]. 2009 IEEE 17TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, VOLS 1 AND 2, 2009, : 1 - 4
  • [42] The roles of semantic similarity and proactive interference in the word length effect
    Goh, Winston D.
    Goh, Chang Khiang
    [J]. PSYCHONOMIC BULLETIN & REVIEW, 2006, 13 (06) : 978 - 984
  • [43] GRAPHEMIC AND SEMANTIC SIMILARITY EFFECTS IN THE PICTURE WORD INTERFERENCE TASK
    RAYNER, K
    SPRINGER, CJ
    [J]. BRITISH JOURNAL OF PSYCHOLOGY, 1986, 77 : 207 - 222
  • [44] A Hybrid Semantic Representation with Internal and External Knowledge for Word Similarity
    Wang, Yanyan
    Liu, Jianbo
    Wang, Kaili
    Yin, Fulian
    [J]. 2020 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA (ICAIBD 2020), 2020, : 264 - 268
  • [45] Analyzing Continuous Semantic Shifts with Diachronic Word Similarity Matrices
    Kiyama, Hajime
    Aida, Taichi
    Komachi, Mamoru
    Ogiso, Toshinobu
    Takamura, Hiroya
    Mochihashi, Daichi
    [J]. arXiv,
  • [46] Semantic Similarity Based on Word Recurrence Ratio Focusing on WordNet
    Ahmed, M. Elius
    Shajalal, Md
    Atabuzzaman, Md
    Aono, Masaki
    [J]. 2020 23RD INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (ICCIT 2020), 2020,
  • [47] Word Embedding based Textual Semantic Similarity Measure in Bengali
    Iqbal, Md Asif
    Sharif, Omar
    Hoque, Mohammed Moshiul
    Sarker, Iqbal H.
    [J]. 10TH INTERNATIONAL YOUNG SCIENTISTS CONFERENCE IN COMPUTATIONAL SCIENCE (YSC2021), 2021, 193 : 92 - 101
  • [48] SEMANTIC EFFECTS IN VISUAL WORD DETECTION WITH VISUAL SIMILARITY CONTROLLED
    HENDERSON, L
    CHARD, J
    [J]. PERCEPTION & PSYCHOPHYSICS, 1978, 23 (04): : 290 - 298
  • [49] Semantic Similarity of Inverse Morpheme Words Based on Word Embedding
    Zhou, Jiaomei
    Liu, Zhiying
    [J]. CHINESE LEXICAL SEMANTICS, CLSW 2021, PT I, 2022, 13249 : 452 - 463
  • [50] The roles of semantic similarity and proactive interference in the word length effect
    Winston D. Goh
    Chang Khiang Goh
    [J]. Psychonomic Bulletin & Review, 2006, 13 : 978 - 984
12345