Minimal models for text production and Zipf's law

被引:0
|
作者
Fontanari, JF [1 ]
Perlovsky, LI [1 ]
机构
[1] Univ Sao Paulo, BR-13560 Sao Carlos, Brazil
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mathematical models used to explain the power-law distribution of word frequencies observed in natural languages - Zipf's law - generally assume that symbols and words occur independently, i.e., they do not interact. Here we show that when interaction is taken into account by allowing the words to compete amongst themselves for space in the memory of the users, the resulting word frequency distribution is best described by an exponential, rather than by a power-law. The implications of the failure to derive Zipf's law under more realistic assumptions are discussed.
引用
收藏
页码:297 / 300
页数:4
相关论文
共 50 条
  • [1] Zipf's law for atlas models
    Fernholz, Ricardo T.
    Fernholz, Robert
    JOURNAL OF APPLIED PROBABILITY, 2020, 57 (04) : 1276 - 1297
  • [2] Application of the Zipf law to text compression
    Bakulina M.P.
    J. Appl. Ind. Math., 2008, 4 (477-483): : 477 - 483
  • [3] Automatic Text Classification Method Based on Zipf's Law
    Yatsko, V. A.
    AUTOMATIC DOCUMENTATION AND MATHEMATICAL LINGUISTICS, 2015, 49 (03) : 83 - 88
  • [4] On Zipf's law and the bias of Zipf regressions
    Schluter, Christian
    EMPIRICAL ECONOMICS, 2021, 61 (02) : 529 - 548
  • [5] On Zipf’s law and the bias of Zipf regressions
    Christian Schluter
    Empirical Economics, 2021, 61 : 529 - 548
  • [6] Zipf's Law in a Random Text from English With a New Ranking Method
    Saxena, Anurag
    Jauhari, Monika
    Gupta, B. M.
    DESIDOC JOURNAL OF LIBRARY & INFORMATION TECHNOLOGY, 2007, 27 (04): : 51 - 58
  • [7] Universality of Zipf's law
    Corominas-Murtra, Bernat
    Sole, Ricard V.
    PHYSICAL REVIEW E, 2010, 82 (01):
  • [8] Unzipping Zipf's law
    Lestrade, Sander
    PLOS ONE, 2017, 12 (08):
  • [9] Zipf's law in percolation
    Watanabe, MS
    PHYSICAL REVIEW E, 1996, 53 (04) : 4187 - 4190
  • [10] Zipf's law in multifragmentation
    Campi, X
    Krivine, H
    PHYSICAL REVIEW C, 2005, 72 (05):