Hidden citations obscure true impact in science

被引:2
|
作者
Meng, Xiangyi [1 ,2 ,3 ]
Varol, Onur [1 ,2 ,4 ]
Barabasi, Albert-Laszlo [1 ,2 ,5 ,6 ]
机构
[1] Northeastern Univ, Network Sci Inst, Boston, MA 02115 USA
[2] Northeastern Univ, Dept Phys, Boston, MA 02115 USA
[3] Northwestern Univ, Dept Phys & Astron, Evanston, IL 60208 USA
[4] Sabanci Univ, Fac Engn & Nat Sci, TR-34956 Istanbul, Turkiye
[5] Harvard Med Sch, Brigham & Womens Hosp, Dept Med, Boston, MA 02115 USA
[6] Cent European Univ, Dept Network & Data Sci, H-1051 Budapest, Hungary
来源
PNAS NEXUS | 2024年 / 3卷 / 05期
基金
美国国家科学基金会;
关键词
science of science; hidden citation; latent Dirichlet allocation; foundational paper; catchphrase; ASSESSING OBLITERATION; EPONYMY;
D O I
10.1093/pnasnexus/pgae155
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by incorporation. This leads to the concept of hidden citation, representing a clear textual credit to a discovery without a reference to the publication embodying it. Here, we rely on unsupervised interpretable machine learning applied to the full text of each paper to systematically identify hidden citations. We find that for influential discoveries hidden citations outnumber citation counts, emerging regardless of publishing venue and discipline. We show that the prevalence of hidden citations is not driven by citation counts, but rather by the degree of the discourse on the topic within the text of the manuscripts, indicating that the more discussed is a discovery, the less visible it is to standard bibliometric analysis. Hidden citations indicate that bibliometric measures offer a limited perspective on quantifying the true impact of a discovery, raising the need to extract knowledge from the full text of the scientific corpus.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Valuing the information hidden in true long-term data for invasion science
    Phillip J. Haubrock
    Ismael Soto
    Biological Invasions, 2023, 25 : 2385 - 2394
  • [22] THE SCIENCE CITATIONS INDEX AND THE RSC
    EMSLEY, J
    CHEMISTRY IN BRITAIN, 1983, 19 (01) : 29 - 30
  • [23] Software Citations in Political Science
    Arel-Bundock, Vincent
    McCrain, Joshua
    PS-POLITICAL SCIENCE & POLITICS, 2023, 56 (03) : 398 - 401
  • [24] The role of self-citations in the impact factor of Library and Information Science journals
    Salvador Olivan, Jose Antonio
    Marco Cuenca, Gonzalo
    Arquero Aviles, Rosario
    IBERSID-REVISTA DE SISTEMAS DE INFORMACION Y DOCUMENTACION, 2024, 18 (02): : 13 - 22
  • [25] Can applied science be ‘good science’? Exploring the relationship between patent citations and citation impact in nanoscience
    M. Meyer
    K. Debackere
    W. Glänzel
    Scientometrics, 2010, 85 : 527 - 539
  • [26] Can applied science be 'good science'? Exploring the relationship between patent citations and citation impact in nanoscience
    Meyer, M.
    Debackere, K.
    Glanzel, W.
    SCIENTOMETRICS, 2010, 85 (02) : 527 - 539
  • [27] Impact beyond citations
    不详
    NATURE BIOMEDICAL ENGINEERING, 2018, 2 (01): : 1 - 1
  • [28] Impact beyond citations
    Nature Biomedical Engineering, 2018, 2 : 1 - 1
  • [29] True philosophy and true science
    Rutkevich, A. M.
    EPISTEMOLOGY & PHILOSOPHY OF SCIENCE-EPISTEMOLOGIYA I FILOSOFIYA NAUKI, 2008, 17 (03): : 222 - 226
  • [30] Fortunes in footnotes - JVs obscure companies' true worth
    Freedman, W
    CHEMICAL WEEK, 1996, 158 (34) : 27 - &