Hidden citations obscure true impact in science

被引:2
|
作者
Meng, Xiangyi [1 ,2 ,3 ]
Varol, Onur [1 ,2 ,4 ]
Barabasi, Albert-Laszlo [1 ,2 ,5 ,6 ]
机构
[1] Northeastern Univ, Network Sci Inst, Boston, MA 02115 USA
[2] Northeastern Univ, Dept Phys, Boston, MA 02115 USA
[3] Northwestern Univ, Dept Phys & Astron, Evanston, IL 60208 USA
[4] Sabanci Univ, Fac Engn & Nat Sci, TR-34956 Istanbul, Turkiye
[5] Harvard Med Sch, Brigham & Womens Hosp, Dept Med, Boston, MA 02115 USA
[6] Cent European Univ, Dept Network & Data Sci, H-1051 Budapest, Hungary
来源
PNAS NEXUS | 2024年 / 3卷 / 05期
基金
美国国家科学基金会;
关键词
science of science; hidden citation; latent Dirichlet allocation; foundational paper; catchphrase; ASSESSING OBLITERATION; EPONYMY;
D O I
10.1093/pnasnexus/pgae155
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by incorporation. This leads to the concept of hidden citation, representing a clear textual credit to a discovery without a reference to the publication embodying it. Here, we rely on unsupervised interpretable machine learning applied to the full text of each paper to systematically identify hidden citations. We find that for influential discoveries hidden citations outnumber citation counts, emerging regardless of publishing venue and discipline. We show that the prevalence of hidden citations is not driven by citation counts, but rather by the degree of the discourse on the topic within the text of the manuscripts, indicating that the more discussed is a discovery, the less visible it is to standard bibliometric analysis. Hidden citations indicate that bibliometric measures offer a limited perspective on quantifying the true impact of a discovery, raising the need to extract knowledge from the full text of the scientific corpus.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] CITATIONS IN POPULAR AND INTERPRETIVE SCIENCE WRITING
    GARFIELD, E
    SCIENCE, 1963, 141 (357) : 392 - &
  • [42] The incidence and role of negative citations in science
    Catalini, Christian
    Lacetera, Nicola
    Oettl, Alexander
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2015, 112 (45) : 13823 - 13826
  • [43] Forensic science - A true science?
    Crispino, Frank
    Ribaux, Olivier
    Houck, Max
    Margot, Pierre
    AUSTRALIAN JOURNAL OF FORENSIC SCIENCES, 2011, 43 (2-3) : 157 - 176
  • [44] True science, false science
    Andre, Jean-Claude
    ENVIRONNEMENT RISQUES & SANTE, 2018, 17 (06): : 632 - 634
  • [45] Impact factors, citations, and GEOPHYSICS
    Peltoniemi, M
    GEOPHYSICS, 2005, 70 (02) : 3MA - 17MA
  • [46] "The True Meaning of the Word Restoration": Architecture and Obsolescence in Jude the Obscure
    Cannon, Benjamin
    VICTORIAN STUDIES, 2014, 56 (02) : 201 - 224
  • [47] Citation behavior in popular scientific papers: what is behind obscure citations? The case of ethnobotany
    Marcelo Alves Ramos
    Joabe Gomes Melo
    Ulysses Paulino Albuquerque
    Scientometrics, 2012, 92 : 711 - 719
  • [48] Citation behavior in popular scientific papers: what is behind obscure citations? The case of ethnobotany
    Ramos, Marcelo Alves
    Melo, Joabe Gomes
    Albuquerque, Ulysses Paulino
    SCIENTOMETRICS, 2012, 92 (03) : 711 - 719
  • [49] Citations, impact factor, and the Journal
    Morley, JE
    JOURNALS OF GERONTOLOGY SERIES A-BIOLOGICAL SCIENCES AND MEDICAL SCIENCES, 2002, 57 (12): : M765 - M769
  • [50] The impact of citations in International Finance
    Millet-Reyes, Benedicte
    GLOBAL FINANCE JOURNAL, 2013, 24 (02) : 129 - 139