Hidden citations obscure true impact in science

被引:2
|
作者
Meng, Xiangyi [1 ,2 ,3 ]
Varol, Onur [1 ,2 ,4 ]
Barabasi, Albert-Laszlo [1 ,2 ,5 ,6 ]
机构
[1] Northeastern Univ, Network Sci Inst, Boston, MA 02115 USA
[2] Northeastern Univ, Dept Phys, Boston, MA 02115 USA
[3] Northwestern Univ, Dept Phys & Astron, Evanston, IL 60208 USA
[4] Sabanci Univ, Fac Engn & Nat Sci, TR-34956 Istanbul, Turkiye
[5] Harvard Med Sch, Brigham & Womens Hosp, Dept Med, Boston, MA 02115 USA
[6] Cent European Univ, Dept Network & Data Sci, H-1051 Budapest, Hungary
来源
PNAS NEXUS | 2024年 / 3卷 / 05期
基金
美国国家科学基金会;
关键词
science of science; hidden citation; latent Dirichlet allocation; foundational paper; catchphrase; ASSESSING OBLITERATION; EPONYMY;
D O I
10.1093/pnasnexus/pgae155
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by incorporation. This leads to the concept of hidden citation, representing a clear textual credit to a discovery without a reference to the publication embodying it. Here, we rely on unsupervised interpretable machine learning applied to the full text of each paper to systematically identify hidden citations. We find that for influential discoveries hidden citations outnumber citation counts, emerging regardless of publishing venue and discipline. We show that the prevalence of hidden citations is not driven by citation counts, but rather by the degree of the discourse on the topic within the text of the manuscripts, indicating that the more discussed is a discovery, the less visible it is to standard bibliometric analysis. Hidden citations indicate that bibliometric measures offer a limited perspective on quantifying the true impact of a discovery, raising the need to extract knowledge from the full text of the scientific corpus.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] 'Hidden' citations conceal the true impact of research
    Allen, Michael
    PHYSICS WORLD, 2024, 37 (07)
  • [2] Evaluating the impact of citations of articles based on knowledge flow patterns hidden in the citations
    Wang, Mingyang
    Zhang, Jiaqi
    Jiao, Shijia
    Zhang, Tianyu
    PLOS ONE, 2019, 14 (11):
  • [3] Citations, Impact Indices and the Fabric of Science
    Balaram, P.
    CURRENT SCIENCE, 2010, 99 (07): : 857 - 858
  • [4] Knowledge Flows, Patent Citations and the Impact of Science on Technology
    Nomaler, Onder
    Verspagen, Bart
    ECONOMIC SYSTEMS RESEARCH, 2008, 20 (04) : 339 - 366
  • [5] Citations and science
    van Mil, J. W. Foppe
    Green, James
    INTERNATIONAL JOURNAL OF CLINICAL PHARMACY, 2017, 39 (05) : 977 - 979
  • [6] Citations and science
    J. W. Foppe van Mil
    James Green
    International Journal of Clinical Pharmacy, 2017, 39 : 977 - 979
  • [7] A simulation-based analysis of the impact of rhetorical citations in science
    Bao, Honglin
    Teplitskiy, Misha
    NATURE COMMUNICATIONS, 2024, 15 (01)
  • [8] The explanatory power of citations: a new approach to unpacking impact in science
    Ruediger, Matthias Sebastian
    Antons, David
    Salge, Torsten-Oliver
    SCIENTOMETRICS, 2021, 126 (12) : 9779 - 9809
  • [9] A simulation-based analysis of the impact of rhetorical citations in science
    Honglin Bao
    Misha Teplitskiy
    Nature Communications, 15
  • [10] Are Altmetrics Proxies or Complements to Citations for Assessing Impact in Computer Science?
    Shakeel, Yusra
    Alchokr, Rand
    Kruger, Jacob
    Saake, Gunter
    Leich, Thomas
    2021 ACM/IEEE JOINT CONFERENCE ON DIGITAL LIBRARIES (JCDL 2021), 2021, : 284 - 286