In which fields are citations indicators of research quality?

被引:21
|
作者
Thelwall, Mike [1 ]
Kousha, Kayvan [1 ]
Stuart, Emma [1 ]
Makita, Meiko [1 ]
Abdoli, Mahshid [1 ]
Wilson, Paul [1 ]
Levitt, Jonathan [1 ]
机构
[1] Univ Wolverhampton, Stat Cybermetr & Res Evaluat Grp, Wolverhampton, England
关键词
RESEARCH ASSESSMENT EXERCISE; BIBLIOMETRIC INDICATORS; PUBLICATIONS; LIBRARY; METRICS; COUNTS;
D O I
10.1002/asi.24767
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Citation counts are widely used as indicators of research quality to support or replace human peer review and for lists of top cited papers, researchers, and institutions. Nevertheless, the relationship between citations and research quality is poorly evidenced. We report the first large-scale science-wide academic evaluation of the relationship between research quality and citations (field normalized citation counts), correlating them for 87,739 journal articles in 34 field-based UK Units of Assessment (UoA). The two correlate positively in all academic fields, from very weak (0.1) to strong (0.5), reflecting broadly linear relationships in all fields. We give the first evidence that the correlations are positive even across the arts and humanities. The patterns are similar for the field classification schemes of Scopus and Dimensions.ai, although varying for some individual subjects and therefore more uncertain for these. We also show for the first time that no field has a citation threshold beyond which all articles are excellent quality, so lists of top cited articles are not pure collections of excellence, and neither is any top citation percentile indicator. Thus, while appropriately field normalized citations associate positively with research quality in all fields, they never perfectly reflect it, even at high values.
引用
收藏
页码:941 / 953
页数:13
相关论文
共 50 条
  • [1] In which fields are citations indicators of research quality?
    Thelwall, Mike
    Kousha, Kayvan
    Stuart, Emma
    Makita, Meiko
    Abdoli, Mahshid
    Wilson, Paul
    Levitt, Jonathan
    arXiv, 2022,
  • [2] Citations and journal impact factors: questionable indicators of research quality
    Seglen, PO
    ALLERGY, 1997, 52 (11) : 1050 - 1056
  • [3] Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories
    Aksnes, Dag W.
    Langfeldt, Liv
    Wouters, Paul
    SAGE OPEN, 2019, 9 (01):
  • [4] SOME INDICATORS FOR ASSESSING RESEARCH PERFORMANCE WITHOUT CITATIONS
    MENDEZ, A
    GOMEZ, I
    BORDONS, M
    SCIENTOMETRICS, 1993, 26 (01) : 157 - 167
  • [5] Self-citations and the quality of anaesthesia research
    Frerk, C.
    ANAESTHESIA, 2021, 76 (11) : 1547 - 1547
  • [6] Which scientific elites? On the concentration of research funds, publications and citations
    Lariviere, Vincent
    Macaluso, Benoit
    Archambault, Eric
    Gingras, Yves
    RESEARCH EVALUATION, 2010, 19 (01) : 45 - 53
  • [7] CITATIONS - INDICATORS OF SIGNIFICANCE
    AMSTERDAMSKA, O
    LEYDESDORFF, L
    SCIENTOMETRICS, 1989, 15 (5-6) : 449 - 471
  • [8] Citations are a good way to determine the quality of research
    Martin Caon
    Jamie Trapp
    Clive Baldock
    Physical and Engineering Sciences in Medicine, 2020, 43 : 1145 - 1148
  • [9] Citations are a good way to determine the quality of research
    Caon, Martin
    Trapp, Jamie
    Baldock, Clive
    PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2020, 43 (04) : 1145 - 1148
  • [10] CITATIONS OR JOURNAL QUALITY: WHICH IS REWARDED MORE IN THE ACADEMIC LABOR MARKET?
    Gibson, John
    Anderson, David L.
    Tressler, John
    ECONOMIC INQUIRY, 2017, 55 (04) : 1945 - 1965