Evaluating research: from informed peer review to bibliometrics

被引:137
|
作者
Abramo, Giovanni [1 ,2 ]
D'Angelo, Ciriaco Andrea [1 ]
机构
[1] Univ Roma Tor Vergata, Dept Management, Lab Studies Res & Technol Transfer, Sch Engn, I-00133 Rome, Italy
[2] Natl Res Council Italy, Rome, Italy
关键词
Decision support systems; Research assessment; Peer review; Bibliometrics; Research productivity; INDICATORS;
D O I
10.1007/s11192-011-0352-7
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
National research assessment exercises are becoming regular events in ever more countries. The present work contrasts the peer-review and bibliometrics approaches in the conduct of these exercises. The comparison is conducted in terms of the essential parameters of any measurement system: accuracy, robustness, validity, functionality, time and costs. Empirical evidence shows that for the natural and formal sciences, the bibliometric methodology is by far preferable to peer-review. Setting up national databases of publications by individual authors, derived from Web of Science or Scopus databases, would allow much better, cheaper and more frequent national research assessments.
引用
收藏
页码:499 / 514
页数:16
相关论文
共 50 条
  • [1] Evaluating research: from informed peer review to bibliometrics
    Giovanni Abramo
    Ciriaco Andrea D’Angelo
    [J]. Scientometrics, 2011, 87 : 499 - 514
  • [2] Informed peer review and uninformed bibliometrics?
    Neufeld, Joerg
    von Ins, Markus
    [J]. RESEARCH EVALUATION, 2011, 20 (01) : 31 - 46
  • [3] Democratising research evaluation: Achieving greater public engagement with bibliometrics-informed peer review
    Derrick, Gemma E.
    Pavone, Vincenzo
    [J]. SCIENCE AND PUBLIC POLICY, 2013, 40 (05) : 563 - 575
  • [4] On the agreement between bibliometrics and peer review: Evidence from the Italian research assessment exercises
    Baccini, Alberto
    Barabesi, Lucio
    De Nicolao, Giuseppe
    [J]. PLOS ONE, 2020, 15 (11):
  • [5] National research assessment exercises: a comparison of peer review and bibliometrics rankings
    Giovanni Abramo
    Ciriaco Andrea D’Angelo
    Flavia Di Costa
    [J]. Scientometrics, 2011, 89 : 929 - 941
  • [6] National research assessment exercises: a comparison of peer review and bibliometrics rankings
    Abramo, Giovanni
    D'Angelo, Ciriaco Andrea
    Di Costa, Flavia
    [J]. SCIENTOMETRICS, 2011, 89 (03) : 929 - 941
  • [7] Key Points of Discussion in Scientific Research Evaluation: Peer Review, Bibliometrics and Relevance
    Fernanda Sarthou, Nerina
    [J]. REVISTA DE ESTUDIOS SOCIALES, 2016, (58) : 76 - 86
  • [8] Peer-informed review
    Zare, Richard N.
    [J]. CHEMICAL & ENGINEERING NEWS, 2019, 97 (12) : 2 - 2
  • [9] Just an artifact? The concordance between peer review and bibliometrics in economics and statistics in the Italian research assessment exercise
    Baccini, Alberto
    De Nicolao, Giuseppe
    [J]. QUANTITATIVE SCIENCE STUDIES, 2022, 3 (01): : 194 - 207
  • [10] Evaluating peer review using calibrated peer review.
    Russell, AA
    Chapman, OL
    [J]. ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2001, 222 : U220 - U220