Peer review versus bibliometrics: Which method better predicts the scholarly impact of publications?

被引:31
|
作者
Abramo, Giovanni [1 ]
D'Angelo, Ciriaco Andrea [2 ]
Reale, Emanuela [3 ]
机构
[1] CNR, Inst Syst Anal & Comp Sci IASI CNR, Lab Studies Res Evaluat, Rome, Italy
[2] Univ Roma Tor Vergata, Dept Engn & Management, Rome, Italy
[3] CNR, Res Inst Sustainable Econ Growth IRCRES CNR, Rome, Italy
关键词
Research evaluation; Scientometrics; Publication quality; Scientific advancement; CITATION COUNTS; RESEARCH PERFORMANCE; SLEEPING BEAUTIES; JOURNAL METRICS; H-INDEX; INDICATORS; UNIVERSITIES; COEFFICIENT; COMBINATION; AGREEMENT;
D O I
10.1007/s11192-019-03184-y
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this work, we try to answer the question of which method, peer review versus bibliometrics, better predicts the future overall scholarly impact of scientific publications. We measure the agreement between peer review evaluations of Web of Science indexed publications submitted to the first Italian research assessment exercise and long-term citations of the same publications. We do the same for an early citation-based indicator. We find that the latter shows stronger predictive power, i.e. it more reliably predicts late citations in all the disciplinary areas examined, and for any citation time window starting 1 year after publication.
引用
收藏
页码:537 / 554
页数:18
相关论文
共 48 条
  • [31] Repeated Lung Ultrasound versus Chest X-ray-Which One Predicts Better Clinical Outcome in COVID-19?
    Spogis, Jakob
    Fusco, Stefano
    Hagen, Florian
    Kaufmann, Sascha
    Malek, Nisar
    Hoffmann, Tatjana
    [J]. TOMOGRAPHY, 2023, 9 (02) : 706 - 716
  • [32] RECTAL WALL VERSUS WHOLE RECTUM DOSE: WHICH VOLUME BETTER PREDICTS GASTROINTESTINAL TOXICITY FROM PROSTATE EXTERNAL BEAM RADIOTHERAPY?
    Khriguian, Julia
    Tsui, James Man Git
    Kucharczyk, Michael Jonathan
    Nabid, Abdenour
    Bettahar, Redouane
    Vincent, Linda Suzanne
    Martin, Andre-Guy
    Jolicoeur, Marjory
    Yassa, Michael
    Barkati, Maroie
    Igidbashian, Levon
    Bahoric, Boris
    Archambault, Robert
    Villeneuve, Hugo
    Mohiuddin, Md
    Niazi, Tamim Mohammad
    [J]. RADIOTHERAPY AND ONCOLOGY, 2019, 139 : S54 - S55
  • [33] Nutritional screening tool versus anthropometric assessment in hospitalized children: which method is better associated to clinical outcomes?
    Marquez Costa, Maria Veronica
    Pastore, Carla Alberici
    [J]. ARCHIVOS LATINOAMERICANOS DE NUTRICION, 2015, 65 (01) : 12 - 20
  • [34] Obligation versus Opportunity: Qualitative Findings from a Mixed Method Study on Staff Nurse Perceptions of Peer Review
    Fenstermacher, Kimberly
    Lampo, Deborah
    Buchko, Barbara
    Coe, Paula
    Bell, Theodore
    [J]. NURSING RESEARCH, 2017, 66 (02) : E79 - E79
  • [35] Kyphoplasty versus vertebroplasty for painful osteoporotic vertebral compression fractures-which one is better? A systematic review and meta-analysis
    Yang, Huilin
    Liu, Tao
    Zhou, Jun
    Meng, Bin
    Wang, Genlin
    Zhu, Xuesong
    [J]. INTERNATIONAL JOURNAL OF SPINE SURGERY, 2013, 7 : e45 - e57
  • [36] Surgical Treatment of Scoliosis Lenke Type 5, Anterior Versus Posterior, Which Approach is Better? A Systematic Review and Meta-Analysis
    Liang, Weishi
    Han, Bo
    Sun, Duan
    Hai, Yong
    Yin, Peng
    Liu, Yuzeng
    Yang, Jincai
    [J]. SPINE, 2023, 48 (14) : E223 - E234
  • [37] Retrieval-based learning versus discussion; which review practice will better enhance primary school students' knowledge of scientific content?
    Jakobsson, Anna
    Loberg, Jenny
    Kjork, Maria
    [J]. INTERNATIONAL JOURNAL OF SCIENCE EDUCATION, 2024, 46 (12) : 1216 - 1238
  • [38] Axial Standardized Protocol Versus "Traditional" Protocol for Prosection of Pancreatoduodenectomies: Which Method is Better? A Ten Year Experience in a Tertiary Care Center
    Ramlal, Bharat
    Timsar, Ali Kazerouni
    Ligato, Saverio
    [J]. MODERN PATHOLOGY, 2019, 32
  • [39] Axial Standardized Protocol Versus "Traditional" Protocol for Prosection of Pancreatoduodenectomies: Which Method is Better? A Ten Year Experience in a Tertiary Care Center
    Ramlal, Bharat
    Timsar, Ali Kazerouni
    Ligato, Saverio
    [J]. LABORATORY INVESTIGATION, 2019, 99
  • [40] Peer review report 1 on "Imageless navigation versus traditional method in total hip arthroplasty: A meta-analysis"
    Husein, Hasan
    [J]. INTERNATIONAL JOURNAL OF SURGERY, 2015, 13 : S121 - S121