Meta-evaluation of meta-analysis: ten appraisal questions for biologists

被引：336

作者：

Nakagawa, Shinichi ^{[1
,2
,3
]}

Noble, Daniel W. A. ^{[1
,2
]}

Senior, Alistair M. ^{[4
,5
]}

Lagisz, Malgorzata ^{[1
,2
]}

机构：

[1] Univ New South Wales, Evolut & Ecol Res Ctr, Sydney, NSW 2052, Australia

[2] Univ New South Wales, Sch Biol Earth & Environm Sci, Sydney, NSW 2052, Australia

[3] Garvan Inst Med Res, Diabet & Metabol Div, 384 Victoria St, Sydney, NSW 2010, Australia

[4] Univ Sydney, Charles Perkins Ctr, Sydney, NSW 2006, Australia

[5] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia

来源：

BMC BIOLOGY | 2017年 / 15卷

基金：

澳大利亚研究理事会;

关键词：

Effect size; Biological importance; Non-independence; Meta-regression; Meta-research; Publication bias; Quantitative synthesis; Reporting bias; Statistical significance; Systematic review; PUBLICATION BIAS; LIFE EXTENSION; EFFECT SIZE; CUMULATIVE METAANALYSIS; ASSESSING HETEROGENEITY; SYSTEMATIC REVIEWS; RESPONSE RATIOS; TEMPORAL TRENDS; MASS-PRODUCTION; ECOLOGY;

D O I：

10.1186/s12915-017-0357-7

中图分类号：

Q [生物科学];

学科分类号：

07 ; 0710 ; 09 ;

摘要：

Meta-analysis is a statistical procedure for analyzing the combined data from different studies, and can be a major source of concise up-to-date information. The overall conclusions of a meta-analysis, however, depend heavily on the quality of the meta-analytic process, and an appropriate evaluation of the quality of metaanalysis (meta-evaluation) can be challenging. We outline ten questions biologists can ask to critically appraise a meta-analysis. These questions could also act as simple and accessible guidelines for the authors of meta-analyses. We focus on meta-analyses using nonhuman species, which we term 'biological' metaanalysis. Our ten questions are aimed at enabling a biologist to evaluate whether a biological meta-analysis embodies 'mega-enlightenment', a 'mega-mistake', or something in between.

引用

页数：14

共 50 条

[21] Meta-evaluation: Evaluation of evaluations some points for discussion
Horvat, M
[J]. SCIENTOMETRICS, 1999, 45 (03) : 533 - 542
[22] Revisiting Meta-evaluation for Grammatical Error Correction
Kobayashi, Masamune
Mita, Masato
Komachi, Mamoru
[J]. TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2024, 12 : 837 - 855
[23] Meta-Evaluation for the Evaluation of Environmental Management: Standards and Practices
Ma, Jing
Yin, Zhaoyun
Guo, Zhengbing
[J]. SUSTAINABILITY, 2021, 13 (05) : 1 - 18
[24] Library performance continuum and the imperative of meta-evaluation
Pinto, Leonor Gaspar
[J]. PERFORMANCE MEASUREMENT AND METRICS, 2014, 15 (03) : 86 - 98
[25] The social context of performance appraisal and appraisal reactions: A meta-analysis
Pichler, Shaun
[J]. HUMAN RESOURCE MANAGEMENT, 2012, 51 (05) : 709 - 732
[26] A meta-evaluation of the quality of reporting and execution in ecological meta-analyses
Pappalardo, Paula
Song, Chao
Hungate, Bruce A.
Osenberg, Craig W.
[J]. PLOS ONE, 2023, 18 (10):
[27] Meta-Evaluation and Quality Standard of the Final Evaluation Report
Seberova, Alena
Malcik, Martin
[J]. NEW EDUCATIONAL REVIEW, 2010, 22 (3-4): : 149 - 164
[28] POLICY EVALUATION AND META-EVALUATION - THE CASE OF RURAL COOPERATIVES
APTHORPE, R
GASPER, D
[J]. WORLD DEVELOPMENT, 1982, 10 (08) : 651 - 668
[29] The 3-min appraisal of a meta-analysis
Hussain, Nasir
Bookwala, Ammar
Sancheti, Parag
Bhandari, Mohit
[J]. INDIAN JOURNAL OF ORTHOPAEDICS, 2011, 45 (01) : 4 - 5
[30] Age effects and health appraisal: A meta-analysis
Roberts, G
[J]. JOURNALS OF GERONTOLOGY SERIES B-PSYCHOLOGICAL SCIENCES AND SOCIAL SCIENCES, 1999, 54 (01): : S24 - S30

← 1 2 3 4 5 →