Meta-evaluation of meta-analysis: ten appraisal questions for biologists

被引:336
|
作者
Nakagawa, Shinichi [1 ,2 ,3 ]
Noble, Daniel W. A. [1 ,2 ]
Senior, Alistair M. [4 ,5 ]
Lagisz, Malgorzata [1 ,2 ]
机构
[1] Univ New South Wales, Evolut & Ecol Res Ctr, Sydney, NSW 2052, Australia
[2] Univ New South Wales, Sch Biol Earth & Environm Sci, Sydney, NSW 2052, Australia
[3] Garvan Inst Med Res, Diabet & Metabol Div, 384 Victoria St, Sydney, NSW 2010, Australia
[4] Univ Sydney, Charles Perkins Ctr, Sydney, NSW 2006, Australia
[5] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Effect size; Biological importance; Non-independence; Meta-regression; Meta-research; Publication bias; Quantitative synthesis; Reporting bias; Statistical significance; Systematic review; PUBLICATION BIAS; LIFE EXTENSION; EFFECT SIZE; CUMULATIVE METAANALYSIS; ASSESSING HETEROGENEITY; SYSTEMATIC REVIEWS; RESPONSE RATIOS; TEMPORAL TRENDS; MASS-PRODUCTION; ECOLOGY;
D O I
10.1186/s12915-017-0357-7
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Meta-analysis is a statistical procedure for analyzing the combined data from different studies, and can be a major source of concise up-to-date information. The overall conclusions of a meta-analysis, however, depend heavily on the quality of the meta-analytic process, and an appropriate evaluation of the quality of metaanalysis (meta-evaluation) can be challenging. We outline ten questions biologists can ask to critically appraise a meta-analysis. These questions could also act as simple and accessible guidelines for the authors of meta-analyses. We focus on meta-analyses using nonhuman species, which we term 'biological' metaanalysis. Our ten questions are aimed at enabling a biologist to evaluate whether a biological meta-analysis embodies 'mega-enlightenment', a 'mega-mistake', or something in between.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Meta-evaluation of meta-analysis: ten appraisal questions for biologists
    Shinichi Nakagawa
    Daniel W. A. Noble
    Alistair M. Senior
    Malgorzata Lagisz
    [J]. BMC Biology, 15
  • [2] Development of a Meta-Evaluation Rubric and Meta-Evaluation of Initial Teacher Education Programs
    Burakgazi, Sevinc Gelmez
    Karsantik, Yasemin
    [J]. EGITIM VE BILIM-EDUCATION AND SCIENCE, 2024, 49 (217): : 225 - 248
  • [3] CALCIUM-BASED CARIES PREVENTIVE AGENTS: A META-EVALUATION OF SYSTEMATIC REVIEWS AND META-ANALYSIS
    Bijle, Mohammed Nadeem Ahmed
    Yiu, Cynthia Kar Yung
    Ekambaram, Manikandan
    [J]. JOURNAL OF EVIDENCE-BASED DENTAL PRACTICE, 2018, 18 (03) : 203 - +
  • [4] Meta-evaluation: Evaluation of evaluations
    L. Georghiou
    [J]. Scientometrics, 1999, 45 : 523 - 530
  • [5] Meta-evaluation: Evaluation of evaluations
    Praestgaard, E
    [J]. SCIENTOMETRICS, 1999, 45 (03) : 531 - 532
  • [6] Meta-evaluation: Evaluation of evaluations
    E. Praestgaard
    [J]. Scientometrics, 1999, 45 : 531 - 532
  • [7] Questions for meta-analysis
    Sohn, D
    [J]. PSYCHOLOGICAL REPORTS, 1997, 81 (01) : 3 - 15
  • [8] Concurrent Meta-Evaluation A Critique
    Hanssen, Carl E.
    Lawrenz, Frances
    Dunet, Diane O.
    [J]. AMERICAN JOURNAL OF EVALUATION, 2008, 29 (04) : 572 - 582
  • [9] Improving the quality of evaluation participation: a meta-evaluation
    Russ-Eft, Darlene
    Preskill, Hallie
    [J]. HUMAN RESOURCE DEVELOPMENT INTERNATIONAL, 2008, 11 (01) : 35 - 50
  • [10] META-EVALUATION: EVALUATING THE EVALUATION OF THE PARIS DECLARATION
    Patton, Michael Quinn
    [J]. CANADIAN JOURNAL OF PROGRAM EVALUATION, 2012, 27 (03) : 147 - 171