Meta-evaluation of meta-analysis: ten appraisal questions for biologists

被引:336
|
作者
Nakagawa, Shinichi [1 ,2 ,3 ]
Noble, Daniel W. A. [1 ,2 ]
Senior, Alistair M. [4 ,5 ]
Lagisz, Malgorzata [1 ,2 ]
机构
[1] Univ New South Wales, Evolut & Ecol Res Ctr, Sydney, NSW 2052, Australia
[2] Univ New South Wales, Sch Biol Earth & Environm Sci, Sydney, NSW 2052, Australia
[3] Garvan Inst Med Res, Diabet & Metabol Div, 384 Victoria St, Sydney, NSW 2010, Australia
[4] Univ Sydney, Charles Perkins Ctr, Sydney, NSW 2006, Australia
[5] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Effect size; Biological importance; Non-independence; Meta-regression; Meta-research; Publication bias; Quantitative synthesis; Reporting bias; Statistical significance; Systematic review; PUBLICATION BIAS; LIFE EXTENSION; EFFECT SIZE; CUMULATIVE METAANALYSIS; ASSESSING HETEROGENEITY; SYSTEMATIC REVIEWS; RESPONSE RATIOS; TEMPORAL TRENDS; MASS-PRODUCTION; ECOLOGY;
D O I
10.1186/s12915-017-0357-7
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Meta-analysis is a statistical procedure for analyzing the combined data from different studies, and can be a major source of concise up-to-date information. The overall conclusions of a meta-analysis, however, depend heavily on the quality of the meta-analytic process, and an appropriate evaluation of the quality of metaanalysis (meta-evaluation) can be challenging. We outline ten questions biologists can ask to critically appraise a meta-analysis. These questions could also act as simple and accessible guidelines for the authors of meta-analyses. We focus on meta-analyses using nonhuman species, which we term 'biological' metaanalysis. Our ten questions are aimed at enabling a biologist to evaluate whether a biological meta-analysis embodies 'mega-enlightenment', a 'mega-mistake', or something in between.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Meta-evaluation of the teaching evaluation system of a Mexican public university
    Delia Hernandez-Villafana, Alma
    Luna Serrano, Edna
    [J]. EDUCATION POLICY ANALYSIS ARCHIVES, 2023, 31
  • [42] Evaluation of heterogeneity in meta-analysis
    Dziri, Chadli
    [J]. COLORECTAL DISEASE, 2023, 25 (05) : 1037 - 1038
  • [43] Meta-evaluation of Online and Offline Web Search Evaluation Metrics
    Chen, Ye
    Zhou, Ke
    Liu, Yiqun
    Zhang, Min
    Ma, Shaoping
    [J]. SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, : 15 - 24
  • [44] Responsive Meta-Evaluation: A Participatory Approach to Enhancing Evaluation Quality
    Sturges, Keith M.
    Howley, Caitlin
    [J]. AMERICAN JOURNAL OF EVALUATION, 2017, 38 (01) : 126 - 137
  • [45] Meta-evaluation of a participatory process in the strengthening of municipal management
    Locatelli de Almeida, Cristiane Andrea
    Tanaka, Oswaldo Yoshimi
    [J]. REVISTA DE SAUDE PUBLICA, 2017, 51
  • [46] Parameters and paradigms for meta-evaluation: an exploratory and reflective review
    Furtado, Juarez Pereira
    Laperriere, Helene
    [J]. CIENCIA & SAUDE COLETIVA, 2012, 17 (03): : 695 - 705
  • [47] Meta-evaluation of human-agent interactions using lens model analysis
    Sawaragi, T
    Horiguchi, Y
    Suzui, Y
    [J]. SICE 2002: PROCEEDINGS OF THE 41ST SICE ANNUAL CONFERENCE, VOLS 1-5, 2002, : 1672 - 1677
  • [48] Meta-analysis: a critical appraisal of the methodology, benefits and drawbacks
    Khan, Shahjahan
    Memon, Breda
    Memon, Muhammed A.
    [J]. BRITISH JOURNAL OF HOSPITAL MEDICINE, 2019, 80 (11) : 636 - 641
  • [49] Ten simple rules for interpreting and evaluating a meta-analysis
    Carlson, Rebecca B.
    Martin, Jennifer R.
    Beckett, Robert D.
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2023, 19 (09)
  • [50] Evaluations of Rural Development Plans: a meta-evaluation study
    Fucilli, Vincenzo
    De Blasi, Giuseppe
    Monteleone, Alessandro
    [J]. AESTIMUM, 2008, : 113 - 124