Quality, methods, and recommendations of systematic reviews on measures of evidence-based practice: an umbrella review

被引:4
|
作者
Roberge-Dao, Jacqueline [1 ,2 ]
Maggio, Lauren A. [3 ]
Zaccagnini, Marco [1 ,2 ]
Rochette, Annie [2 ,4 ]
Shikako-Thomas, Keiko [1 ,2 ]
Boruff, Jill [5 ]
Thomas, Aliki [1 ,2 ]
机构
[1] McGill Univ, Sch Phys & Occupat Therapy, Montreal, PQ, Canada
[2] Ctr Interdisciplinary Res Rehabil Greater Montrea, Montreal, PQ, Canada
[3] Uniformed Serv Univ Hlth Sci, Med & Hlth Profess Educ, Bethesda, MD 20814 USA
[4] Univ Montreal, Sch Rehabil, Montreal, PQ, Canada
[5] McGill Univ, Schulich Lib Phys Sci Life Sci & Engn, Montreal, PQ, Canada
基金
加拿大健康研究院;
关键词
evidence-based practice; instruments; psychometrics; systematic review; umbrella review; EVIDENCE-BASED MEDICINE; OCCUPATIONAL-THERAPY; CRITICAL-APPRAISAL; METHODOLOGICAL QUALITY; REGIONAL HOSPITALS; RESEARCH KNOWLEDGE; ATTITUDES; VALIDITY; SKILLS; INSTRUMENTS;
D O I
10.11124/JBIES-21-00118
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Objectives: The objective of the review was to estimate the quality of systematic reviews on evidence-based practice measures across health care professions and identify differences between systematic reviews regarding approaches used to assess the adequacy of evidence-based practice measures and recommended measures. Introduction: Systematic reviews on the psychometric properties of evidence-based practice measures guide researchers, clinical managers, and educators in selecting an appropriate measure for use. The lack of psychometric standards specific to evidence-based practice measures, in addition to recent findings suggesting the low methodological quality of psychometric systematic reviews, calls into question the quality and methods of systematic reviews examining evidence-based practice measures. Inclusion criteria: We included systematic reviews that identified measures that assessed evidence-based practice as a whole or of constituent parts (eg, knowledge, attitudes, skills, behaviors), and described the psychometric evidence for any health care professional group irrespective of assessment context (education or clinical practice). Methods: We searched five databases (MEDLINE, Embase, CINAHL, PsycINFO, and ERIC) on January 18, 2021. Two independent reviewers conducted screening, data extraction, and quality appraisal following the JBI approach. A narrative synthesis was performed. Results: Ten systematic reviews, published between 2006 and 2020, were included and focused on the following groups: all health care professionals (n = 3), nurses (n = 2), occupational therapists (n = 2), physical therapists (n = 1), medical students (n = 1), and family medicine residents (n = 1). The overall quality of the systematic reviews was low: none of the reviews assessed the quality of primary studies or adhered to methodological guidelines, and only one registered a protocol. Reporting of psychometric evidence and measurement characteristics differed. While all the systematic reviews discussed internal consistency, feasibility was only addressed by three. Many approaches were used to assess the adequacy of measures, and five systematic reviews referenced tools. Criteria for the adequacy of individual properties and measures varied, but mainly followed standards for patient-reported outcome measures or the Standards of Educational and Psychological Testing. There were 204 unique measures identified across 10 reviews. One review explicitly recommended measures for occupational therapists, three reviews identified adequate measures for all health care professionals, and one review identified measures for medical students. The 27 measures deemed adequate by these five systematic reviews are described. Conclusions: Our results suggest a need to improve the overall methodological quality and reporting of systematic reviews on evidence-based practice measures to increase the trustworthiness of recommendations and allow comprehensive interpretation by end users. Risk of bias is common to all the included systematic reviews, as the quality of primary studies was not assessed. The diversity of tools and approaches used to evaluate the adequacy of evidence-based practice measures reflects tensions regarding the conceptualization of validity, suggesting a need to reflect on the most appropriate application of validity theory to evidence-based practice measures. Systematic review registration number: PROSPERO CRD42020160874
引用
收藏
页码:1004 / 1073
页数:70
相关论文
共 50 条
  • [1] On systematic reviews for evidence-based practice
    Oates, Briony J.
    [J]. JOURNAL OF INFORMATION TECHNOLOGY, 2015, 30 (02) : 177 - 179
  • [2] Methods of teaching evidence-based practice: a systematic review
    Bethany Howard
    Basia Diug
    Dragan Ilic
    [J]. BMC Medical Education, 22
  • [3] Methods of teaching evidence-based practice: a systematic review
    Howard, Bethany
    Diug, Basia
    Ilic, Dragan
    [J]. BMC MEDICAL EDUCATION, 2022, 22 (01)
  • [4] Measures of knowledge and skills for evidence-based practice: A systematic review
    Glegg, Stephanie M. N.
    Holsti, Liisa
    [J]. CANADIAN JOURNAL OF OCCUPATIONAL THERAPY-REVUE CANADIENNE D ERGOTHERAPIE, 2010, 77 (04): : 219 - 232
  • [5] Evidence-Based Practice in Nephrology: Systematic Reviews
    Samuel, Joyce
    Samuels, Joshua
    [J]. ADVANCES IN CHRONIC KIDNEY DISEASE, 2012, 19 (01) : 34 - 39
  • [6] Interventions, methods and outcome measures used in teaching evidence-based practice to healthcare students: an overview of systematic reviews
    Lea D. Nielsen
    Mette M. Løwe
    Francisco Mansilla
    Rene B. Jørgensen
    Asviny Ramachandran
    Bodil B. Noe
    Heidi K. Egebæk
    [J]. BMC Medical Education, 24
  • [7] Interventions, methods and outcome measures used in teaching evidence-based practice to healthcare students: an overview of systematic reviews
    Nielsen, Lea D.
    Lowe, Mette M.
    Mansilla, Francisco
    Jorgensen, Rene B.
    Ramachandran, Asviny
    Noe, Bodil B.
    Egebaek, Heidi K.
    [J]. BMC MEDICAL EDUCATION, 2024, 24 (01)
  • [9] Systematic reviews - Their role and contribution to evidence-based practice
    Duffy, ME
    [J]. CLINICAL NURSE SPECIALIST, 2005, 19 (01) : 15 - 17
  • [10] The Role of Systematic Reviews in Teaching Evidence-Based Practice
    Hopp, Lisa
    [J]. CLINICAL NURSE SPECIALIST, 2009, 23 (06) : 321 - 322