Evolutionary Evaluation: Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate

被引:30
|
作者
Urban, Jennifer Brown [1 ]
Hargraves, Monica [2 ]
Trochim, William M. [3 ]
机构
[1] Montclair State Univ, Dept Family & Child Studies, Montclair, NJ 07043 USA
[2] Cornell Univ, Cornell Off Res Evaluat, Ithaca, NY 14853 USA
[3] Cornell Univ, Cornell Off Res Evaluat, Dept Policy Anal & Management, Ithaca, NY 14853 USA
基金
美国国家科学基金会;
关键词
Evolutionary Evaluation; Program evolution; Evaluation design; Experimental design; Randomized controlled trial (RCT); Validity; Evidence-based program (EBP); Evolutionary theory; Developmental systems theory; Evolutionary epistemology; Lifecycles; Systems evaluation; STRUCTURED CONCEPTUALIZATION; THINKING EVALUATION; INTEGRATION; OUTCOMES;
D O I
10.1016/j.evalprogplan.2014.03.011
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of "evidence-based programs". From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:127 / 139
页数:13
相关论文
共 50 条
  • [1] A Constructive Indian Country Response to the Evidence-Based Program Mandate
    Walker, R. Dale
    Bigelow, Douglas A.
    [J]. JOURNAL OF PSYCHOACTIVE DRUGS, 2011, 43 (04) : 276 - 281
  • [2] Evidence-Based Practice? An Evolution Is Necessary for Bovine Practitioners, Teachers, and Researchers
    Vandeweerd, Jean-Michel
    Gustin, Pascal
    Buczinski, Sebastien
    [J]. VETERINARY CLINICS OF NORTH AMERICA-FOOD ANIMAL PRACTICE, 2012, 28 (01) : 133 - +
  • [3] Using Implementation Science to Improve Evidence-Based Policing: An Introduction for Researchers and Practitioners
    del Pozo, Brandon
    Belenko, Steven
    Pivovarova, Ekaterina
    Ray, Bradley
    Martins, Kaitlin F.
    Taxman, Faye S.
    [J]. POLICE QUARTERLY, 2024,
  • [4] A large-scale initiative to disseminate an evidence-based drug abuse prevention program in Italy: Lessons learned for practitioners and researchers
    Velasco, Veronica
    Griffin, Kenneth W.
    Antichi, Mariella
    Celata, Corrado
    [J]. EVALUATION AND PROGRAM PLANNING, 2015, 52 : 27 - 38
  • [5] A longitudinal multi-site evaluation of community-based partnerships: implications for researchers, funders, and communities
    Lewis, Virginia J.
    Scott, Catherine M.
    Silburn, Kate
    Miller, William L.
    [J]. HEALTH RESEARCH POLICY AND SYSTEMS, 2023, 21 (01)
  • [6] A longitudinal multi-site evaluation of community-based partnerships: implications for researchers, funders, and communities
    Virginia J. Lewis
    Catherine M. Scott
    Kate Silburn
    William L. Miller
    [J]. Health Research Policy and Systems, 21
  • [7] IMPLICATIONS OF CONTINUOUS QUALITY IMPROVEMENT FOR PROGRAM-EVALUATION AND EVALUATORS
    MARK, MM
    PINES, E
    [J]. EVALUATION PRACTICE, 1995, 16 (02): : 131 - 139
  • [8] A collaboration between practitioners, intermediaries, and researchers to increase access to evidence-based chronic pain care
    Chen, Jessica
    Glynn, Lisa
    Dawson, Timothy
    Gelman, Hannah
    Zeliadt, Steven
    [J]. IMPLEMENTATION SCIENCE, 2020, 15
  • [9] The privileged role of researchers in "evidence-based" policy: implications and engagement of other voices
    Ritter, Alison
    [J]. DRUGS AND ALCOHOL TODAY, 2015, 15 (04) : 181 - 191
  • [10] Evaluation of an evidence-based peer teaching assessment program
    Hansen, Laura B.
    McCollum, Marianne
    Paulsen, Susan M.
    Cyr, Thomas
    Jarvis, Catherine L.
    Tate, Glenda
    Altiere, Ralph J.
    [J]. AMERICAN JOURNAL OF PHARMACEUTICAL EDUCATION, 2007, 71 (03)