Assessing the Use of Aggregate Data in the Evaluation of School-Based Interventions: Implications for Evaluation Research and State Policy Regarding Public-Use Data

被引:25
|
作者
Jacob, Robin T. [1 ,2 ]
Goddard, Roger D. [3 ]
Kim, Eun Sook [4 ]
机构
[1] Univ Michigan, Inst Social Res, Ann Arbor, MI 48109 USA
[2] Univ Michigan, Sch Educ, Ann Arbor, MI 48109 USA
[3] Mid Continent Res Educ & Learning, Denver, CO USA
[4] Univ S Florida, Tampa, FL 33620 USA
关键词
MULTILEVEL ANALYSIS; STATISTICAL POWER; LEVEL; DESIGNS;
D O I
10.3102/0162373713485814
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
It is often difficult and costly to obtain individual-level student achievement data, yet, researchers are frequently reluctant to use school-level achievement data that are widely available from state websites. We argue that public-use aggregate school-level achievement data are, in fact, sufficient to address a wide range of evaluation questions and the use of this data is more appropriate than commonly thought. Specifically, we explore (a) when point estimates and standard errors differ between models that use individual student-level data and those that use aggregate school-level data, (b) the potential for conducting subgroup and nonexperimental analyses with aggregate data, and (c) the metrics that are currently available in state public-use data sets and the implications these have for analyses. © 2013 AERA.
引用
收藏
页码:44 / 66
页数:23
相关论文
共 50 条
  • [41] Advanced methodology for evaluation of driver's actual state with use of technical driving data
    Novotny, Stanislav
    Bouchner, Petr
    PROCEEDINGS OF THE 8TH WSEAS INTERNATIONAL CONFERENCE ON SYSTEMS THEORY AND SCIENTIFIC COMPUTATION (ISTAC'08): NEW ASPECTS OF SYSTEMS THEORY AND SCIENTIFIC COMPUTATION, 2008, : 160 - +
  • [42] Use of Real-World Data for the Research, Development, and Evaluation of Oncology Precision Medicines
    Lewis, Jan R. R.
    Kerridge, Ian
    Lipworth, Wendy
    JCO PRECISION ONCOLOGY, 2017, 1 : 1 - 11
  • [43] Use of exclusive data for corporate research on machine learning and artificial intelligence: Implications for innovation and competition policy
    Kwon, Seokbeom
    Porter, Alan L.
    TECHNOLOGY IN SOCIETY, 2025, 81
  • [44] Ontologies for FAIR Data in Additive Manufacturing: A Use Case-Based Evaluation
    Bjarsch, Thomas
    Drechsler, Klaus
    Schilp, Johannes
    ADVANCED ENGINEERING MATERIALS, 2025,
  • [45] AN INVIVO EVALUATION OF THE USE OF DATA-BASED RULES TO GUIDE INSTRUCTIONAL DECISIONS
    BROWDER, D
    DEMCHAK, MA
    HELLER, M
    KING, D
    JOURNAL OF THE ASSOCIATION FOR PERSONS WITH SEVERE HANDICAPS, 1989, 14 (03): : 234 - 240
  • [46] Common Factors and Common Elements: Use of Data Science-Derived Innovations to Improve School-Based Counseling
    Stephanie L. Coleman
    Contemporary School Psychology, 2018, 22 (4) : 512 - 524
  • [47] Implications of the X-car decision on use of accident data in motor vehicle defect evaluation
    Laurenza, Paul M.
    Mccarthy, Roger L.
    Journal of Products Liability, 1988, 11 (04)
  • [48] A model for evidence-based elementary school counseling: Using school data, research, and evaluation to enhance practice
    Carey, John
    Dimmitt, Carey
    ELEMENTARY SCHOOL JOURNAL, 2008, 108 (05): : 422 - 430
  • [49] The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned
    Joe, Jonathan
    Chaudhuri, Shomir
    Le, Thai
    Thompson, Hilaire
    Demiris, George
    JOURNAL OF BIOMEDICAL INFORMATICS, 2015, 56 : 284 - 291
  • [50] Climatic effects research in cultural landscape:: Evaluation of topoclimatic mapping by use remote sensing data
    Vysoudil, M
    Létal, A
    27TH INTERNATIONAL SYMPOSIUM ON REMOTE SENSING OF ENVIRONMENT, PROCEEDINGS: INFORMATION FOR SUSTAINABILITY, 1998, : 495 - 498