A Multi-Rater Latent Growth Curve Model

被引:2
|
作者
Soland, James [1 ,2 ]
Kuhfeld, Megan [2 ]
机构
[1] Univ Virginia, Charlottesville, VA USA
[2] NWEA, Portland, OR USA
关键词
Multiple raters; growth modeling; measurement; item response theory; MEASUREMENT INVARIANCE; INFORMANT DISCREPANCIES; FACTORIAL INVARIANCE; MULTIMETHOD; CONSTRUCT; VALIDITY; DEPRESSION; CHILD;
D O I
10.1080/00273171.2021.1925076
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
To avoid the subjectivity of having a single person evaluate a construct of interest (e.g., a student's self-efficacy in school), multiple raters are often used. Increasingly, data that use multiple raters to evaluate psychological and social-emotional constructs over time are available. While a range of models to address measurement issues that arise when using multiple raters have been presented, including a small number for longitudinal data, few if any models are available to estimate growth in the presence of multiple raters. In this study, we provide a model that removes all but the shared perceptions of raters at a given timepoint (i.e., removes unique rater variance), then adds on a latent growth curve model across timepoints. Through simulation and empirical studies, we examine the performance of the model in terms of recovering true growth parameters, and relative to more crude approaches like estimating growth based on a single rater. Our results indicate that the model we propose performs quite well along these dimensions, and shows promise for use by researchers who want to estimate growth based on longitudinal multi-rater data.
引用
收藏
页码:701 / 717
页数:17
相关论文
共 50 条
  • [1] Latent Class Models Approach to the Multi-rater Agreement
    Yilmaz, Ayfer Ezgi
    Aktas, Serpil
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS, 2018, 57 (02): : 172 - 184
  • [2] Multi-Rater Feedback
    Supervision, 3 (25):
  • [3] Inequalities between multi-rater kappas
    Warrens, Matthijs J.
    ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2010, 4 (04) : 271 - 286
  • [4] Analyzing Stability and Change in Dyadic Attachment: The Multi-Rater Latent State-Trait Model With Autoregressive Effects
    Bohn, Johannes
    Holtmann, Jana
    Ulitzsch, Esther
    Koch, Tobias
    Luhmann, Maike
    Eid, Michael
    FRONTIERS IN PSYCHOLOGY, 2021, 12
  • [5] Inequalities between multi-rater kappas
    Matthijs J. Warrens
    Advances in Data Analysis and Classification, 2010, 4 : 271 - 286
  • [6] Hubert's multi-rater kappa revisited
    Martin Andres, Antonio
    Alvarez Hernandez, Maria
    BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2020, 73 (01): : 1 - 22
  • [7] Gaming Leadership Development with Multi-rater Assessment
    Ali, Zain
    Knox, Anita
    PERFORMANCE IMPROVEMENT QUARTERLY, 2021, 34 (03) : 279 - 302
  • [8] A Multi-Rater Framework for Studying Personality: The Trait-Reputation-Identity Model
    McAbee, Samuel T.
    Connelly, Brian S.
    PSYCHOLOGICAL REVIEW, 2016, 123 (05) : 569 - 591
  • [9] Physicians' abdominal auscultation - A multi-rater agreement study
    Gade, J
    Kruse, P
    Andersen, OT
    Pedersen, SB
    Boesby, S
    SCANDINAVIAN JOURNAL OF GASTROENTEROLOGY, 1998, 33 (07) : 773 - 777
  • [10] A Multi-Occasion Multi-Rater Model of Affective Dispositions and Affective Well-Being
    Judith Gere
    Ulrich Schimmack
    Journal of Happiness Studies, 2011, 12 : 931 - 945