Using item scores and response times in person-fit assessment

被引:4
|
作者
Gorney, Kylie [1 ]
Sinharay, Sandip [2 ]
Liu, Xiang [2 ]
机构
[1] Univ Wisconsin, 1025 W Johnson St, Madison, WI 53706 USA
[2] Educ Testing Serv, Princeton, NJ USA
关键词
aberrant behaviour; person fit; response times; APPROPRIATENESS MEASUREMENT; LOGNORMAL MODEL; STATISTICS; ACCURACY;
D O I
10.1111/bmsp.12320
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The use of joint models for item scores and response times is becoming increasingly popular in educational and psychological testing. In this paper, we propose two new person-fit statistics for such models in order to detect aberrant behaviour. The first statistic is computed by combining two existing person-fit statistics: one for the item scores, and one for the item response times. The second statistic is computed directly using the likelihood function of the joint model. Using detailed simulations, we show that the empirical null distributions of the new statistics are very close to the theoretical null distributions, and that the new statistics tend to be more powerful than several existing statistics for item scores and/or response times. A real data example is also provided using data from a licensure examination.
引用
收藏
页码:151 / 168
页数:18
相关论文
共 50 条
  • [31] Assessing person-fit on measures of typical performance
    Reise, SP
    Flannery, WP
    APPLIED MEASUREMENT IN EDUCATION, 1996, 9 (01) : 9 - 26
  • [32] A Monte Carlo Study of the Effect of Item Characteristic Curve Estimation on the Accuracy of Three Person-Fit Statistics
    St-Onge, Christina
    Valois, Pierre
    Abdous, Belkacem
    Germain, Stephane
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2009, 33 (04) : 307 - 324
  • [33] Performance of Nonparametric Person-Fit Statistics with Unfolding versus Dominance Response Models
    Reimers, Jennifer
    Turner, Ronna C.
    Tendeiro, Jorge N.
    Lo, Wen-Juo
    Keiffer, Elizabeth
    MEASUREMENT-INTERDISCIPLINARY RESEARCH AND PERSPECTIVES, 2023, 21 (04) : 232 - 253
  • [34] Performance of Person-Fit Statistics Under Model Misspecification
    Hong, Seong Eun
    Monroe, Scott
    Falk, Carl F.
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2020, 57 (03) : 423 - 442
  • [35] PerFit: An R Package for Person-Fit Analysis in IRT
    Tendeiro, Jorge N.
    Meijer, Rob R.
    Niessen, A. Susan M.
    JOURNAL OF STATISTICAL SOFTWARE, 2016, 74 (05): : 1 - 27
  • [36] Person-fit: relationship with four personality tests in mathematics
    Dodeen, Hamzeh
    Darabi, Maher
    RESEARCH PAPERS IN EDUCATION, 2009, 24 (01) : 115 - 126
  • [37] Aberrance Detection Powers of the BW and Person-Fit Indices
    Huang, Tsai-Wei
    EDUCATIONAL TECHNOLOGY & SOCIETY, 2012, 15 (01): : 28 - 37
  • [38] Scale Comparability Between Nonaccommodated and Accommodated Forms of a Statewide High School Assessment: Using lz Person-Fit
    Seo, Dong Gi
    Hao, Shiqi
    JOURNAL OF PSYCHOEDUCATIONAL ASSESSMENT, 2016, 34 (03) : 230 - 243
  • [39] How to Compare Parametric and Nonparametric Person-Fit Statistics Using Real Data
    Sinharay, Sandip
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2017, 54 (04) : 420 - 439
  • [40] Comparing the aberrant response detection performance of thirty-six person-fit statistics
    Karabatsos, G
    APPLIED MEASUREMENT IN EDUCATION, 2003, 16 (04) : 277 - 298