Using item scores and response times in person-fit assessment

被引:4
|
作者
Gorney, Kylie [1 ]
Sinharay, Sandip [2 ]
Liu, Xiang [2 ]
机构
[1] Univ Wisconsin, 1025 W Johnson St, Madison, WI 53706 USA
[2] Educ Testing Serv, Princeton, NJ USA
关键词
aberrant behaviour; person fit; response times; APPROPRIATENESS MEASUREMENT; LOGNORMAL MODEL; STATISTICS; ACCURACY;
D O I
10.1111/bmsp.12320
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The use of joint models for item scores and response times is becoming increasingly popular in educational and psychological testing. In this paper, we propose two new person-fit statistics for such models in order to detect aberrant behaviour. The first statistic is computed by combining two existing person-fit statistics: one for the item scores, and one for the item response times. The second statistic is computed directly using the likelihood function of the joint model. Using detailed simulations, we show that the empirical null distributions of the new statistics are very close to the theoretical null distributions, and that the new statistics tend to be more powerful than several existing statistics for item scores and/or response times. A real data example is also provided using data from a licensure examination.
引用
收藏
页码:151 / 168
页数:18
相关论文
共 50 条
  • [1] Using Item Scores and Distractors in Person-Fit Assessment
    Gorney, Kylie
    Wollack, James A.
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2023, 60 (01) : 3 - 27
  • [2] Nonparametric person-fit analysis of polytomous item scores
    Emons, Wilco H. M.
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2008, 32 (03) : 224 - 247
  • [3] A New Person-Fit Statistic for the Lognormal Model for Response Times
    Sinharay, Sandip
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2018, 55 (04) : 457 - 476
  • [4] Diagnosing item score patterns on a test using item response theory-based person-fit statistics
    Meijer, RR
    PSYCHOLOGICAL METHODS, 2003, 8 (01) : 72 - 87
  • [5] The person response function as a tool in person-fit research
    Sijtsma, K
    Meijer, RR
    PSYCHOMETRIKA, 2001, 66 (02) : 191 - 207
  • [6] The person response function as a tool in person-fit research
    Klaas Sijtsma
    Rob R. Meijer
    Psychometrika, 2001, 66 : 191 - 207
  • [7] Graphical procedures for assessing person-fit in item factor analysis
    Ferrando Piera, Pere Joan
    Morales Vives, Fabia
    PSICOTHEMA, 2010, 22 (02) : 348 - 354
  • [8] A comparison of the person response function and the lz person-fit statistic
    Nering, ML
    Meijer, RR
    APPLIED PSYCHOLOGICAL MEASUREMENT, 1998, 22 (01) : 53 - 69
  • [9] Global, local, and graphical person-fit analysis using person-response functions
    Emons, WHM
    Sijtsma, K
    Meijer, RR
    PSYCHOLOGICAL METHODS, 2005, 10 (01) : 101 - 119
  • [10] PERSON-FIT STATISTICS: A USEFUL TOOL FOR FORMATIVE ASSESSMENT
    Fuentes, Marta
    Doval, Eduardo
    Dolors Riba, M.
    Renom, Jordi
    EDULEARN15: 7TH INTERNATIONAL CONFERENCE ON EDUCATION AND NEW LEARNING TECHNOLOGIES, 2015, : 5905 - 5909