Using item scores and response times in person-fit assessment

被引:4
|
作者
Gorney, Kylie [1 ]
Sinharay, Sandip [2 ]
Liu, Xiang [2 ]
机构
[1] Univ Wisconsin, 1025 W Johnson St, Madison, WI 53706 USA
[2] Educ Testing Serv, Princeton, NJ USA
关键词
aberrant behaviour; person fit; response times; APPROPRIATENESS MEASUREMENT; LOGNORMAL MODEL; STATISTICS; ACCURACY;
D O I
10.1111/bmsp.12320
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The use of joint models for item scores and response times is becoming increasingly popular in educational and psychological testing. In this paper, we propose two new person-fit statistics for such models in order to detect aberrant behaviour. The first statistic is computed by combining two existing person-fit statistics: one for the item scores, and one for the item response times. The second statistic is computed directly using the likelihood function of the joint model. Using detailed simulations, we show that the empirical null distributions of the new statistics are very close to the theoretical null distributions, and that the new statistics tend to be more powerful than several existing statistics for item scores and/or response times. A real data example is also provided using data from a licensure examination.
引用
收藏
页码:151 / 168
页数:18
相关论文
共 50 条
  • [21] The power of Rasch person-fit statistics in detecting unusual response patterns
    Li, MNF
    Olejnik, S
    APPLIED PSYCHOLOGICAL MEASUREMENT, 1997, 21 (03) : 215 - 231
  • [22] Using the Bayes Factors to Evaluate Person Fit in the Item Response Theory
    Pan, Tianshu
    Yin, Yue
    APPLIED MEASUREMENT IN EDUCATION, 2017, 30 (03) : 213 - 227
  • [23] Person-Fit to the Five Factor Model of Personality
    Allik, Jueri
    Realo, Anu
    Mottus, Rene
    Borkenau, Peter
    Kuppens, Peter
    Hrebickova, Martina
    SWISS JOURNAL OF PSYCHOLOGY, 2012, 71 (01): : 35 - 45
  • [24] A Practical Guide to Check the Consistency of Item Response Patterns in Clinical Research Through Person-Fit Statistics: Examples and a Computer Program
    Meijer, Rob R.
    Niessen, A. Susan M.
    Tendeiro, Jorge N.
    ASSESSMENT, 2016, 23 (01) : 52 - 62
  • [25] USING PERSON-FIT MEASURES TO ASSESS THE IMPACT OF PANEL CONDITIONING ON RELIABILITY
    Kroh, Martin
    Winter, Florin
    Schupp, Juergen
    PUBLIC OPINION QUARTERLY, 2016, 80 (04) : 914 - 942
  • [26] Detecting dissimulation in personality test scores: A comparison between person-fit indices and detection scales
    Ferrando, PJ
    Chico, E
    EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2001, 61 (06) : 997 - 1012
  • [27] Using multilevel logistic regression to evaluate person-fit in IRT models
    Reise, SP
    MULTIVARIATE BEHAVIORAL RESEARCH, 2000, 35 (04) : 543 - 568
  • [28] Efficient Corrections for Standardized Person-Fit Statistics
    Gorney, Kylie
    Sinharay, Sandip
    Eckerly, Carol
    PSYCHOMETRIKA, 2024, 89 (02) : 569 - 591
  • [29] Comparing Person-Fit and Traditional Indices Across Careless Response Patterns in Surveys
    Jones, Eli A. A.
    Wind, Stefanie A. A.
    Tsai, Chia-Lin
    Ge, Yuan
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2023, 47 (5-6) : 365 - 385
  • [30] Some Statistics for Assessing Person-Fit Based on Continuous-Response Models
    Ferrando, Pere Joan
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2010, 34 (04) : 219 - 237