Trait parameter recovery using multidimensional computerized adaptive testing in reading and mathematics

被引:23
|
作者
Li, YH
Schafer, WD
机构
[1] Prine Georges Cty Publ Sch, Dept Testing Res & Evaluat, Marlboro, MD 20772 USA
[2] Univ Maryland, College Pk, MD 20742 USA
关键词
computerized adaptive testing (CAT); item response theory (IRT); dimensionality; 0-1 linear programming; constraints; item exposure; reading assessment; mathematics assessment;
D O I
10.1177/0146621604270667
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
Under a multidimensional item response theory (MIRT) computerized adaptive testing (CAT) testing scenario, a trait estimate (theta) in one dimension will provide clues for subsequently seeking a solution in other dimensions. This feature may enhance the efficiency of MIRT CAT's item selection and its scoring algorithms compared with its counterpart, the unidimensional CAT (UCAT). The present study used existing Reading and Math test data to generate simulated item parameters. A confirmatory item factor analysis model was applied to the data using NOHARM to produce interpretable MIRT item parameters. Results showed that MIRT CAT. conditional on the constraints, was quite capable of producing accurate estimates on both measures. Compared with UCAT. MIRT CAT slightly increased the. accuracy of both trait estimates, especially for the low-level or high-level trait examinees in both measures, and reduced the rate of unused items in the item pool.
引用
收藏
页码:3 / 25
页数:23
相关论文
共 50 条
  • [41] The Optimal Design of Bifactor Multidimensional Computerized Adaptive Testing with Mixed-format Items
    Mao, Xiuzhen
    Zhang, Jiahui
    Xin, Tao
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 2022, 46 (07) : 605 - 621
  • [42] Item Selection in Multidimensional Computerized Adaptive Testing—Gaining Information from Different Angles
    Chun Wang
    Hua-Hua Chang
    [J]. Psychometrika, 2011, 76 : 363 - 384
  • [43] Item Selection and Exposure Control Methods for Computerized Adaptive Testing with Multidimensional Ranking Items
    Chen, Chia-Wen
    Wang, Wen-Chung
    Chiu, Ming Ming
    Ro, Sage
    [J]. JOURNAL OF EDUCATIONAL MEASUREMENT, 2020, 57 (02) : 343 - 369
  • [44] A Multidimensional Computerized Adaptive Testing System for Enhancing the Chinese as Second Language Proficiency Test
    Wang, Hsuan-Po
    Kuo, Bor-Chen
    Chao, Rih-Chang
    [J]. SELECTED TOPICS IN EDUCATION AND EDUCATIONAL TECHNOLOGY, 2010, : 245 - +
  • [45] Item selection methods in multidimensional computerized adaptive testing for forced-choice items using Thurstonian IRT model
    Wang, Qin
    Zheng, Yi
    Liu, Kai
    Cai, Yan
    Peng, Siwei
    Tu, Dongbo
    [J]. BEHAVIOR RESEARCH METHODS, 2024, 56 (02) : 600 - 614
  • [46] Item selection methods in multidimensional computerized adaptive testing for forced-choice items using Thurstonian IRT model
    Qin Wang
    Yi Zheng
    Kai Liu
    Yan Cai
    Siwei Peng
    Dongbo Tu
    [J]. Behavior Research Methods, 2024, 56 : 600 - 614
  • [47] Multidimensional computerized adaptive testing of the EORTC QLQ-C30: Basic developments and evaluations
    Petersen, MA
    Groenvold, M
    Aaronson, N
    Fayers, P
    Sprangers, M
    Bjorner, J
    [J]. QUALITY OF LIFE RESEARCH, 2006, 15 (03) : 315 - 329
  • [48] A comparative analysis of multidimensional computerized adaptive testing for the DASH and QuickDASH scores in Dupuytren's disease
    Harrison, Conrad
    Clelland, Andrew D.
    Davis, Tim R. C.
    Scammell, Brigitte E.
    Zhang, Weiya
    Russell, Peter
    Fullilove, Sue
    Chakrabarti, Indranil
    Davidson, Dominique
    Rodrigues, Jeremy
    [J]. JOURNAL OF HAND SURGERY-EUROPEAN VOLUME, 2022, 47 (07) : 750 - 754
  • [49] Multidimensional Computerized Adaptive Testing of the EORTC QLQ-C30: Basic Developments and Evaluations
    Morten Aa. Petersen
    Mogens Groenvold
    Neil Aaronson
    Peter Fayers
    Mirjam Sprangers
    Jakob B. Bjorner
    [J]. Quality of Life Research, 2006, 15 : 315 - 329
  • [50] Item Selection in Multidimensional Computerized Adaptive Testing-Gaining Information from Different Angles
    Wang, Chun
    Chang, Hua-Hua
    [J]. PSYCHOMETRIKA, 2011, 76 (03) : 363 - 384