Multidimensional Computerized Adaptive Testing Simulations in R

被引:0
|
作者
Araci, F. Gul Ince [1 ]
Tan, Seref [1 ]
机构
[1] Gazi Univ, Gazi Fac Educ, Dept Measurement & Evaluat Educ, Ankara, Turkey
关键词
Computerized adaptive testing; Multidimensional; R; MCAT; Simulation; SELECTION; DESIGN;
D O I
10.21449/ijate.909616
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Computerized Adaptive Testing (CAT) is a beneficial test technique that decreases the number of items that need to be administered by taking items in accordance with individuals' own ability levels. After the CAT applications were constructed based on the unidimensional Item Response Theory (IRT), Multidimensional CAT (MCAT) applications have gained momentum with the improvement of multidimensional IRT (MIRT) models in recent years. Researchers often benefit from simulation studies in order to design the final adaptive testing application and to test the effectiveness of adaptive testing applications they developed with different methods. Recently, R has become one of the most widely used programming languages in Monte Carlo Simulation studies since it is a free and open-source software. The aims of this study are to present the MCAT simulation process step by step in the R environment, to examine the effects of the conditions that researchers can handle during the simulation process according to two different dimensional models, and to examine the effect of treating multidimensional structures as unidimensional structures on simulation results. In this direction, datasets generated in accordance with within-item dimensionality and between-item dimensionality models, MCAT simulation studies were constructed with different customizations, and MCAT simulation results were compared with unidimensional CAT simulation results. All commands required for each simulation example were explained and results were shared for each condition.
引用
收藏
页码:118 / 137
页数:20
相关论文
共 50 条
  • [1] Deriving Stopping Rules for Multidimensional Computerized Adaptive Testing
    Wang, Chun
    Chang, Hua-Hua
    Boughton, Keith A.
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 2013, 37 (02) : 99 - 122
  • [2] Using Response Time in Multidimensional Computerized Adaptive Testing
    He, Yinhong
    Qi, Yuanyuan
    [J]. JOURNAL OF EDUCATIONAL MEASUREMENT, 2023, 60 (04) : 697 - 738
  • [3] Implementation and measurement efficiency of multidimensional computerized adaptive testing
    Wang, WC
    Chen, PH
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 2004, 28 (05) : 295 - 316
  • [4] Multidimensional computerized adaptive testing in a certification or licensure context
    Luecht, RM
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 1996, 20 (04) : 389 - 404
  • [5] Applying multidimensional computerized adaptive testing to the MSQOL-54
    Giordano, Andrea
    Testa, Silvia
    Bassi, Marta
    Cilia, Sabina
    Bertolotto, Antonio
    Quartuccio, Maria Esmeralda
    Pietrolongo, Erika
    Falautano, Monica
    Grobberio, Monica
    Niccolai, Claudia
    Allegri, Beatrice
    Viterbo, Rosa Gemma
    Confalonieri, Paolo
    Giovannetti, Ambra Mara
    Cocco, Eleonora
    Grasso, Maria Grazia
    Lugaresi, Alessandra
    Ferriani, Elisa
    Nocentini, Ugo
    Zaffaroni, Mauro
    De Livera, Alysha
    Jelinek, George
    Solari, Alessandra
    Rosato, Rosalba
    [J]. QUALITY OF LIFE RESEARCH, 2020, 29 (SUPPL 1) : S89 - S90
  • [6] A New Online Calibration Method for Multidimensional Computerized Adaptive Testing
    Ping Chen
    Chun Wang
    [J]. Psychometrika, 2016, 81 : 674 - 701
  • [7] A Review of SimuMCAT: A Simulation Software for Multidimensional Computerized Adaptive Testing
    Sie, Haskell
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 2015, 39 (03) : 241 - 244
  • [8] catR: An R Package for Computerized Adaptive Testing
    Magis, David
    Raiche, Gilles
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 2011, 35 (07) : 576 - 577
  • [9] A strategy for controlling item exposure in multidimensional computerized adaptive testing
    Lee, Yi-Hsuan
    Ip, Edward H.
    Fuh, Cheng-Der
    [J]. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2008, 68 (02) : 215 - 232
  • [10] Best Design for Multidimensional Computerized Adaptive Testing With the Bifactor Model
    Seo, Dong Gi
    Weiss, David J.
    [J]. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2015, 75 (06) : 954 - 978