Rotating Item Banks versus Restriction of Maximum Exposure Rates in Computerized Adaptive Testing

被引:5
|
作者
Ramon Barrada, Juan [1 ]
Olea, Julio [2 ]
Jose Abad, Francisco [2 ]
机构
[1] Univ Autonoma Barcelona, Fac Psicol, Bellaterra 08193, Spain
[2] Univ Autonoma Madrid, E-28049 Madrid, Spain
来源
SPANISH JOURNAL OF PSYCHOLOGY | 2008年 / 11卷 / 02期
关键词
item bank security; overlap rate; accuracy; bank rotation; Sympson-Hetter method;
D O I
10.1017/S1138741600004625
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
If examinees were to know, beforehand, part of the content of a computerized adaptive test. their estimated trait levels would then have a marked positive bias. One of the strategies to avoid this consists of dividing a large item bank into several sub-banks and rotating the sub-bank employed (Ariel, Veldkamp & van der Linden, 2004). This strategy permits substantial improvements in exposure control at little cost to measurement accuracy. However, we do not know whether this option provides better results than using the master bank with greater restriction in the maximum exposure rates (Sympson & Hetter, 1985). In order to investigate this issue, we worked with several simulated banks of 2100 items, comparing them, for RMSE and overlap rate, with the same banks divided in two, three... up to seven sub-banks. By means of extensive manipulation of the maximum exposure rate in each bank, we found that the option of rotating banks slightly outperformed the option of restricting maximum exposure rate of the master bank by means of the Sympson-Hetter method.
引用
收藏
页码:618 / 625
页数:8
相关论文
共 50 条
  • [1] Multiple Maximum Exposure Rates in Computerized Adaptive Testing
    Ramon Barrada, Juan
    Veldkamp, Bernard P.
    Olea, Julio
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 2009, 33 (01) : 58 - 73
  • [2] Maximum information stratification method for controlling item exposure in computerized adaptive testing
    Barrada, JR
    Mazuela, P
    Olea, J
    [J]. PSICOTHEMA, 2006, 18 (01) : 156 - 159
  • [3] Comparison of methods for controlling maximum exposure rates in computerized adaptive testing
    Ramon Barrada, Juan
    Jose Abad, Francisco
    Veldkamp, Bernard P.
    [J]. PSICOTHEMA, 2009, 21 (02) : 313 - 320
  • [4] Predicting item exposure parameters in computerized adaptive testing
    Chen, Shu-Ying
    Doong, Shing-Hwang
    [J]. BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2008, 61 : 75 - 91
  • [5] Multistage Computerized Adaptive Testing With Uniform Item Exposure
    Edwards, Michael C.
    Flora, David B.
    Thissen, David
    [J]. APPLIED MEASUREMENT IN EDUCATION, 2012, 25 (02) : 118 - 141
  • [6] Hypergeometric family and item overlap rates in computerized adaptive testing
    Hua-Hua Chang
    Jinming Zhang
    [J]. Psychometrika, 2002, 67 : 387 - 398
  • [7] Hypergeometric family and item overlap rates in computerized adaptive testing
    Chang, HH
    Zhang, JM
    [J]. PSYCHOMETRIKA, 2002, 67 (03) : 387 - 398
  • [8] Constraining item exposure in computerized adaptive testing with shadow tests
    van der Linden, WJ
    Veldkamp, BP
    [J]. JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2004, 29 (03) : 273 - 291
  • [9] A comparison of item exposure control methods in computerized adaptive testing
    Revuelta, J
    Ponsoda, V
    [J]. JOURNAL OF EDUCATIONAL MEASUREMENT, 1998, 35 (04) : 311 - 327
  • [10] Investigating Item Exposure Control Methods in Computerized Adaptive Testing
    Ozturk, Nagihan Boztunc
    Dogan, Nuri
    [J]. EDUCATIONAL SCIENCES-THEORY & PRACTICE, 2015, 15 (01): : 85 - 98