A Generalized Objective Function for Computer Adaptive Item Selection

被引:1
|
作者
Doran, Harold [1 ]
Yamada, Testsuhiro [1 ]
Diaz, Ted [1 ]
Gonulates, Emre [1 ]
Culver, Vanessa [1 ]
机构
[1] Human Resources Res Org HumRRO, 66 Canal Ctr Plaza 700, Alexandria, VA 22314 USA
关键词
ABILITY ESTIMATION;
D O I
10.1111/jedm.12405
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
Computer adaptive testing (CAT) is an increasingly common mode of test administration offering improved test security, better measurement precision, and the potential for shorter testing experiences. This article presents a new item selection algorithm based on a generalized objective function to support multiple types of testing conditions and principled assessment design. The generalized nature of the algorithm permits a wide array of test requirements allowing experts to define what to measure and how to measure it and the algorithm is simply a means to an end to support better construct representation. This work also emphasizes the computational algorithm and its ability to scale to support faster computing and better cost-containment in real-world applications than other CAT algorithms. We make a significant effort to consolidate all information needed to build and scale the algorithm so that expert psychometricians and software developers can use this document as a self-contained resource and specification document to build and deploy an operational CAT platform.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] OPTIMIZATION OF ITEM SELECTION IN COMPUTER ADAPTIVE TESTING
    Walter, Otto B.
    Rose, Matthias
    QUALITY OF LIFE RESEARCH, 2004, 13 (09) : 1514 - 1514
  • [2] Item Selection Methods for Computer Adaptive Testing With Passages
    Yao, Lihua
    FRONTIERS IN PSYCHOLOGY, 2019, 10
  • [3] Multi-Objective Optimization of Item Selection in Computerized Adaptive Testing
    Mujtaba, Dena F.
    Mahapatra, Nihar R.
    PROCEEDINGS OF THE 2021 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'21), 2021, : 1018 - 1026
  • [4] Stratified and Maximum Information Item Selection Procedures in Computer Adaptive Testing
    Deng, Hui
    Ansley, Timothy
    Chang, Hua-Hua
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2010, 47 (02) : 202 - 226
  • [5] A comparison of item selection strategies used in a computer adaptive test of mathematics ability
    Carlson, RD
    Suen, HK
    OBJECTIVE MEASUREMENT: THEORY INTO PRACTICE, VOL 3, 1996, : 335 - 347
  • [6] Dual-Objective Item Selection Criteria in Cognitive Diagnostic Computerized Adaptive Testing
    Kang, Hyeon-Ah
    Zhang, Susu
    Chang, Hua-Hua
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2017, 54 (02) : 165 - 183
  • [7] COMPUTER PROGRAMS FOR TEST OBJECTIVE AND ITEM BANKING
    GORTH, WP
    ALLEN, DW
    GRAYSON, A
    EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1971, 31 (01) : 245 - &
  • [8] Computer adaptive testing improved accuracy and precision of scores over random item selection in a physical functioning item bank
    Haley, Stephen M.
    Ni, Pengsheng
    Hambleton, Ronald K.
    Slavin, Mary D.
    Jette, Alan M.
    JOURNAL OF CLINICAL EPIDEMIOLOGY, 2006, 59 (11) : 1174 - 1182
  • [9] The Effects of Different Item Selection Methods on Test Information and Test Efficiency in Computer Adaptive Testing
    Kursad, Merve Sahin
    JOURNAL OF MEASUREMENT AND EVALUATION IN EDUCATION AND PSYCHOLOGY-EPOD, 2023, 14 (01): : 33 - 46
  • [10] EFFECT OF ITEM ORDER ON ITEM CALIBRATION AND ITEM BANK CONSTRUCTION FOR COMPUTER ADAPTIVE TESTS
    Walter, Otto B.
    Fliege, Herbert
    Rose, Matthias
    QUALITY OF LIFE RESEARCH, 2005, 14 (09) : 2013 - 2013