Examinee Characteristics and their Impact on the Psychometric Properties of a Multiple Choice Test According to the Item Response Theory (IRT)

被引:16
|
作者
Almaleki, Deyab [1 ]
机构
[1] Umm Al Qura Univ, Dept Evaluat Measurement & Res, Mecca, Saudi Arabia
关键词
item response theory; item characteristics; multiple-choice; psychometric properties; FIT; DIFFICULTY; STUDENTS;
D O I
10.48084/etasr.4056
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The aim of the current study is to provide improvement evaluation practices in the educational process. A multiple choice test was developed, which was based on content analysis and the test specification table covered some of the vocabulary of the applied statistics course. The test in its final form consisted of 18 items that were reviewed by specialists in the field of statistics to determine their validity. The results determine the relationship between individual responses and the student ability. Most thresholds span the negative section of the ability. Item information curves show that the items provide a good amount of information about a student with lower or moderate ability compared to a student with high ability. In terms of precision, most items were more convenient with lower ability students. The test characteristic curve was plotted according to the change in the characteristics of the examinees. The information obtained by female students appeared to be more than the information obtained by male students and the test provided more information about students who were not studying statistics in an earlier stage compared with students who did. This test clearly indicated that, based on the level of the statistics course, there should be a periodic review of the tests in line with the nature and level of the course materials in order to have a logical judgment about the level of the students' progress at the level of their ability.
引用
收藏
页码:6889 / 6901
页数:13
相关论文
共 50 条
  • [1] The psychometric properties of the "Reading the Mind in the Eyes" Test: an item response theory (IRT) analysis
    Preti, Antonio
    Vellante, Marcello
    Petretto, Donatella R.
    [J]. COGNITIVE NEUROPSYCHIATRY, 2017, 22 (03) : 233 - 253
  • [2] The Impact of Item Format and Examinee Characteristics on Response Times
    Hess, Brian J.
    Johnston, Mary M.
    Lipner, Rebecca S.
    [J]. INTERNATIONAL JOURNAL OF TESTING, 2013, 13 (04) : 295 - 313
  • [3] ITEM ORDER, RESPONSE LOCATION AND EXAMINEE SEX AND HANDEDNESS AND PERFORMANCE ON A MULTIPLE-CHOICE TEST
    KLEINKE, DJ
    [J]. JOURNAL OF EDUCATIONAL RESEARCH, 1980, 73 (04): : 225 - 229
  • [4] Item response theory models applied to data allowing examinee choice
    Bradlow, ET
    Thomas, N
    [J]. JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 1998, 23 (03) : 236 - 243
  • [5] A new item response theory model to adjust data allowing examinee choice
    Pena, Carolina Silva
    Costa, Marcelo Azevedo
    Braga Oliveira, Rivert Paulo
    [J]. PLOS ONE, 2018, 13 (02):
  • [6] Examination of Polytomous Items' Psychometric Properties According to Nonparametric Item Response Theory Models in Different Test Conditions
    Avsar, Asiye Sengul
    Tavsancil, Ezel
    [J]. EDUCATIONAL SCIENCES-THEORY & PRACTICE, 2017, 17 (02): : 493 - 514
  • [7] Evaluation of the Psychometric Properties of the Arab Compulsive Internet Use Scale (CIUS) by Item Response Theory Modeling (IRT)
    Khazaal, Yasser
    El Abiddine, Fares Zine
    Penzenstadler, Louise
    Berbiche, Djamal
    Bteich, Ghada
    Valizadeh-Haghi, Saeideh
    Rochat, Lucien
    Achab, Sophia
    Khan, Riaz
    Chatton, Anne
    [J]. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2022, 19 (19)
  • [8] EFFECTS OF ITEM CHARACTERISTICS ON PSYCHOMETRIC PROPERTIES OF FORCED CHOICE SCALES
    DEATON, WL
    GLASNAPP, DR
    POGGIO, JP
    [J]. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1980, 40 (03) : 599 - 610
  • [9] Item Response Theory for Psychometric Properties of the SNOT-22 (22-Item Sinonasal Outcome Test)
    Liu, David T.
    Phillips, Katie M.
    Speth, Marlene M.
    Besser, Gerold
    Mueller, Christian A.
    Sedaghat, Ahmad R.
    [J]. OTOLARYNGOLOGY-HEAD AND NECK SURGERY, 2022, 166 (03) : 580 - 588
  • [10] Psychometric Properties of the Wisconsin Schizotypy Scales in an Undergraduate Sample: Classical Test Theory, Item Response Theory, and Differential Item Functioning
    Beate P. Winterstein
    Terry A. Ackerman
    Paul J. Silvia
    Thomas R. Kwapil
    [J]. Journal of Psychopathology and Behavioral Assessment, 2011, 33 : 480 - 490