Validation of a developed university placement test using classical test theory and Rasch measurement approach

被引:2
|
作者
Bichi, Ado Abdu [1 ]
Talib, Rohaya [1 ]
Atan, Noor Azean [1 ]
Ibrahim, Halijah [1 ]
Yusof, Sanitah Mohd [1 ]
机构
[1] Univ Teknol Malaysia, Sch Educ, Jahor Bahru 81310, Malaysia
关键词
Rash model; Classical test theory; Validity; Placement test; Item response theory;
D O I
10.21833/ijaas.2019.06.004
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
University entrances examinations are conducted to ensure qualified applicant are placed into appropriate programs of their choices. The outcomes of the test have an important and significant value in taking appropriate decision on the applicant's eligibility, the validity of that examination is paramount to achieving the set goal. The aim of this study is to provide empirical evidence of the construct validity of the newly developed Economics Test using traditional Classical Test Theory and Rasch Measurement Model. The developed Economics Test consists of 70 items after expert judgment and review was administered to 280 students, age 16-20 randomly selected from two public schools in Kano. The study employed a CTT and Rasch model to analyze the data using ITEMAN 4.3 and WINSTEPS 3.72.3 software. The softwares automatically generate the recommended estimate of the parameters to judge the quality of the test items. The results of CTT identified 17 problematic items using difficulty and discriminating index. The results of Rasch showed person statistics (Separation 2.40>2.00 and reliability 0.85>0.80) and item statistics (separation 3.73>3.0 and reliability 0.93>0.8) an excellent person and item reliability. The test measures unidimensional construct supported by the raw variance of 24.9% explained by measures. Investigation of the item person map revealed that the test covered a wide range of the examinees' ability. Overall, using Rasch 10 misfitting construct irrelevant items were identified for deletion. While CTT provides information that is limited to two parameters, the Rasch results provide very detailed information on the quality of the test items. Thus both models can be integrated to generate enough evidence of validity and reliability items in the development of a standardize test. (C) 2019 The Authors. Published by IASE.
引用
收藏
页码:22 / 29
页数:8
相关论文
共 50 条
  • [1] Evaluating A Technical University's Placement Test Using The Rasch Measurement Model
    Salleh, Tuan Salwani
    Bakri, Norhayati
    Zin, Zalhan Mohd
    [J]. 4TH INTERNATIONAL CONFERENCE ON QUANTITATIVE SCIENCES AND ITS APPLICATIONS (ICOQSIA 2016), 2016, 1782
  • [2] The nutrition for sport knowledge questionnaire (NSKQ): development and validation using classical test theory and Rasch analysis
    Trakman, Gina Louise
    Forsyth, Adrienne
    Hoye, Russell
    Belski, Regina
    [J]. JOURNAL OF THE INTERNATIONAL SOCIETY OF SPORTS NUTRITION, 2017, 14
  • [3] Validation of the Danish version of the McGill Ingestive Skills Assessment using classical test theory and the Rasch model
    Hansen, Tina
    Lambert, Heather C.
    Faber, Jens
    [J]. DISABILITY AND REHABILITATION, 2012, 34 (10) : 859 - 868
  • [4] Chinese version of Yoon Critical Thinking Disposition Instrument: validation using classical test theory and Rasch analysis
    Mio Leng Au
    Yue Yi Li
    Lai Kun Tong
    Si Chen Wang
    Wai I Ng
    [J]. BMC Nursing, 22
  • [5] Chinese version of Yoon Critical Thinking Disposition Instrument: validation using classical test theory and Rasch analysis
    Au, Mio Leng
    Li, Yue Yi
    Tong, Lai Kun
    Wang, Si Chen
    Ng, Wai, I
    [J]. BMC NURSING, 2023, 22 (01)
  • [6] Rasch-Based Objective Standard Setting for University Placement Test
    Bichi, Ado Abdu
    Talib, Rohaya
    Embong, Rahimah
    Mohamed, Hasnah Binti
    Ismail, Mohd Sani
    Ibrahim, Abdallah
    [J]. EURASIAN JOURNAL OF EDUCATIONAL RESEARCH, 2019, (84): : 57 - 69
  • [7] Putting the Alzheimer's cognitive test to the test II: Rasch Measurement Theory
    Hobart, Jeremy
    Cano, Stefan
    Posner, Holly
    Selnes, Ola
    Stern, Yaakov
    Thomas, Ronald
    Zajicek, John
    [J]. ALZHEIMERS & DEMENTIA, 2013, 9 (01) : S10 - S20
  • [8] COMPLEMENTARY EVIDENCE IN THE EARLY-STAGE VALIDATION OF LANGUAGE TESTS: CLASSICAL TEST THEORY AND RASCH ANALYSES
    Weideman, Albert
    [J]. PER LINGUAM-A JOURNAL OF LANGUAGE LEARNING, 2020, 36 (02): : 57 - 75
  • [9] Patient self-report section of the ASES questionnaire: a Spanish validation study using classical test theory and the Rasch model
    Vrotsou, Kalliopi
    Cuellar, Ricardo
    Silio, Felix
    Angel Rodriguez, Miguel
    Garay, Daniel
    Busto, Gorka
    Trancho, Ziortza
    Escobar, Antonio
    [J]. HEALTH AND QUALITY OF LIFE OUTCOMES, 2016, 14
  • [10] Patient self-report section of the ASES questionnaire: a Spanish validation study using classical test theory and the Rasch model
    Kalliopi Vrotsou
    Ricardo Cuéllar
    Félix Silió
    Miguel Ángel Rodriguez
    Daniel Garay
    Gorka Busto
    Ziortza Trancho
    Antonio Escobar
    [J]. Health and Quality of Life Outcomes, 14