THE ITEM RESPONSE THEORY (IRT) FOR THE ANALYSIS OF THE UNIVERSITY ENTRY TESTS

被引:0
|
作者
Tammaro, R. [1 ]
Marzano, A. [1 ]
Notti, A. [1 ]
机构
[1] Univ Salerno, Salerno, Italy
关键词
Item analysis; item response theory; classic test theory; assessment; test;
D O I
暂无
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
For several years, in our country, it is most frequently realized the need to detect, treat, analyze and interpret data and information; the need to have therefore measuring instruments suitable for the detection and the organization of all those elements through which certain phenomenon occurs. One of these tools, even if not the most used, is represented by the tests. Each year thousands of students can see opened or precluded the doors of the university by the results of a test. To make all these things there must be some specialists, as rightly pointed out Bottani (2011); to create good tests it is necessary skill and practice, which cannot be replaced by a rapid reading of instructions (Lucisano 2011). This complex and articulated operation becomes even more difficult when tests are made to select, and, as in our case, to foreclose the possible inclusion to a degree course. It is thus necessary is to verify the quality of the entry tests used in order to check their validity and reliability and to suggest any change to make them congruent to the purposes for which they were built. This means to pay attention not only to the content, the minimum knowledge, but, "above all", the part does not immediately visible and still partially neglected related to the "technical construction" of the test, that is, its accuracy, its clarity, and the perception derived. The "quality, validity and reliability" of the questions, however, are closely related to the answers provided by students. The item psychometric examination of the test is, in fact, an important step in the test's construction process. The results obtained through the item analysis will make possible the choice of questions with parameter values able to increase reliability requirements of the test and determine the level of difficulty and the discriminating capacity of it (Barbaranelli-Natali, 2005). This process of analysis can be carried out through two different approaches whose characteristics and assumptions are strongly differentiated: Classical Test Theory (CTT) and Item Response Theory (IRT). In the first one, the answers obtained are subjected to statistical analysis to highlight the items too easy or too difficult; if there are distractors which have a percentage of choice too low or too high; to check if the items are able to discriminate the candidates more competent than those less competent; to perform the appropriate calibrations in the tests. The IRT, on the other hand, allows to evaluate the performance of the subject as a function of a latent abilities through the specification of a statistical model-mathematician which allows you to reach not only the evaluation of the performance of the individual, but also the characteristics of each question. Having said that, in the research project of the present paper, the research team has decided to analyze and correlate the results of entry tests to the degree course in Primary Teach Education over the last five years by using both approaches but focusing the attention on the potential of IRT models which allow to obtain objective and universal measures transcending the context of the measurement and the instrument used.
引用
收藏
页码:79 / 89
页数:11
相关论文
共 50 条
  • [21] Using item response theory (IRT) to develop measures of asthma control.
    Ahmed, S
    Ernst, P
    Colman, N
    Tamblyn, R
    AMERICAN JOURNAL OF EPIDEMIOLOGY, 2005, 161 (11) : S70 - S70
  • [22] Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement
    Edelen, Maria Orlando
    Reeve, Bryce B.
    QUALITY OF LIFE RESEARCH, 2007, 16 (Suppl 1) : 5 - 18
  • [23] Multiple Group Item Response Theory Applications Using Stata irt Package
    Zheng, Xiaying
    Yang, Ji Seung
    MEASUREMENT-INTERDISCIPLINARY RESEARCH AND PERSPECTIVES, 2021, 19 (03) : 190 - 198
  • [24] Evaluation of Buss-Perry Aggression Questionnaire with Item Response Theory (IRT)
    Dinic, Bojana
    Janicic, Bojan
    PSIHOLOGIJA, 2012, 45 (02) : 189 - 207
  • [25] Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement
    Maria Orlando Edelen
    Bryce B. Reeve
    Quality of Life Research, 2007, 16 : 5 - 18
  • [26] An IRT forecasting model: linking proper scoring rules to item response theory
    Bo, Yuanchao Emily
    Budescu, David V.
    Lewis, Charles
    Tetlock, Philip E.
    Mellers, Barbara
    JUDGMENT AND DECISION MAKING, 2017, 12 (02): : 90 - 103
  • [27] ASSESSMENT OF DIAGNOSTICS TOOLS FOR SARCOPENIA SEVERITY USING THE ITEM RESPONSE THEORY (IRT)
    Steffl, M.
    Musalek, M.
    Kramperova, V.
    Petr, M.
    Kohlikova, E.
    Holmerova, I.
    Volicer, L.
    JOURNAL OF NUTRITION HEALTH & AGING, 2016, 20 (10): : 1051 - 1055
  • [28] Application of Item Response Theory (IRT)-Graded Response Model (GRM) to Entrepreneurial Ecosystem Scale
    Sethar, Waqar Ahmed
    Pitafi, Adnan
    Bhutto, Arabella
    Nassani, Abdelmohsen A.
    Haffar, Mohamed
    Kamran, Shah Muhammad
    SUSTAINABILITY, 2022, 14 (09)
  • [29] The Effect of Item Form on Estimating Person's Ability, Item Parameters, and Information Function According to Item Response Theory (IRT)
    ALKursheh, Taha Okleh
    Al-zboon, Habis Saad
    AlNasraween, Mo'en Salman
    INTERNATIONAL JOURNAL OF INSTRUCTION, 2022, 15 (03) : 1111 - 1130
  • [30] IRT ANALYSIS OF BINARY RESPONSE CATEGORIES IN THE 15-ITEM GDS
    Porensky, E.
    Rodebaugh, T.
    GERONTOLOGIST, 2008, 48 : 523 - 523