Construction of the Teacher Situational Judgment Test

被引:6
|
作者
Chao, Tzu-Yang [1 ]
Huang, Jia-Li [2 ]
Sung, Yao-Ting [1 ]
Kuo, Hui-Ning [3 ]
Shiu, Ming-Huei [3 ]
机构
[1] Natl Taiwan Normal Univ, Dept Educ Psychol & Counseling, Taipei, Taiwan
[2] Natl Taiwan Normal Univ, Off Teacher Educ & Careers Serv, Taipei, Taiwan
[3] Natl Taiwan Normal Univ, Res Ctr Psychol & Educ Testing, Taipei, Taiwan
来源
关键词
reliability; validity; teacher situational judgment test; item response theory; qualitative analysis;
D O I
10.6209/JORIES.2016.61(2).04
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
According to the ideal of having multiple measures of teacher education, this study developed the teacher situational judgment test (TSJT) for selecting student teachers. The TSJS was based on the hypothesis that the more similar a student's thinking is to senior and high-performing teachers, the more likely that student is to become an effective teacher. In Study 1, we collected data from 3,133 intern-teachers and teachers to determine the reliability and validity of the TSJT. On the basis of the analysis of the pilot test and formal test, we retained 75 items. Furthermore, the internal consistency reliability of three of the TSJT booklets was exceeded .7. Additionally, the Rasch model analysis showed that 90.67% of the TSJT items fit the Rasch model. In Study 2, we developed 150 new items to expand the TSJT item bank, and recruited 3,039 college students for an item analysis. Subsequently, we further retained 105 items for the TSJT item bank, totaling 180. The reliability of each booklet was between .47 and .74. For the test validity, the analysis of variances indicated that the TSJT scores of student teachers were significantly higher than those of nonstudent teachers. This provided known-group differences validity for the TSJT. Furthermore, in Study 2, we also conducted a qualitative content analysis to provide additional evidence of the construct validity. This present study discusses the development and practical applications of the TSJT.
引用
收藏
页码:85 / 117
页数:33
相关论文
共 55 条
  • [1] Arenson E. A., 1999, ANN M SACR STAT ASS
  • [2] Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions
    Chan, D
    Schmitt, N
    [J]. JOURNAL OF APPLIED PSYCHOLOGY, 1997, 82 (01) : 143 - 159
  • [3] Situational judgment and job performance
    Chan, D
    Schmitt, N
    [J]. HUMAN PERFORMANCE, 2002, 15 (03) : 233 - 254
  • [4] Chang F.-F., 2010, J ELEM ED, V35, P87, DOI DOI 10.7036/JEE.201004.0087
  • [5] Chen MY, 2005, J RES EDUC SCI, V50, P183
  • [6] OPTIMALITY OF SOME 2-ASSOCIATE-CLASS PARTIALLY BALANCED INCOMPLETE-BLOCK DESIGNS
    CHENG, CS
    BAILEY, RA
    [J]. ANNALS OF STATISTICS, 1991, 19 (03): : 1667 - 1671
  • [7] Cheng Y.-W., 2014, B ED PSYCHOL, V46, P271, DOI [10.6251/BEP.20140516, DOI 10.6251/BEP.20140516]
  • [8] Incremental validity of situational judgment tests
    Clevenger, J
    Pereira, GM
    Wiechmann, D
    Schmitt, N
    Harvey, VS
    [J]. JOURNAL OF APPLIED PSYCHOLOGY, 2001, 86 (03) : 410 - 417
  • [9] Resources, instruction, and research
    Cohen, DK
    Raudenbush, SW
    Ball, DL
    [J]. EDUCATIONAL EVALUATION AND POLICY ANALYSIS, 2003, 25 (02) : 119 - 142
  • [10] Cohen J., 1977, STAT POWER ANAL BEHA