Animated videos in assessment: comparing validity evidence from and test-takers' reactions to an animated and a text-based situational judgment test

被引:7
|
作者
Karakolidis, Anastasios [1 ,2 ,3 ]
O'Leary, Michael [2 ]
Scully, Darina [2 ]
机构
[1] Educ Res Ctr, DCU St Patricks Coll Campus, Dublin, Ireland
[2] Dublin City Univ, Ctr Assessment Res Policy & Practice Educ CARPE, Dublin, Ireland
[3] Univ Nicosia, Sch Educ, Nicosia, Cyprus
关键词
Animated videos; assessment; construct-irrelevant variance; situational judgment tests; validity; COGNITIVE-ABILITY TESTS; APPLICANT REACTIONS; SELECTION PROCEDURES; TEST-PERFORMANCE; PERCEPTIONS;
D O I
10.1080/15305058.2021.1916505
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
The linguistic complexity of many text-based tests can be a source of construct-irrelevant variance, as test-takers' performance may be affected by factors that are beyond the focus of the assessment itself, such as reading comprehension skills. This experimental study examined the extent to which the use of animated videos, as opposed to written text, could (i) reduce construct-irrelevant variance attributed to language and reading skills and (ii) impact test-takers' reactions to a situational judgment test. The results indicated that the variance attributed to construct-irrelevant factors was lower by 93% in the animated version of the test. In addition, those who took the animated test perceived it to be more valid, fair, and enjoyable, than those who took the text-based test. They also rated the language used as less difficult to understand. The implications of these findings are discussed.
引用
收藏
页码:57 / 79
页数:23
相关论文
共 10 条