The importance of situation evaluation and the ability to identify criteria in a construct-driven situational judgment test

被引:3
|
作者
Wang, Dan [1 ]
Oostrom, Janneke K. [2 ]
Schollaert, Eveline [3 ]
机构
[1] Xihua Univ, Sch Management, 999 Jin Zhou Rd, Chengdu 610039, Peoples R China
[2] Tilburg Univ, Tilburg Sch Social & Behav Sci, Dept Social Psychol, POB 90153, NL-5000 LE Tilburg, Netherlands
[3] Univ Ghent, Fac Econ & Business Adm, Dept Mkt Innovat & Org, Tweekerkenstraat 2, B-9000 Ghent, Belgium
关键词
Situational judgment test; Situational construal; Ability to identify criteria; Criterion-related validity; Trait activation theory; PERSONALITY; PERFORMANCE; CONSISTENCY; VALIDITY; MODEL; DIMENSIONS; BEHAVIOR; WORK;
D O I
10.1016/j.paid.2023.112182
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Situational judgment tests (SJTs) typically focus on candidates' judgment of various response options and ignore the process of arriving at that judgment. In three studies, we developed two situational construal measures (i.e., situation evaluation and the ability to identify criteria [ATIC]) based on a construct-driven SJT measuring cooperativeness. We tested their role in the response judgment process and examined their incremental validity in predicting work performance. Study 1 (N = 30) provided qualitative evidence that situation evaluation and ATIC shape response judgment. Study 2 (Nstudent = 136, Nemployee = 154) showed that situation evaluation predicts response judgment. Moreover, situation evaluation had incremental validity in predicting supervisorrated task performance and peer-rated interpersonal performance over and above response judgment and ATIC. Furthermore, ATIC predicted response judgment and had incremental validity in predicting interpersonal performance but not task performance over and above response judgment. Finally, Study 3 (N = 266) replicated the findings of Study 2 using a new sample and yielded similar results regardless of the order in which situation evaluation and response judgment were measured.
引用
收藏
页数:10
相关论文
共 36 条
  • [1] Effects of situation descriptions on the construct-related validity of construct-driven situational judgment tests
    Schapers, Philipp
    Freudenstein, Jan-Philipp
    Mussel, Patrick
    Lievens, Filip
    Krumm, Stefan
    [J]. JOURNAL OF RESEARCH IN PERSONALITY, 2020, 87
  • [2] Predicting undergraduate OSCE performance using traditional and construct-driven situational judgment tests at admission
    Mielke, Ina
    Breil, Simon M.
    Hissbach, Johanna
    Ehrhardt, Maren
    Knorr, Mirjana
    [J]. ADVANCES IN HEALTH SCIENCES EDUCATION, 2024,
  • [3] Construct-Driven Development of a Video-Based Situational Judgment Test for Integrity A Study in a Multi-Ethnic Police Setting
    de Meijer, Lonneke A. L.
    Born, Marise Ph.
    van Zielst, Jaap
    van der Molen, Henk T.
    [J]. EUROPEAN PSYCHOLOGIST, 2010, 15 (03) : 229 - 236
  • [4] Does the ability to identify the construct on an empathy situational judgment test relate to performance? Exploring a new concept in assessment
    Wolcott, Michael D.
    Lobczowski, Nikki G.
    Zeeman, Jacqueline M.
    McLaughlin, Jacqueline E.
    [J]. CURRENTS IN PHARMACY TEACHING AND LEARNING, 2021, 13 (11) : 1451 - 1456
  • [5] Does understanding what a test measures make a difference? On the relevance of the ability to identify criteria for situational judgment test performance
    Reznik, Nomi
    Krumm, Stefan
    Freudenstein, Jan-Philipp
    Heimann, Anna L.
    Ingold, Pia
    Schaepers, Philipp
    Kleinmann, Martin
    [J]. INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, 2024, 32 (02) : 210 - 224
  • [6] Situational judgement tests for selection: Traditional vs construct-driven approaches
    Tiffin, Paul A.
    Paton, Lewis W.
    O'Mara, Deborah
    MacCann, Carolyn
    Lang, Jonas W. B.
    Lievens, Filip
    [J]. MEDICAL EDUCATION, 2020, 54 (02) : 105 - 115
  • [7] Is it all in the eye of the beholder? The importance of situation construal for situational judgment test performance
    Freudenstein, Jan-Philipp
    Schapers, Philipp
    Roemer, Lena
    Mussel, Patrick
    Krumm, Stefan
    [J]. PERSONNEL PSYCHOLOGY, 2020, 73 (04) : 669 - 700
  • [8] Assessing distinguishable social skills in medical admission: does construct-driven development solve validity issues of situational judgment tests?
    Mielke, Ina
    Breil, Simon M.
    Amelung, Dorothee
    Espe, Lia
    Knorr, Mirjana
    [J]. BMC MEDICAL EDUCATION, 2022, 22 (01)
  • [9] Assessing distinguishable social skills in medical admission: does construct-driven development solve validity issues of situational judgment tests?
    Ina Mielke
    Simon M. Breil
    Dorothee Amelung
    Lia Espe
    Mirjana Knorr
    [J]. BMC Medical Education, 22
  • [10] The "Hot Mess" of Situational Judgment Test Construct Validity and Other Issues
    McDaniel, Michael A.
    List, Sheila K.
    Kepes, Sven
    [J]. INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY-PERSPECTIVES ON SCIENCE AND PRACTICE, 2016, 9 (01): : 47 - 51