Artificial Intelligence Can Recognize Whether a Job Applicant Is Selling and/or Lying According to Facial Expressions and Head Movements Much More Correctly Than Human Interviewers

被引：0

作者：

Suen, Hung-Yue ^{[1
]}

Hung, Kuo-En ^{[1
]}

Liu, Che-Wei ^{[2
]}

Su, Yu-Sheng ^{[3
]}

Fan, Han-Chih ^{[4
]}

机构：

[1] Natl Taiwan Normal Univ, Technol Applicat & Human Resource Dev, Taipei 10610, Taiwan

[2] Indiana Univ, Kelley Sch Business, Informat Syst, Bloomington, IN 47405 USA

[3] Natl Chung Cheng Univ, Dept Comp Sci & Informat Engn, Minxiong 621301, Chiayi, Taiwan

[4] Adv Semicond Mat Lithog ASML, Hsinchu 300042, Taiwan

来源：

IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS | 2024年 / 11卷 / 05期

关键词：

3-D convolutional neural network (3D-CNN); affective computing; applicant faking; emotion sensing; FaceMesh; long short-term memory (LSTM); DECEPTION; FAKING; SYSTEM; CUES;

D O I：

10.1109/TCSS.2024.3376732

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Whether an interviewee's honest and deceptive responses can be detected by the signals of facial expressions in videos has been debated and called to be researched. We developed deep learningmodels enabled by computer vision to extract the temporal patterns of job applicants' facial expressions and head movements to identify self-reported honest and deceptive impression management (IM) tactics from video frames in real asynchronous video interviews. A 12- to 15-min video was recorded for each of the N = 121 job applicants as they answered five structured behavioral interview questions. Each applicant completed a survey to self-evaluate their trustworthiness on four IM measures. Additionally, a field experiment was conducted to compare the concurrent validity associated with self-reported IMs between our modeling and human interviewers. Human interviewers' performance in predicting these IMmeasures from another subset of 30 videos was obtained by having N = 30 human interviewers evaluate three recordings. Our models explained 91% and 84% of the variance in honest and deceptive IMs, respectively, and showed a stronger correlation with self-reported IMscores compared to human interviewers.

引用

页码：5949 / 5960

页数：12