Prediction of Communication Effectiveness During Media Skills Training Using Commercial Automatic Non-verbal Recognition Systems

被引:5
|
作者
Pereira, Monica [1 ]
Meng, Hongying [2 ]
Hone, Kate [3 ]
机构
[1] London Metropolitan Univ, Sch Social Sci, Dept Psychol, London, England
[2] Brunel Univ London, Coll Engn Design & Phys Sci, Dept Elect & Comp Engn, London, England
[3] Brunel Univ London, Coll Engn Design & Phys Sci, Dept Comp Sci, London, England
来源
FRONTIERS IN PSYCHOLOGY | 2021年 / 12卷
关键词
social signals detection; commercial technologies; communication skills; training; non-verbal signals; media interviews; multimodal fusion; FACIAL EXPRESSIONS; IMPRESSION-FORMATION; THIN SLICES; EMOTION; BEHAVIOR; ADOLESCENTS; VALIDATION; JUDGMENTS; CHILDREN;
D O I
10.3389/fpsyg.2021.675721
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
It is well recognised that social signals play an important role in communication effectiveness. Observation of videos to understand non-verbal behaviour is time-consuming and limits the potential to incorporate detailed and accurate feedback of this behaviour in practical applications such as communication skills training or performance evaluation. The aim of the current research is twofold: (1) to investigate whether off-the-shelf emotion recognition technology can detect social signals in media interviews and (2) to identify which combinations of social signals are most promising for evaluating trainees' performance in a media interview. To investigate this, non-verbal signals were automatically recognised from practice on-camera media interviews conducted within a media training setting with a sample size of 34. Automated non-verbal signal detection consists of multimodal features including facial expression, hand gestures, vocal behaviour and 'honest' signals. The on-camera interviews were categorised into effective and poor communication exemplars based on communication skills ratings provided by trainers and neutral observers which served as a ground truth. A correlation-based feature selection method was used to select signals associated with performance. To assess the accuracy of the selected features, a number of machine learning classification techniques were used. Naive Bayes analysis produced the best results with an F-measure of 0.76 and prediction accuracy of 78%. Results revealed that a combination of body movements, hand movements and facial expression are relevant for establishing communication effectiveness in the context of media interviews. The results of the current study have implications for the automatic evaluation of media interviews with a number of potential application areas including enhancing communication training including current media skills training.
引用
收藏
页数:16
相关论文
共 9 条
  • [1] Automatic non-verbal communication skills analysis: A quantitative evaluation
    Cepero, Alvaro
    Clapes, Albert
    Escalera, Sergio
    AI COMMUNICATIONS, 2015, 28 (01) : 87 - 101
  • [2] Verbal and non-verbal communication skills including empathy during history taking of undergraduate medical students
    Vogel, Daniela
    Meyer, Marco
    Harendza, Sigrid
    BMC MEDICAL EDUCATION, 2018, 18
  • [3] Verbal and non-verbal communication skills including empathy during history taking of undergraduate medical students
    Daniela Vogel
    Marco Meyer
    Sigrid Harendza
    BMC Medical Education, 18
  • [4] Improvement of Verbal and Non-Verbal Communication Skills of Children with Autism Spectrum Disorder using Human Robot Interaction
    Farhan, S. K. Adif
    Khan, Md Nasfikur Rahman
    Swaron, Mostafizur Rahman
    Shukhon, Ramendra Narayan Saha
    Islam, Md Mofijul
    Razzak, Md Abdur
    2021 IEEE WORLD AI IOT CONGRESS (AIIOT), 2021, : 356 - 359
  • [5] Trauma team leaders’ non-verbal communication: video registration during trauma team training
    Maria Härgestam
    Magnus Hultin
    Christine Brulin
    Maritha Jacobsson
    Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 24
  • [6] Trauma team leaders' non-verbal communication: video registration during trauma team training
    Hargestam, Maria
    Hultin, Magnus
    Brulin, Christine
    Jacobsson, Maritha
    SCANDINAVIAN JOURNAL OF TRAUMA RESUSCITATION & EMERGENCY MEDICINE, 2016, 24
  • [7] Developing a Proposed Training Program Based on Discrete Trial Training (DTT) to Improve the Non-verbal Communication Skills in Children with Autism Spectrum Disorder (ASD)
    Hamdan, Mohammed Akram
    INTERNATIONAL JOURNAL OF SPECIAL EDUCATION, 2018, 33 (03) : 579 - 591
  • [8] COMPUTER SUPPORT IN NON-VERBAL COMMUNICATION SYSTEMS WITH USING GRAPHIC SINGS IN EDUCATION OF PEOPLE WITH INTELLECTUAL DISABILITIES
    Gauda, Konrad
    Nowosad, Monika
    ADVANCES IN SCIENCE AND TECHNOLOGY-RESEARCH JOURNAL, 2014, 8 (24): : 76 - 82
  • [9] Using a Haptic Belt to Convey Non-Verbal Communication Cues during Social Interactions to Individuals who are Blind
    McDaniel, Troy
    Krishna, Sreekar
    Balasubramanian, Vineeth
    Colbry, Dirk
    Panchanathan, Sethuraman
    2008 IEEE INTERNATIONAL WORKSHOP ON HAPTIC AUDIO VISUAL ENVIRONMENTS AND THEIR APPLICATIONS, 2008, : 13 - 18