Automatic Emotion Recognition in Robot-Children Interaction for ASD Treatment

被引:38
|
作者
Leo, Marco [1 ]
Del Coco, Marco [1 ]
Carcagni, Pierluigi [1 ]
Distante, Cosimo [1 ]
Bernava, Massimo [1 ]
Pioggia, Giovanni [1 ]
Palestra, Giuseppe [1 ]
机构
[1] ISASI UOS Lecce, Campus Univ Via Monteroni Sn, I-73100 Lecce, Italy
关键词
FACIAL EXPRESSION RECOGNITION; FEATURES;
D O I
10.1109/ICCVW.2015.76
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Autism Spectrum Disorders (ASD) are a group of lifelong disabilities that affect people's communication and understanding social cues. The state of the art witnesses how technology, and in particular robotics, may offer promising tools to strengthen the research and therapy of ASD. This work represents the first attempt to use machine-learning strategies during robot-ASD children interactions, in terms of facial expression imitation, making possible an objective evaluation of children's behaviours and then giving the possibility to introduce a metric about the effectiveness of the therapy. In particular, the work focuses on the basic emotion recognition skills. In addition to the aforementioned applicative innovations this work contributes also to introduce a facial expression recognition (FER) engine that automatically detects and tracks the child's face and then recognize emotions on the basis of a machine learning pipeline based on HOG descriptor and Support Vector Machines. Two different experimental sessions were carried out: the first one tested the FER engine on publicly available datasets demonstrating that the proposed pipeline outperforms the existing strategies in terms of recognition accuracy. The second one involved ASD children and it was a preliminary exploration of how the introduction of the FER engine in the therapeutic protocol can be effectively used to monitor children's behaviours.
引用
收藏
页码:537 / 545
页数:9
相关论文
共 50 条
  • [21] Effects of Emotional Music on Facial Emotion Recognition in Children with Autism Spectrum Disorder (ASD)
    Wagener, Gary L.
    Berning, Madeleine
    Costa, Andreia P.
    Steffgen, Georges
    Melzer, Andre
    JOURNAL OF AUTISM AND DEVELOPMENTAL DISORDERS, 2021, 51 (09) : 3256 - 3265
  • [22] Recognition of facial emotion and affective prosody in children with ASD ( plus ADHD) and their unaffected siblings
    Oerlemans, Anoek M.
    van der Meer, Jolanda M. J.
    van Steijn, Daphne J.
    de Ruiter, Saskia W.
    de Bruijn, Yvette G. E.
    de Sonneville, Leo M. J.
    Buitelaar, Jan K.
    Rommelse, Nanda N. J.
    EUROPEAN CHILD & ADOLESCENT PSYCHIATRY, 2014, 23 (05) : 257 - 271
  • [23] Constraints in the design of activities focusing on Emotion Recognition for children with ASD using robotic tools
    Costa, Sandra C.
    Soares, Filomena O.
    Pereira, Ana P.
    Moreira, Fatima
    2012 4TH IEEE RAS & EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL ROBOTICS AND BIOMECHATRONICS (BIOROB), 2012, : 1884 - 1889
  • [24] The role of linguistic and cognitive factors in emotion recognition difficulties in children with ASD, ADHD or DLD
    Loytomaki, Joanna
    Ohtonen, Pasi
    Laakso, Marja-Leena
    Huttunen, Kerttu
    INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS, 2020, 55 (02) : 231 - 242
  • [25] Effects of Emotional Music on Facial Emotion Recognition in Children with Autism Spectrum Disorder (ASD)
    Gary L. Wagener
    Madeleine Berning
    Andreia P. Costa
    Georges Steffgen
    André Melzer
    Journal of Autism and Developmental Disorders, 2021, 51 : 3256 - 3265
  • [26] Automatic gesture recognition for intelligent human-robot interaction
    Lee, Seong-Whan
    PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION - PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE, 2006, : 645 - 650
  • [27] Hierarchical Attention Approach in Multimodal Emotion Recognition for Human Robot Interaction
    Abdullah, Muhammad
    Ahmad, Mobeen
    Han, Dongil
    2021 36TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC), 2021,
  • [28] Multimodal emotion recognition with evolutionary computation for human-robot interaction
    Perez-Gaspar, Luis-Alberto
    Caballero-Morales, Santiago-Omar
    Trujillo-Romero, Felipe
    EXPERT SYSTEMS WITH APPLICATIONS, 2016, 66 : 42 - 61
  • [29] Emotion Recognition From Speech to Improve Human-robot Interaction
    Zhu, Changrui
    Ahamd, Wasim
    IEEE 17TH INT CONF ON DEPENDABLE, AUTONOM AND SECURE COMP / IEEE 17TH INT CONF ON PERVAS INTELLIGENCE AND COMP / IEEE 5TH INT CONF ON CLOUD AND BIG DATA COMP / IEEE 4TH CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2019, : 370 - 375
  • [30] Feature Reduction for Dimensional Emotion Recognition in Human-Robot Interaction
    Banda, Ntombikayise
    Engelbrecht, Andries
    Robinson, Peter
    2015 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2015, : 803 - 810