Automatic Emotion Recognition in Robot-Children Interaction for ASD Treatment

被引:38
|
作者
Leo, Marco [1 ]
Del Coco, Marco [1 ]
Carcagni, Pierluigi [1 ]
Distante, Cosimo [1 ]
Bernava, Massimo [1 ]
Pioggia, Giovanni [1 ]
Palestra, Giuseppe [1 ]
机构
[1] ISASI UOS Lecce, Campus Univ Via Monteroni Sn, I-73100 Lecce, Italy
关键词
FACIAL EXPRESSION RECOGNITION; FEATURES;
D O I
10.1109/ICCVW.2015.76
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Autism Spectrum Disorders (ASD) are a group of lifelong disabilities that affect people's communication and understanding social cues. The state of the art witnesses how technology, and in particular robotics, may offer promising tools to strengthen the research and therapy of ASD. This work represents the first attempt to use machine-learning strategies during robot-ASD children interactions, in terms of facial expression imitation, making possible an objective evaluation of children's behaviours and then giving the possibility to introduce a metric about the effectiveness of the therapy. In particular, the work focuses on the basic emotion recognition skills. In addition to the aforementioned applicative innovations this work contributes also to introduce a facial expression recognition (FER) engine that automatically detects and tracks the child's face and then recognize emotions on the basis of a machine learning pipeline based on HOG descriptor and Support Vector Machines. Two different experimental sessions were carried out: the first one tested the FER engine on publicly available datasets demonstrating that the proposed pipeline outperforms the existing strategies in terms of recognition accuracy. The second one involved ASD children and it was a preliminary exploration of how the introduction of the FER engine in the therapeutic protocol can be effectively used to monitor children's behaviours.
引用
收藏
页码:537 / 545
页数:9
相关论文
共 50 条
  • [41] Emotion recognition in non-structured utterances for human-robot interaction
    Martínez, CK
    Cruz, AB
    2005 IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN), 2005, : 19 - 23
  • [42] Emotion Recognition for Human-Robot Interaction: Recent Advances and Future Perspectives
    Spezialetti, Matteo
    Placidi, Giuseppe
    Rossi, Silvia
    FRONTIERS IN ROBOTICS AND AI, 2020, 7
  • [43] A Facial Expression Emotion Recognition Based Human-robot Interaction System
    Zhentao Liu
    Min Wu
    Weihua Cao
    Luefeng Chen
    Jianping Xu
    Ri Zhang
    Mengtian Zhou
    Junwei Mao
    IEEE/CAAJournalofAutomaticaSinica, 2017, 4 (04) : 668 - 676
  • [44] An Audiovisual Child Emotion Recognition System for Child-Robot Interaction Applications
    Filntisis, Panagiotis P.
    Efthymiou, Niki
    Potamianos, Gerasimos
    Maragos, Petros
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 791 - 795
  • [45] Human-robot interaction for social skill development in children with ASD: A literature review
    Raptopoulou, Anastasia
    Komnidis, Antonios
    Bamidis, Panagiotis D.
    Astaras, Alexandros
    HEALTHCARE TECHNOLOGY LETTERS, 2021, 8 (04) : 90 - 96
  • [46] Stereotyped movement recognition in children with ASD
    Rodrigues, Jose L.
    Goncalves, Nuno
    Costa, Sandra
    Soares, Filomena
    SENSORS AND ACTUATORS A-PHYSICAL, 2013, 202 : 162 - 169
  • [47] Stereotype movement recognition in children with ASD
    Rodrigues, Jose L.
    Goncalves, Nuno
    Costa, Sandra
    Soares, Filomena
    26TH EUROPEAN CONFERENCE ON SOLID-STATE TRANSDUCERS, EUROSENSOR 2012, 2012, 47 : 668 - 671
  • [48] Evaluating the Research in Automatic Emotion Recognition
    Marrero-Fernandez, Pedro
    Montoya-Padron, Arquimedes
    Jaume-i-Capo, Antoni
    Buades Rubio, Jose Maria
    IETE TECHNICAL REVIEW, 2014, 31 (03) : 220 - 232
  • [49] Technology-Assisted Emotion Recognition for Autism Spectrum Disorder (ASD) Children: A Systematic Literature Review
    Rashidan, Mohammad Ariff
    Sidek, Shahrul Na'im
    Yusof, Hazlina Md
    Khalid, Madihah
    Dzulkarnain, Ahmad Aidil Arafat
    Ghazali, Aimi Shazwani
    Zabidi, Sarah Afiqah Mohd
    Sidique, Faizanah Abdul Alim
    IEEE ACCESS, 2021, 9 : 33638 - 33653
  • [50] Automatic Speech Emotion Recognition: A Survey
    Chandrasekar, Purnima
    Chapaneri, Santosh
    Jayaswal, Deepak
    2014 INTERNATIONAL CONFERENCE ON CIRCUITS, SYSTEMS, COMMUNICATION AND INFORMATION TECHNOLOGY APPLICATIONS (CSCITA), 2014, : 341 - 346