Automatic Emotion Recognition in Robot-Children Interaction for ASD Treatment

被引:38
|
作者
Leo, Marco [1 ]
Del Coco, Marco [1 ]
Carcagni, Pierluigi [1 ]
Distante, Cosimo [1 ]
Bernava, Massimo [1 ]
Pioggia, Giovanni [1 ]
Palestra, Giuseppe [1 ]
机构
[1] ISASI UOS Lecce, Campus Univ Via Monteroni Sn, I-73100 Lecce, Italy
关键词
FACIAL EXPRESSION RECOGNITION; FEATURES;
D O I
10.1109/ICCVW.2015.76
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Autism Spectrum Disorders (ASD) are a group of lifelong disabilities that affect people's communication and understanding social cues. The state of the art witnesses how technology, and in particular robotics, may offer promising tools to strengthen the research and therapy of ASD. This work represents the first attempt to use machine-learning strategies during robot-ASD children interactions, in terms of facial expression imitation, making possible an objective evaluation of children's behaviours and then giving the possibility to introduce a metric about the effectiveness of the therapy. In particular, the work focuses on the basic emotion recognition skills. In addition to the aforementioned applicative innovations this work contributes also to introduce a facial expression recognition (FER) engine that automatically detects and tracks the child's face and then recognize emotions on the basis of a machine learning pipeline based on HOG descriptor and Support Vector Machines. Two different experimental sessions were carried out: the first one tested the FER engine on publicly available datasets demonstrating that the proposed pipeline outperforms the existing strategies in terms of recognition accuracy. The second one involved ASD children and it was a preliminary exploration of how the introduction of the FER engine in the therapeutic protocol can be effectively used to monitor children's behaviours.
引用
收藏
页码:537 / 545
页数:9
相关论文
共 50 条
  • [1] Do different robot appearances change emotion recognition in children with ASD?
    Pinto-Bernal, Maria. J. J.
    Sierra, Sergio. D. M. D.
    Munera, Marcela
    Casas, Diego
    Villa-Moreno, Adriana
    Frizera-Neto, Anselmo
    Stoelen, Martin. F. F.
    Belpaeme, Tony
    Cifuentes, Carlos. A. A.
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [2] Emotion Recognition of ASD Children using Wavelet Analysis
    Rashidan, M. A.
    Sidek, S. N.
    Yusof, H. M.
    Ghazali, A. S.
    Rusli, N.
    2023 32ND IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, RO-MAN, 2023, : 1705 - 1710
  • [3] A gesture recognition algorithm in a robot therapy for ASD children
    Ivani, Alessia Silvia
    Giubergia, Alice
    Santos, Laura
    Geminiani, Alice
    Annunziata, Silvia
    Caglio, Arianna
    Olivieri, Ivana
    Pedrocchi, Alessandra
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 74
  • [4] Multimodal Emotion Recognition for Human Robot Interaction
    Adiga, Sharvari
    Vaishnavi, D. V.
    Saxena, Suchitra
    ShikhaTripathi
    2020 7TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE (ISCMI 2020), 2020, : 197 - 203
  • [5] Emotion Recognition in Children and Adolescents with ASD and ADHD: a Systematic Review
    Lievore, Rachele
    Crisci, Giulia
    Mammarella, Irene C.
    REVIEW JOURNAL OF AUTISM AND DEVELOPMENTAL DISORDERS, 2023,
  • [6] Emotion Recognition in Human-Robot Interaction Using the NAO Robot
    Valagkouti, Iro Athina
    Troussas, Christos
    Krouska, Akrivi
    Feidakis, Michalis
    Sgouropoulou, Cleo
    COMPUTERS, 2022, 11 (05)
  • [7] Emotion in human-robot interaction: Recognition and display
    Wendt, Cornalia
    Kuehnlenz, Kolja
    Popp, Michael
    Karg, Michella
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2008, 43 (3-4) : 578 - 578
  • [8] Facial Emotion Recognition and Polymorphisms of Dopaminergic Pathway Genes in Children with ASD
    Liu, Zhuo
    Liu, Jun
    Zhang, Zengyu
    Yu, Hong
    Hu, Fengpei
    BEHAVIOURAL NEUROLOGY, 2020, 2020
  • [9] Emotion Recognition in Children with ASD using Technologies: A Systematic Mapping Study
    Pavez, Rodolfo
    Diaz, Jaime
    Vega, Diego
    2019 38TH INTERNATIONAL CONFERENCE OF THE CHILEAN COMPUTER SCIENCE SOCIETY (SCCC), 2019,
  • [10] Modules Of Interaction for ASD Children Using Rero Robot (Humanoid)
    Ishak, Nor Izzati
    Yusof, Hazlina Md
    Ramlee, Mohd Rais Hakim
    Sidek, Shahrul Na'im
    Rusli, Nazreen
    2019 7TH INTERNATIONAL CONFERENCE ON MECHATRONICS ENGINEERING (ICOM), 2019, : 93 - 98