Design of a Wearable Device for Reading Positive Expressions from Facial EMG Signals

被引:83
|
作者
Gruebler, Anna [1 ]
Suzuki, Kenji [2 ,3 ]
机构
[1] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[2] Univ Tsukuba, Ctr Cybern Res, Tsukuba, Ibaraki, Japan
[3] Japan Sci & Technol Agcy, Tokyo, Japan
关键词
Electromyography; face and gesture recognition; pattern recognition; wearable interface; RECOGNITION; DEPRESSION; BEHAVIORS; HAPPINESS; AUTISM; SCALE;
D O I
10.1109/TAFFC.2014.2313557
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present the design of a wearable device that reads positive facial expressions using physiological signals. We first analyze facial morphology in 3 dimensions and facial electromyographic signals on different facial locations and show that we can detect electromyographic signals with high amplitude on areas of low facial mobility on the side of the face, which are correlated to ones obtained from electrodes on traditional surface electromyographic capturing positions on top of facial muscles on the front of the face. We use a multi-attribute decision-making method to find adequate electrode positions on the side of face to capture these signals. Based on this analysis, we design and implement an ergonomic wearable device with high reliability. Because the signals are recorded distally, the proposed device uses independent component analysis and an artificial neural network to analyze them and achieve a high facial expression recognition rate on the side of the face. The recognized emotional facial expressions through the wearable interface device can be recorded during therapeutic interventions and for long-term facial expression recognition to quantify and infer the user's affective state in order to support medical professionals.
引用
收藏
页码:227 / 237
页数:11
相关论文
共 50 条
  • [41] The Use of a Bone-Anchored Device as a Hard-Wired Conduit for Transmitting EMG Signals From Implanted Muscle Electrodes
    Al-Ajam, Y.
    Lancashire, H.
    Pendegrass, C.
    Kang, N.
    Dowling, R. P.
    Taylor, S. J. G.
    Blunn, G.
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2013, 60 (06) : 1654 - 1659
  • [42] The sound of silence: Quantification of typical absence seizures by sonifying EEG signals from a custom-built wearable device
    Borges, Daniel Filipe
    Fernandes, Joao
    Soares, Joana Isabel
    Casalta-Lopes, Joao
    Carvalho, Daniel
    Beniczky, Sandor
    Leal, Alberto
    EPILEPTIC DISORDERS, 2024, 26 (02) : 188 - 198
  • [43] Effect of empathy trait on attention to various facial expressions: evidence from N170 and late positive potential (LPP)
    Damee Choi
    Takayuki Nishimura
    Midori Motoi
    Yuka Egashira
    Riko Matsumoto
    Shigeki Watanuki
    Journal of Physiological Anthropology, 33
  • [44] Childhood maltreatment is associated with increased neural response to ambiguous threatening facial expressions in adulthood: Evidence from the late positive potential
    Aislinn Sandre
    Paige Ethridge
    Insub Kim
    Anna Weinberg
    Cognitive, Affective, & Behavioral Neuroscience, 2018, 18 : 143 - 154
  • [45] Effect of empathy trait on attention to various facial expressions: evidence from N170 and late positive potential (LPP)
    Choi, Damee
    Nishimura, Takayuki
    Motoi, Midori
    Egashira, Yuka
    Matsumoto, Riko
    Watanuki, Shigeki
    JOURNAL OF PHYSIOLOGICAL ANTHROPOLOGY, 2014, 33
  • [46] Childhood maltreatment is associated with increased neural response to ambiguous threatening facial expressions in adulthood: Evidence from the late positive potential
    Sandre, Aislinn
    Ethridge, Paige
    Kim, Insub
    Weinberg, Anna
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2018, 18 (01) : 143 - 154
  • [47] Reading Food Experiences from the Face: Effects of Familiarity and Branding of Soy Sauce on Facial Expressions and Video-Based RPPG Heart Rate
    de Wijk, Rene A.
    Ushiama, Shota
    Ummels, Meeke
    Zimmerman, Patrick
    Kaneko, Daisuke
    Vingerhoeds, Monique H.
    FOODS, 2021, 10 (06)
  • [48] Non-contact detection of mental fatigue from facial expressions and heart signals: A self-supervised-based multimodal fusion method
    Hu, Shengjian
    Fang, Weining
    Bao, Haifeng
    Zhang, Tianlong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 105
  • [49] Smiles may go unseen in generalized social anxiety disorder: Evidence from binocular rivalry for reduced visual consciousness of positive facial expressions
    Anderson, Eric C.
    Dryman, M. Taylor
    Worthington, John
    Hoge, Elizabeth A.
    Fischer, Laura E.
    Pollack, Mark H.
    Barrett, Lisa Feldman
    Simon, Naomi M.
    JOURNAL OF ANXIETY DISORDERS, 2013, 27 (07) : 619 - 626
  • [50] Adaptive user interface design and analysis using emotion recognition through facial expressions and body posture from an RGB-D sensor
    Medjden, Selma
    Ahmed, Naveed
    Lataifeh, Mohammed
    PLOS ONE, 2020, 15 (07):