Design of a Wearable Device for Reading Positive Expressions from Facial EMG Signals

被引:83
|
作者
Gruebler, Anna [1 ]
Suzuki, Kenji [2 ,3 ]
机构
[1] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[2] Univ Tsukuba, Ctr Cybern Res, Tsukuba, Ibaraki, Japan
[3] Japan Sci & Technol Agcy, Tokyo, Japan
关键词
Electromyography; face and gesture recognition; pattern recognition; wearable interface; RECOGNITION; DEPRESSION; BEHAVIORS; HAPPINESS; AUTISM; SCALE;
D O I
10.1109/TAFFC.2014.2313557
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present the design of a wearable device that reads positive facial expressions using physiological signals. We first analyze facial morphology in 3 dimensions and facial electromyographic signals on different facial locations and show that we can detect electromyographic signals with high amplitude on areas of low facial mobility on the side of the face, which are correlated to ones obtained from electrodes on traditional surface electromyographic capturing positions on top of facial muscles on the front of the face. We use a multi-attribute decision-making method to find adequate electrode positions on the side of face to capture these signals. Based on this analysis, we design and implement an ergonomic wearable device with high reliability. Because the signals are recorded distally, the proposed device uses independent component analysis and an artificial neural network to analyze them and achieve a high facial expression recognition rate on the side of the face. The recognized emotional facial expressions through the wearable interface device can be recorded during therapeutic interventions and for long-term facial expression recognition to quantify and infer the user's affective state in order to support medical professionals.
引用
收藏
页码:227 / 237
页数:11
相关论文
共 50 条
  • [11] Multimodal Emotion Recognition From EEG Signals and Facial Expressions
    Wang, Shuai
    Qu, Jingzi
    Zhang, Yong
    Zhang, Yidie
    IEEE ACCESS, 2023, 11 : 33061 - 33068
  • [12] Design and Implementation of a Multifunction Wearable Device to Monitor Sleep Physiological Signals
    Liao, Lun-De
    Wang, Yuhling
    Tsao, Yung-Chung
    Wang, I-Jan
    Jhang, De-Fu
    Chuang, Chiung-Cheng
    Chen, Sheng-Fu
    MICROMACHINES, 2020, 11 (07)
  • [13] Challenges and Emerging Trends for Machine Reading of the Mind from Facial Expressions
    Ghazouani H.
    SN Computer Science, 5 (1)
  • [14] Control over emotional facial expressions: Evidence from facial EMG and ERPs in a Stroop-like task
    Xu, Qiang
    Sommer, Werner
    Recio, Guillermo
    BIOLOGICAL PSYCHOLOGY, 2023, 181
  • [15] The impact of unconscious facial expressions on consumption behavior involves changes in positive affect: Evidence from EMG and appetitive reflex-modulation
    Starr, Mark J.
    Lin, Johnny
    Winkielman, Piotr
    PSYCHOPHYSIOLOGY, 2007, 44 : S80 - S80
  • [16] EMG-to-Speech: Direct Generation of Speech From Facial Electromyographic Signals
    Janke, Matthias
    Diener, Lorenz
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2017, 25 (12) : 2375 - 2385
  • [17] Classification of facial movements in chronic facial palsy based on intramuscular EMG signals recorded from the paretic side
    Leistritz, Lutz
    Hochreiter, Jakob
    Bachl, Fabian
    Volk, Gerd Fabian
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 662 - 665
  • [18] Designing and Evaluating a Wearable Device for Accessing Gaze Signals from the Sighted
    Qiu, Shi
    Rauterberg, Matthias
    Hu, Jun
    UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION; METHODS, TECHNIQUES, AND BEST PRACTICES, PT I, 2016, 9737 : 454 - 464
  • [19] Classifying signals from a wearable accelerometer device to measure respiratory rate
    Drummond, Gordon B.
    Fischer, Darius
    Lees, Margaret
    Bates, Andrew
    Mann, Janek
    Arvind, D. K.
    ERJ OPEN RESEARCH, 2021, 7 (02)
  • [20] Ergonomic and Human-Centered Design of Wearable Gaming Controller Using Eye Movements and Facial Expressions
    Wang, Ker-Jiun
    Zhang, Anna
    You, Kaiwen
    Chen, Fangyi
    Liu, Quanbo
    Liu, Yu
    Li, Zaiwang
    Tung, Hsiao-Wei
    Mao, Zhi-Hong
    2018 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-TAIWAN (ICCE-TW), 2018,