Automated pain detection using STA-LSTM on facial landmarks

被引:0
|
作者
Du, Tiehua [1 ]
Choo, Keng Wah [1 ]
Kong, Wai Ming [1 ]
Tan, Chin Wen [2 ]
Teo, Jing Chun [2 ]
Chan, Diana [3 ]
Sng, Ban Leong [2 ]
机构
[1] Nanyang Polytech, Singapore, Singapore
[2] KK Womens & Childrens Hosp, Singapore, Singapore
[3] Singapore Gen Hosp, Singapore, Singapore
关键词
Pain detection; STA-LSTM; Facial landmarks;
D O I
10.1145/3665065.3665072
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research introduces an advanced deep learning system that seamlessly integrates facial landmark extraction, 3D normalization, and a Spatial-Temporal Attention Long Short-Term Memory (STA-LSTM) model for accurate pain intensity level estimation. The video dataset, sourced from hospitals, underwent meticulous categorization and deidentification processes. To overcome dataset imbalances, a thoughtful sampling technique was employed. The STA-LSTM model, trained with optimized parameters, demonstrated an impressive 98% accuracy during training, and validation yielded a substantial accuracy of 92.2%. This proposed approach establishes a comprehensive framework for automated pain assessment, showcasing potential enhancements in patient care within clinical settings. Moreover, the system seamlessly integrates into a user-friendly graphical user interface (GUI).
引用
收藏
页码:36 / 40
页数:5
相关论文
共 50 条
  • [1] Automated pain detection using facial expression in adult patients with a customized spatial temporal attention long short-term memory (STA-LSTM) network
    Chin Wen Tan
    Tiehua Du
    Jing Chun Teo
    Diana Xin Hui Chan
    Wai Ming Kong
    Ban Leong Sng
    Scientific Reports, 15 (1)
  • [2] Spontaneous micro-expression recognition based on STA-LSTM
    Li D.-X.
    Chen M.-S.
    Liu Y.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2022, 52 (04): : 897 - 909
  • [3] Automated Detection of Cat Facial Landmarks
    Martvel, George
    Shimshoni, Ilan
    Zamansky, Anna
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (08) : 3103 - 3118
  • [4] 基于STA-LSTM的自发微表情识别算法
    李大湘
    陈梦思
    刘颖
    吉林大学学报(工学版), 2022, 52 (04) : 897 - 909
  • [5] Automated video-based pain recognition in cats using facial landmarks
    Martvel, George
    Lazebnik, Teddy
    Feighelstein, Marcelo
    Henze, Lea
    Meller, Sebastian
    Shimshoni, Ilan
    Twele, Friederike
    Schuetter, Alexandra
    Foraita, Nora
    Kaestner, Sabine
    Finka, Lauren
    Luna, Stelio P. L.
    Mills, Daniel S.
    Volk, Holger A.
    Zamansky, Anna
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [6] Facial Action Unit Detection using 3D Face Landmarks for Pain Detection
    Feghoul, Kevin
    Bouazizi, Mondher
    Maia, Deise Santana
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [7] Pain Detection from Facial Landmarks Using Spatial-temporal Deep Neural Network
    Choo, Keng Wah
    Du, Tiehua
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
  • [8] Driver Monitoring Using Face Detection and Facial Landmarks
    Constantin, Leonte
    Fosalau, Cristian
    Zet, Cristian
    Petrisor, Daniel
    2018 INTERNATIONAL CONFERENCE AND EXPOSITION ON ELECTRICAL AND POWER ENGINEERING (EPE), 2018, : 385 - 390
  • [9] Metrological Characterization of a Pain Detection System Based on Transfer Entropy of Facial Landmarks
    Casti, Paola
    Mencattini, Arianna
    Filippi, Joanna
    D'Orazio, Michele
    Comes, Maria Colomba
    Di Giuseppe, Davide
    Martinelli, Eugenio
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [10] Metrological Characterization of a Pain Detection System Based on Transfer Entropy of Facial Landmarks
    Casti, Paola
    Mencattini, Arianna
    Filippi, Joanna
    D'Orazio, Michele
    Comes, Maria Colomba
    Di Giuseppe, Davide
    Martinelli, Eugenio
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70