AutoDep: automatic depression detection using facial expressions based on linear binary pattern descriptor

被引:17
|
作者
Tadalagi, Manjunath [1 ]
Joshi, Amit M. [2 ]
机构
[1] Malaviya Natl Inst Technol, Jaipur, Rajasthan, India
[2] Malaviya Natl Inst Technol, Dept ECE, Jaipur, Rajasthan, India
关键词
Face detection; Feature extraction; Depression level detection; Machine learning; Support vector machine; RECOGNITION; MACHINE;
D O I
10.1007/s11517-021-02358-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The psychological health of a person plays an important role in their daily life activities. The paper addresses depression issues with the machine learning model using facial expressions of the patient. Some research has already been done on visual based on depression detection methods, but those are illumination variant. The paper uses feature extraction using LBP (Local Binary Pattern) descriptor, which is illumination invariant. The Viola-Jones algorithm is used for face detection and SVM (support vector machine) is considered for classification along with the LBP descriptor to make a complete model for depression level detection. The proposed method captures frontal face from the videos of subjects and their facial features are extracted from each frame. Subsequently, the facial features are analyzed to detect depression levels with the post-processing model. The performance of the proposed system is evaluated using machine learning algorithms in MATLAB. For the real-time system design, it is necessary to test it on the hardware platform. The LBP descriptor has been implemented on FPGA using Xilinx VIVADO 16.4. The results of the proposed method show satisfactory performance and accuracy for depression detection comparison with similar previous work.
引用
收藏
页码:1339 / 1354
页数:16
相关论文
共 50 条
  • [1] AutoDep: automatic depression detection using facial expressions based on linear binary pattern descriptor
    Manjunath Tadalagi
    Amit M. Joshi
    [J]. Medical & Biological Engineering & Computing, 2021, 59 : 1339 - 1354
  • [2] AUTOMATIC DEPRESSION DETECTION VIA FACIAL EXPRESSIONS USING MULTIPLE INSTANCE LEARNING
    Wang, Yanfei
    Ma, Jie
    Hao, Bibo
    Hu, Pengwei
    Wang, Xiaoqian
    Mei, Jing
    Li, Shaochun
    [J]. 2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 1933 - 1936
  • [3] A Novel Facial Appearance Descriptor Based on Local Binary Pattern
    Zhu, Shihu
    Feng, Jufu
    [J]. PROCEEDINGS OF THE 2008 CHINESE CONFERENCE ON PATTERN RECOGNITION (CCPR 2008), 2008, : 262 - 265
  • [4] The Automatic Detection of Cognition Using EEG and Facial Expressions
    El Kerdawy, Mohamed
    El Halaby, Mohamed
    Hassan, Afnan
    Maher, Mohamed
    Fayed, Hatem
    Shawky, Doaa
    Badawi, Ashraf
    [J]. SENSORS, 2020, 20 (12) : 1 - 32
  • [5] Automatic Facial Expression Recognition Using Local Binary Pattern
    Wang, Wencheng
    Chang, Faliang
    Zhao, Jianguo
    Chen, Zhenxue
    [J]. 2010 8TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2010, : 6375 - 6378
  • [6] Detection of facial expressions of emotions in depression
    Suslow, T
    Junghanns, K
    Arolt, V
    [J]. PERCEPTUAL AND MOTOR SKILLS, 2001, 92 (03) : 857 - 868
  • [7] Recognition of Facial Expressions using Gaussian based Edge Direction and Texture Descriptor
    Revina, I. Michael
    Emmanuel, W. R. Sam
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTING AND INFORMATICS (ICICI 2017), 2017, : 99 - 103
  • [8] AUTOMATIC DETECTION OF SENTIMENTALITY FROM FACIAL EXPRESSIONS
    Bishay, Mina
    Turcot, Jay
    Page, Graham
    Mavadati, Mohammad
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 321 - 325
  • [9] TSFFM: Depression detection based on latent association of facial and body expressions
    Li, Xingyun
    Yi, Xinyu
    Lu, Lin
    Wang, Hao
    Zheng, Yunshao
    Han, Mengmeng
    Wang, Qingxiang
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 168
  • [10] Automatic Depression Analysis Using Dynamic Facial Appearance Descriptor and Dirichlet Process Fisher Encoding
    He, Lang
    Jiang, Dongmei
    Sahli, Hichem
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (06) : 1476 - 1486