AUTOMATIC DEPRESSION DETECTION VIA FACIAL EXPRESSIONS USING MULTIPLE INSTANCE LEARNING

被引:0
|
作者
Wang, Yanfei [1 ]
Ma, Jie [1 ]
Hao, Bibo [1 ]
Hu, Pengwei [1 ]
Wang, Xiaoqian [2 ]
Mei, Jing [1 ]
Li, Shaochun [1 ]
机构
[1] IBM Res, Beijing, Peoples R China
[2] Peking Univ, Beijing, Peoples R China
关键词
depression; multiple instance learning; average pooling; visual features; mental health;
D O I
10.1109/isbi45749.2020.9098396
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Depression affects more than 300 million people around the world and is the leading cause of disability in USA for individuals ages from 15 to 44. The damage of it compares to most common diseases like cancer, diabetes, or heart disease according to the WHO report. However, people with depression symptoms sometimes do not receive proper treatment due to access barriers. In this paper, we propose a method that automatically detects depression using only landmarks of facial expressions, which are easy to collect with less privacy exposure. We deal with the coarse-grained labels i.e. one final label for the long-time series video clips, which is the common cases in applications, through the integration of feature manipulation and multiple instance learning. The effectiveness of our method is compared to other visual based methods, and our method even outperforms multi-modal methods that use multiple modalities.
引用
收藏
页码:1933 / 1936
页数:4
相关论文
共 50 条
  • [1] Dual-Stream Multiple Instance Learning for Depression Detection With Facial Expression Videos
    Shangguan, Zixuan
    Liu, Zhenyu
    Li, Gang
    Chen, Qiongqiong
    Ding, Zhijie
    Hu, Bin
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 554 - 563
  • [2] The Automatic Detection of Cognition Using EEG and Facial Expressions
    El Kerdawy, Mohamed
    El Halaby, Mohamed
    Hassan, Afnan
    Maher, Mohamed
    Fayed, Hatem
    Shawky, Doaa
    Badawi, Ashraf
    [J]. SENSORS, 2020, 20 (12) : 1 - 32
  • [3] AutoDep: automatic depression detection using facial expressions based on linear binary pattern descriptor
    Manjunath Tadalagi
    Amit M. Joshi
    [J]. Medical & Biological Engineering & Computing, 2021, 59 : 1339 - 1354
  • [4] AutoDep: automatic depression detection using facial expressions based on linear binary pattern descriptor
    Tadalagi, Manjunath
    Joshi, Amit M.
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2021, 59 (06) : 1339 - 1354
  • [5] Salient Object Detection via Multiple Instance Learning
    Huang, Fang
    Qi, Jinqing
    Lu, Huchuan
    Zhang, Lihe
    Ruan, Xiang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) : 1911 - 1922
  • [6] Detection of facial expressions of emotions in depression
    Suslow, T
    Junghanns, K
    Arolt, V
    [J]. PERCEPTUAL AND MOTOR SKILLS, 2001, 92 (03) : 857 - 868
  • [7] Automatic tag-to-region assignment via multiple instance learning
    Xia, Zhaoqiang
    Shen, Yi
    Feng, Xiaoyi
    Peng, Jinye
    Fan, Jianping
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (03) : 979 - 1002
  • [8] Automatic tag-to-region assignment via multiple instance learning
    Zhaoqiang Xia
    Yi Shen
    Xiaoyi Feng
    Jinye Peng
    Jianping Fan
    [J]. Multimedia Tools and Applications, 2015, 74 : 979 - 1002
  • [9] Automatic change detection of multiple facial expressions: A visual mismatch negativity study
    Xiong, Menghui
    Ding, Xiaobin
    Kang, Tiejun
    Zhao, Xin
    Zhao, Jing
    Liu, Jianyi
    [J]. NEUROPSYCHOLOGIA, 2022, 170
  • [10] AUTOMATIC DETECTION OF SENTIMENTALITY FROM FACIAL EXPRESSIONS
    Bishay, Mina
    Turcot, Jay
    Page, Graham
    Mavadati, Mohammad
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 321 - 325