Robust heart-rate estimation from facial videos using Project_ICA

被引:19
|
作者
Qi, Lin [1 ]
Yu, Huidong [1 ]
Xu, Lisheng [1 ,2 ]
Mpanda, Ramadhani Selemani [1 ]
Greenwald, Stephen E. [3 ]
机构
[1] Northeastern Univ, Sino Dutch Biomed & Informat Engn Sch, Shenyang, Liaoning, Peoples R China
[2] Minist Educ, Key Lab Med Image Comp, Shenyang, Liaoning, Peoples R China
[3] Queen Mary Univ London, Barts & London Sch Med & Dent, Blizard Inst, London, England
基金
中国国家自然科学基金;
关键词
remote photoplethysmography; dichromatic reflection model; independent component analysis; MOTION-ROBUST; PULSE; NONCONTACT;
D O I
10.1088/1361-6579/ab2c9f
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
Objective: Remote photoplethysmography (rPPG) can achieve non-contact measurement of heart rate (HR) from a continuous video sequence by scanning the skin surface. However, practical applications are still limited by factors such as non-rigid facial motion and head movement. In this work, a detailed system framework for remotely estimating heart rate from facial videos under various movement conditions is described. Approach: After the rPPG signal has been obtained from a defined region of the facial skin, a method, termed 'Project_ICA', based on a skin reflection model, is employed to extract the pulse signal from the original signal. Main results: To evaluate the performance of the proposed algorithm, a dataset containing 112 videos including the challenges of various skin tones, body motion and HR recovery after exercise was created from 28 participants. Significance: The results show that Project_ICA, when evaluated by several criteria, provides a more accurate and robust estimate of HR than most existing methods, although problems remain in obtaining reliable measurements from dark-skinned subjects.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] MSDN: A Multistage Deep Network for Heart-Rate Estimation From Facial Videos
    Zhang, Xiaobiao
    Xia, Zhaoqiang
    Dai, Jing
    Liu, Lili
    Peng, Jinye
    Feng, Xiaoyi
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72 : 1 - 15
  • [2] Heart Rate Estimation from RGB Facial Videos Using Robust Face Demarcation and VMD
    Mehta, Arya Deo
    Sharma, Hemant
    [J]. 2021 NATIONAL CONFERENCE ON COMMUNICATIONS (NCC), 2021, : 587 - 592
  • [3] ROBUST ADAPTIVE HEART-RATE MONITORING USING FACE VIDEOS
    Gupta, Puneet
    Bhowmik, Brojeshwar
    Pal, Arpan
    [J]. 2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, : 530 - 538
  • [4] Robust Heart Rate Variability Measurement from Facial Videos
    Odinaev, Ismoil
    Wong, Kwan Long
    Chin, Jing Wei
    Goyal, Raghav
    Chan, Tsz Tai
    So, Richard H. Y.
    [J]. BIOENGINEERING-BASEL, 2023, 10 (07):
  • [5] Robust Heart Rate Estimation With Spatial-Temporal Attention Network From Facial Videos
    Hu, Min
    Qian, Fei
    Wang, Xiaohua
    He, Lei
    Guo, Dong
    Ren, Fuji
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (02) : 639 - 647
  • [6] Heart Rate Estimation From Facial Videos for Depression Analysis
    Mustafa, Aamir
    Bhatia, Shalini
    Hayat, Munawar
    Goecke, Roland
    [J]. 2017 SEVENTH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2017, : 498 - 503
  • [7] Heart rate estimation network from facial videos using spatiotemporal feature image
    Jaiswal, Kokila Bharti
    Meenpal, T.
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 151
  • [8] A deep learning framework for heart rate estimation from facial videos
    Hsu, Gee-Sern Jison
    Xie, Rui-Cang
    Ambikapathi, ArulMurugan
    Chou, Kae-Jy
    [J]. NEUROCOMPUTING, 2020, 417 : 155 - 166
  • [9] ACCURATE HEART-RATE ESTIMATION FROM FACE VIDEOS USING QUALITY-BASED FUSION
    Gupta, Puneet
    Bhowmick, Brojeshwar
    Pal, Arpan
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 4132 - 4136
  • [10] Heart Rate Estimation From Facial Videos Using a Spatiotemporal Representation With Convolutional Neural Networks
    Song, Rencheng
    Zhang, Senle
    Li, Chang
    Zhang, Yunfei
    Cheng, Juan
    Chen, Xun
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (10) : 7411 - 7421