Robust Non-Contact Heart Rate Detection Based on Near Infrared Video

被引:1
|
作者
Kong Lingqin [1 ,2 ,3 ]
Wu Xiaoxi [1 ]
Dong Liquan [1 ,2 ,3 ]
Zhao Yuejin [1 ,2 ,3 ]
Liu Ming [1 ,2 ,3 ]
机构
[1] Beijing Inst Technol, Sch Opt & Photon, Beijing 100081, Peoples R China
[2] Beijing Key Lab Precis Optoelect Measurement I, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Yangtze Delta Reg Acad, Jiaxing 314019, Zhejiang, Peoples R China
来源
关键词
medical optics; near-infrared video; image photoplethysmography technology; heart rate; orthogonal decomposition projection; singular value decomposition;
D O I
10.3788/CJL230946
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Objective Heart rate serves as a pivotal metric for assessing cardiovascular and cerebrovascular health. Routinely monitoring heart rate is crucial in averting cardiovascular diseases and treating chronic ailments. Image photoplethysmography (IPPG) technology enables non-invasive measurement of physiological parameters by detecting subtle changes in light intensity caused by variations in blood volume on the surface of the skin. Recently, IPPG has witnessed extensive applications in measuring diverse vital signs. However, prevailing investigations on heart rate detection using near-infrared video predominantly occur in controlled environments due to the constrained absorption of blood constituents in the near-infrared spectrum. Studies about moving objects are scant and suffer from high errors and low generalizability. This study proposes a heart rate detection method combining orthogonal projection and singular value decomposition, termed the OP-SVD method. The OP-SVD method adeptly extracts high signal-to-noise ratio IPPG signals from single-channel near-infrared facial videos, surmounting the influence of motion artifacts and achieving accurate heart rate detection. This research holds certain significance for clinical applications requiring continuous monitoring during nighttime in settings like intensive care units (ICUs) and non-contact human health monitoring during the night. Methods The proposed OP-SVD method comprises the following steps: First, the near-infrared videos underwent processing to detect and track facial landmarks. Each frame of the facial imagery is divided into N=44 regions of interest (ROI) by leveraging the positions of these facial landmarks and blood perfusion status, effectively preserving the pulse wave information. Second, spatial averaging is applied to mitigate camera quantization noise from pixels within each ROI; the resulting time-series data are concatenated to generate the raw IPPG signal matrix. The orthogonal projection algorithm is employed to eliminate motion artifacts from the raw IPPG signal matrix caused by head movement, yielding a denoised IPPG signal matrix. A fifth-order Butterworth band-pass filter is applied to each time series in the IPPG signal matrix to adapt to a broad range of normal heart rates. Additionally, a detrending filter is used to remove low-frequency drift noise from the time series. Next, the filtered IPPG signal matrix undergoes singular value decomposition for further denoising, and reconstruction is performed based on signal quality indices, yielding a clean IPPG signal matrix. Finally, the reconstructed signals are processed using a 10 s sliding window with a step size of 0.2 s to perform a fast Fourier transform (FFT). Zero-padding is applied to the windowed data to prevent spectral leakage, generating the corresponding power spectra. Heart rate estimation is obtained by identifying the frequency with the highest peak in the power spectrum. Results and Discussions The proposed OP-SVD method can achieve accurate heart rate measurements under motion conditions. Illustrated by a 30 s near-infrared video featuring a moving subject, heart rate estimation values obtained through the OP-SVD method correlate consistently with reference values (Fig. 5). Additionally, we conduct a correlation analysis between the heart rate values obtained without denoising and those estimated using the OP-SVD algorithm (Fig. 6). The heart rate estimation values from the OPSVD algorithm show a stronger concordance with the true values. It underscores that the OP-SVD method significantly improves the consistency between heart rate estimation value and true heart rate result, achieving robust heart rate measurement under motion conditions. Finally, the OP-SVD method is compared with traditional single-channel signal processing methods based on IPPG technology [single-channel filtering (SCF), empirical mode decomposition (EEMD), and single-channel independent component analysis (SCICA)]. Empirical findings substantiate that the OP-SVD-based heart rate detection method outperforms its counterparts, with a mean absolute error (MAE) of 3. 14 bit/min (Table 1). Conclusions In response to the suboptimal accuracy of video-based heart rate detection under infrared light during nighttime conditions and the prevailing challenge of achieving high-precision heart rate measurement amidst subject head movement, this study proposes the OP-SVD heart rate detection method. The proposed method combines orthogonal decomposition projection with singular value decomposition to mitigate noise stemming from head movement, facilitating high-precision and robust heart rate detection under nighttime near-infrared scenarios using video. Comparative analysis with existing classical algorithms underscores the superior performance of the proposed method, with a mean absolute error of 3.14 bit/min.
引用
收藏
页数:7
相关论文
共 20 条
  • [11] Remote Pulse Rate Measurement From Near-Infrared Videos
    Park, Sang Bae
    Kim, Gyehyun
    Baek, Hyun Jae
    Han, Jong Hee
    Kim, Joon Ho
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (08) : 1271 - 1275
  • [12] Remote plethysmographic imaging using ambient light
    Verkruysse, Wim
    Svaasand, Lars O.
    Nelson, J. Stuart
    [J]. OPTICS EXPRESS, 2008, 16 (26) : 21434 - 21445
  • [13] Fully-automatic camera-based pulse-oximetry during sleep
    Vogels, Tom
    van Gastel, Mark
    Wang, Wenjin
    de Haan, Gerard
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1430 - 1438
  • [14] Discriminative Signatures for Remote-PPG
    Wang, Wenjin
    den Brinker, Albertus C.
    de Haan, Gerard
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2020, 67 (05) : 1462 - 1473
  • [15] Algorithmic Principles of Remote PPG
    Wang, Wenjin
    den Brinker, Albertus C.
    Stuijk, Sander
    de Haan, Gerard
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (07) : 1479 - 1491
  • [16] Research on Non-Contact Heart Rate Measurement Method Based on Self-Optimizing Normalized Least Mean Square Algorithm
    Wu Fen
    Peng Li
    Han Peng
    Luo Kaiqing
    Liu Dongmei
    Qiu Jian
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (20)
  • [17] Remote Measurements of Heart and Respiration Rates for Telemedicine
    Zhao, Fang
    Li, Meng
    Qian, Yi
    Tsien, Joe Z.
    [J]. PLOS ONE, 2013, 8 (10):
  • [18] Non-Contact Skin Blood Perfusion Imaging Based on IPPG
    Zhao Li
    Zhou Peng
    Luo Jingjing
    Xi Qiang
    Yu Hui
    Guo Yi
    [J]. ACTA OPTICA SINICA, 2023, 43 (02)
  • [19] Hand-over-face occlusion and distance adaptive heart rate detection based on imaging photoplethysmography and pixel distance in online learning
    Zheng, Kun
    Kong, Jianping
    Tian, Li
    Li, Bin
    Li, Hui
    Zhou, Jing
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 85
  • [20] Zhu Y, 2022, 2022 15 INT C IMAGE