Facial video heart rate detection based on fast-ICA and LA-Res2Net

Hanguang Xiao; Wei Zhang; Kai Chen; Xiuhong Zhu; Yuewei Li; Dasheng Zhang; Daidai Liu

doi:10.1117/12.2681100

8 June 2023 Facial video heart rate detection based on fast-ICA and LA-Res2Net

Hanguang Xiao, Wei Zhang, Kai Chen, Xiuhong Zhu, Yuewei Li, Dasheng Zhang, Daidai Liu

Proceedings Volume 12707, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023); 127071V (2023) https://doi.org/10.1117/12.2681100
Event: International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023), 2023, Changsha, China

Abstract

The majority of non-contact heart rate detection are based on pure traditional or pure deep learning methods, which struggle with high noise interference and low accuracy in complex scenes or with insufficient training data. Therefore, this paper proposes a hybrid method that combines traditional signal processing with deep learning, leveraging the complementary advantages of both, to enhance heart rate detection accuracy and robustness. First, Gaussian heatmaps are used to predict the facial keypoints for Region of Interest (ROI) localization, from which the skin color change signals of RGB channels are extracted. After using Fast-ICA to demix the pixel averages of the three channels, three independent source signals are obtained, and the signal with the highest signal-to-noise ratio is selected as the remote photoplethysmography (rPPG) signal. Then Gramian angular field method (GAF) is used to encode the feature image of rPPG signal as the input of LA-Res2Net, and finally the model can infer the heart rate after training. The effectiveness of the proposed method is verified using the VIPL-HR-V2 dataset. Experimental results show that compared with traditional image processing methods and other advanced models, the proposed method reduces the mean absolute error (MAE) from 15.2 BPM to 6.2 BPM, the root mean square error (RMSE) from 19.5 BPM to 9.1 BPM, and increases the Pearson correlation coefficient (R) from 0.22 to 0.62. This indicates that the proposed method provides a reliable solution for remote non-contact human heart rate detection.

Citation Download Citation

Hanguang Xiao, Wei Zhang, Kai Chen, Xiuhong Zhu, Yuewei Li, Dasheng Zhang, and Daidai Liu "Facial video heart rate detection based on fast-ICA and LA-Res2Net", Proc. SPIE 12707, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023), 127071V (8 June 2023); https://doi.org/10.1117/12.2681100

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Heart

Video

RGB color model

Deep learning

Skin

Feature extraction

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years