-
摘要:
在面部视频中提取生命体征相关的生理信号时易受环境光和受试者头部运动的影响,为了降低外界干扰并提高生命体征检测的准确度,提出了一种联合集合经验模态分解(EEMD)算法与信号质量检测的面部视频分析方法,用于精确检测人体的心率与呼吸频率等生命体征。通过公开数据集进行实验验证,实验结果表明,所提方法相较于目前已有的常用信号处理方法能够得到更精确的心率与呼吸频率的估计值,所得估计值与标准值的相关系数分别高于0.9和0.8。同时,所提方法将为实时活体人脸识别提供一种思路,也有助于丰富监控视频智能分析的应用研究。
-
关键词:
- 面部视频 /
- 成像式光电容积描记法 /
- 集合经验模态分解(EEMD) /
- 信号质量检测 /
- 抗干扰
Abstract:To detect the physiological signals related to vital signs via facial video is easily affected by ambient lights and head motions. In order to reduce the disturbance and increase the accuracy of estimations of vital signs, this paper proposes a facial video analysis method that combines Ensemble Empirical Mode Decomposition (EEMD) algorithm and signals quality detection to accurately detect vital signs such as the heart rate and respiratory rate of human beings. The performance of the proposed method is validated by comparing it with the existing signal processing techniques in a public dataset. The experimental results show that the proposed method can obtain more accurate estimates of heart rate and respiratory rate than the existing methods. The correlation coefficients between the estimates and the golden standards are higher than 0.9 and 0.8, respectively. The vital signs detection method has the potential to benefit real-time living face recognition and intelligent surveillance video analysis.
-
表 1 不同方法的心率比较
Table 1. Comparison of heart rate among different methods
-
[1] 杨哲.基于视频监控的人群异常行为检测[D].秦皇岛: 燕山大学, 2019. http://cdmd.cnki.com.cn/Article/CDMD-10216-1019921057.htmYANG Z.Detection of crowd abnormal behavior based on video surveillance[D].Qinhuangdao: Yanshan University, 2019(in Chinese). http://cdmd.cnki.com.cn/Article/CDMD-10216-1019921057.htm [2] BLEDSOE W.The model method in facial recognition: Technical report: PRI-15[R].Palo Alto: Panoramic Research, Inc., 1964. [3] HE J, CAI J F, FANG L Z, et al.A method of facial expression recognition based on LBP fusion of key expressions areas[C]//The 27th Chinese Control and Decision Conference.Piscataway: IEEE Press, 2015: 4200-4204. [4] AHONEN T, HADID A, PIETIKÄINEN M.Face recognition with local binary patterns[C]//European Conference on Computer Vision.Berlin: Springer, 2004: 469-481. [5] LENC L, KRÁL P.Local binary pattern based face recognition with automatically detected fiducial points[J].Integrated Computer-Aided Engineering, 2016, 23(2):129-139. doi: 10.3233/ICA-150506 [6] KRANJEC J, BEGUŠ S, GERŠAK G, et al.Non-contact heart rate and heart rate variability measurements:A review[J].Biomedical Signal Processing and Control, 2014, 13:102-112. doi: 10.1016/j.bspc.2014.03.004 [7] SUN Y, THAKOR N.Photoplethysmography revisited:From contact to noncontact, from point to imaging[J].IEEE Transactions on Bio-Medical Engineering, 2016, 63(3):463-477. doi: 10.1109/TBME.2015.2476337 [8] WU T, BLAZEK V, SCHMITT H J.Photoplethysmography imaging: A new noninvasive and noncontact method for mapping of the dermal perfusion changes[C]//Optical Techniques and Instrumentation for the Measurement of Blood Composition, Structure, and Dynamics.Bellingham: International Society for Optics and Photonics, 2000, 4163: 62-70. https://www.researchgate.net/publication/253321950_Photoplethysmography_imaging_a_new_noninvasive_and_noncontact_method_for_mapping_of_the_dermal_perfusion_changes [9] LI X B, CHEN J, ZHAO G Y, et al.Remote heart rate measurement from face videos under realistic situations[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Piscataway: IEEE Press, 2014: 4264-4271. https://www.researchgate.net/publication/286594471_Remote_Heart_Rate_Measurement_from_Face_Videos_under_Realistic_Situations [10] BEATSON A, GREEN R.Calculating a vagal tone index using webcam photoplethysmography[C]//Proceedings of the 29th International Conference on Image and Vision Computing.New York: ACM, 2014: 242-246. doi: 10.1145/2683405.2683446 [11] CHENG J, CHEN X, XU L X, et al.Illumination variation-resistant video-based heart rate measurement using joint blind source separation and ensemble empirical mode decomposition[J].IEEE Journal of Biomedical and Health Informatics, 2017, 21(3):1422-1433. http://ieeexplore.ieee.org/document/7585027 [12] POH M Z, MCDUFF D J, PICARD R W.Non-contact, automated cardiac pulse measurements using video imaging and blind source separation[J].Optics Express, 2010, 18(10):10762-10774. doi: 10.1364/OE.18.010762 [13] 雷恒波, 郭友达, 莫镜清, 等.基于人脸视频的光电容积脉搏波信号获取与处理[J].中国医学物理学杂志, 2016, 33(11):1178-1182. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgyxwlxzz201611019LEI H B, GUO Y D, MO J Q, et al.Acquisition and processing of photoelectric volume pulse wave signal based on face video[J].Chinese Journal of Medical Physics, 2016, 33(11):1178-1182(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgyxwlxzz201611019 [14] WU Z, HUANG N E.Ensemble empirical mode decomposition:A noise-assisted data analysis method[J].Advances in Adaptive Data Analysis, 2009, 1(1):1-41. [15] ZHAO J, HUANG J F, JIA G Q, et al.Non-contact method of heart rate using a webcam[C]//IEEE International Conference on Internet of Things and IEEE Green Computing and Communications and IEEE Cyber, Physical and Social Computing and IEEE Smart Data.Piscataway: IEEE Press, 2018: 1902-1906. https://www.researchgate.net/publication/333595344_Non-Contact_Method_of_Heart_Rate_Using_a_Webcam [16] FAVILLA R, ZUCCALÀ V C, COPPINI G.Heart rate and heart rate variability from single-channel video and ICA integration of multiple signals[J].IEEE Journal of Biomedical and Health Informatics, 2019, 23(6):2398-2408. doi: 10.1109/JBHI.2018.2880097 [17] LEI Y G, HE Z J, ZI Y Y.Application of the EEMD method to rotor fault diagnosis of rotating machinery[J].Mechanical Systems and Signal Processing, 2009, 23(4):1327-1338. doi: 10.1016/j.ymssp.2008.11.005 [18] ZHANG K P, ZHANG Z P, LI Z F, et al.Joint face detection and alignment using multitask cascaded convolutional networks[J].IEEE Signal Processing Letters, 2016, 23(10):1499-1503. doi: 10.1109/LSP.2016.2603342 [19] NEUBECK A, VAN GOOL L.Efficient non-maximum suppression[C]//18th International Conference on Pattern Recognition.Piscataway: IEEE Press, 2006, 3: 850-855. https://www.researchgate.net/publication/220929789_Efficient_Non-Maximum_Suppression [20] KING D E.Dlib-ml:A machine learning toolkit[J].Journal of Machine Learning Research, 2009, 10:1755-1758. http://cn.bing.com/academic/profile?id=763e0724818935e117719c1aedaec5fa&encoded=0&v=paper_preview&mkt=zh-cn [21] DE H G, JEANNE V.Robust pulse rate from chrominance-based rPPG[J].IEEE Transactions on Biomedical Engineering, 2013, 60(10):2878-2886. doi: 10.1109/TBME.2013.2266196 [22] PANG B, LIU M, ZHANG X, et al.Advanced EMD method using variance characterization for PPG with motion artifact[C]//IEEE Biomedical Circuits and Systems Conference.Piscataway: IEEE Press, 2016: 196-199. [23] KOELSTRA S, MUHL C, SOLEYMANI M, et al.Deap:A database for emotion analysis using physiological signals[J].IEEE Transactions on Affective Computing, 2011, 3(1):18-31. http://dl.acm.org/citation.cfm?id=2197060 [24] POH M Z, MCDUFF D J, PICARD R W.Advancements in noncontact, multiparameter physiological measurements using a webcam[J].IEEE Transactions on Bio-Medical Engineering, 2011, 58(1):7-11. doi: 10.1109/TBME.2010.2086456 [25] TARASSENKO L, VILLARROEL M, GUAZZI A, et al.Non-contact video-based vital sign monitoring using ambient light and auto-regressive models[J].Physiological Measurement, 2014, 35(5):807-831. doi: 10.1088/0967-3334/35/5/807