一种复杂场景下的人眼检测算法

doi:10.13700/j.bh.1001-5965.2019.0641

北京航空航天大学学报 ›› 2021, Vol. 47 ›› Issue (1): 38-44.doi: 10.13700/j.bh.1001-5965.2019.0641

一种复杂场景下的人眼检测算法

崔家礼¹, 曹衡¹, 张亚明¹, 罗嗣梧², 李锦涛², 王华峰^1,2

1. 北方工业大学信息学院, 北京 100144;
2. 北京航空航天大学软件学院, 北京 100083

收稿日期:2019-12-23 发布日期:2021-01-29
通讯作者: 王华峰 E-mail:wanghuafeng@ncut.edu.cn
作者简介:崔家礼,男,博士,助理研究员。主要研究方向:智能识别与数字图像处理;曹衡,男,硕士研究生。主要研究方向:智能识别与数字图像处理;王华峰,男,博士,副研究员。主要研究方向:人工智能与机器人。
基金资助:
国家重点研发计划（2017YFB0802300）

A human eye detection algorithm in complex scenarios

CUI Jiali¹, CAO Heng¹, ZHANG Yaming¹, LUO Siwu², LI Jintao², WANG Huafeng^1,2

1. School of Information Science and Technology, North China University of Technology, Beijing 100144, China;
2. School of Software, Beihang University, Beijing 100083, China

Received:2019-12-23 Published:2021-01-29

摘要/Abstract

摘要： 针对复杂场景下的人眼检测问题，间接方法和直接方法具有一定的局限性。提出了一种不依赖人脸检测的直接型人眼检测算法，以解决复杂场景下多尺度尤其是小尺度人眼检测问题。算法通过减少下采样因子并加入扩张残差单元以提升小尺度人眼检测能力，且对多尺度特征相互拼接以保证多尺度人眼检测的精度。同时，算法借助于压缩特征输出通道降低了模型复杂度，使人眼检测效率得以提升。实验结果表明：所提模型可以在小尺度下有效地进行左右眼区分，并在红外数据上表现良好。经在DIF数据集上进行训练与测试，所提模型在较小尺度下人眼检测精度达到82.59%，检测效率达到30.5 fps。

关键词: 人眼检测, 深度学习, 小目标检测, 复杂场景, 多尺度特征

Abstract: Aiming at the problem of human eye detection in complex scenes, indirect methods and direct methods have certain limitations.A direct human eye detection method which is independent of face detection is proposed. The proposed method detects eyes under multiple scales especially small scale in complex scenarios. The improvement of the proposed method consists of improving small-scale human eye detection ability by reducing the down-sampling factor and adding extended residual units; ensuring the accuracy of multi-scale human eye detection by concatenating the multi-scale features; improving human eye detection efficiency by reducing the number of feature output channels to simplify the complexity of the model. The experimental results show that the proposed model can distinguish the left and right eyes effectively under small scale and has good performance with infrared data. The training and test on DIF dataset show that the human eye detection precision of the proposed method is 82.59%, and the detection rate is 30.5 fps.

Key words: human eye detection, deep learning, small target detection, complex scenarios, multi-scale features

中图分类号:

崔家礼, 曹衡, 张亚明, 罗嗣梧, 李锦涛, 王华峰. 一种复杂场景下的人眼检测算法[J]. 北京航空航天大学学报, 2021, 47(1): 38-44.

CUI Jiali, CAO Heng, ZHANG Yaming, LUO Siwu, LI Jintao, WANG Huafeng. A human eye detection algorithm in complex scenarios[J]. Journal of Beijing University of Aeronautics and Astronautics, 2021, 47(1): 38-44.

参考文献

[1] DAUGMAN J.How iris recognition works[M]//BOVIK A.The essential guide to image processing.Salt Lake City:Academic Press,2009:715-739.
[2] TURK M A,PENTLAND A P.Face recognition using eigenfaces[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,1991:586-591.
[3] DUCHOWSKI A T.Eye tracking methodology[J].Theory and Practice,2007,328(614):2-3.
[4] ASADA M,TANAKA T,HOSODA K.Adaptive binocular visual servoing for independently moving target tracking[C]//IEEE International Conference on Robotics and Automation.Piscataway:IEEE Press,2000,3:2076-2081.
[5] HAILIN W,HANHUI L,ZHUMEI S.Fatigue driving detection system design based on driving behavior[C]//International Conference on Optoelectronics and Image Processing.Piscataway:IEEE Press,2010,1:549-552.
[6] 叶修强.基于局部特征的人眼检测[D].南昌:南昌大学,2018:18-20.YE X Q.Human eye detection based on local features[D].Nanchang:Nanchang University,2018:18-20(in Chinese).
[7] 金花.人脸识别中眼睛定位算法的研究[D].沈阳:东北大学,2010:6-7.JIN H.Research on eye location algorithm in face recognition[D].Shenyang:Northeastern University,2010:6-7(in Chinese).
[8] 郝叶林,罗兵,杨锐,等.复杂场景图像中人员目标检测算法的改进[J].五邑大学学报,2018,28(1):103-108.HAO Y L,LUO B,YANG R,et al.Improvement of human target detection algorithm in complex scene images[J].Journal of Wuyi University,2018,28(1):103-108(in Chinese).
[9] MERLER M,RATHA N,FERIS R S,et al.Diversity in faces[EB/OL].(2019-01-29)[2019-12-30].https://arxiv.org/abs/1901.10436.
[10] 刘青.基于深度学习的多姿态眼睛定位算法研究及应用[D].广州:华南理工大学,2018:5-7.LIU Q.Research and application of multi-pose eye positioning algorithm based on deep learning[D].Guangzhou:South China University of Technology,2018:5-7(in Chinese).
[11] 张杰,杨晓飞,赵瑞莲.基于积分投影和Hough变换圆检测的人眼精确定位方法研究[J].电子器件,2005,28(4):706-709.ZHANG J,YANG X F,ZHAO R L.Research on human eye precise positioning method based on integral projection and Hough transform circle detection[J].Electronic Devices,2005,28(4):706-709(in Chinese).
[12] KROON B,MAAS S,BOUGH S,et al.Eye localization in low and standard definition content with application to face matching[J].Computer Vision and Image Understanding,2009,113(8):921-933.
[13] TANG X,OU Z,SU T,et al.Robust precise eye location by Adaboost and SVM techniques[J].Lecture Notes in Computer Science,2005,3497:93-98.
[14] GKIOXARI G,GIISHICK R,MALIK J.Contextual action recognition with R^*CNN[C]//Proceedings of the IEEE International Conference on Computer Vision.Piscataway:IEEE Press,2015:1080-1088.
[15] REN S,HE K M,GIRSHICK R,et al.Faster R-CNN:Towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.
[16] LIU W,ANGUELOY D,ERHAN D,et al.SSD:Single shot multibox detector[C]//European Conference on Computer Vision.Berlin:Springer,2016:21-37.
[17] REDMON J,FARGADI A.YOLOv3:An incremental improvement[EB/OL](2018-04-08)[2019-12-30].https://arxiv.org/abs/1804.02767.
[18] TAN T N,SUN Z N.CASIA iris image database[EB/OL].[2019-12-20].http://biometrics.idealtest.org/.
[19] SCHUTZE H,MANNING C D,RAGH P.Introduction to information retrieval[C]//Proceedings of the International Communication of Association for Computing Machinery Conference.Cambridge:Cambridge University Press,2008,39:234-265.
[20] KIM C E,OGHAZ M D,FAJTL J,et al.A comparison of embedded deep learning methods for person detection[EB/OL].(2018-12-09)[2019-12-30].https//arxiv.org/abs/1812.03451.
[21] REDMON J,FARHADI A.YOLO9000:Better,faster,stronger[EB/OL].(2016-12-25)[2019-12-30].https://arxiv.org/abs/1612.08242.

一种复杂场景下的人眼检测算法

A human eye detection algorithm in complex scenarios

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	陈猛夫. 基于迁移学习的暴恐图像自动识别[J]. 北京航空航天大学学报, 2020, 46(9): 1677-1681.
[2]	杜雨佳, 李海生, 姚春莲, 蔡强. 基于三元组网络的单图三维模型检索[J]. 北京航空航天大学学报, 2020, 46(9): 1691-1700.
[3]	陶一宁, 苏峰, 袁培江, 王田苗, 钟涛, 郝静如. 联合足迹识别与监控视频分析的智能刑侦系统[J]. 北京航空航天大学学报, 2020, 46(9): 1730-1738.
[4]	张洁茹, 苏峰, 袁培江, 王田苗, 陶一宁, 丁东. 双光谱智能体温检测与健康大数据管理系统[J]. 北京航空航天大学学报, 2020, 46(9): 1739-1746.
[5]	张子昊, 周千里, 王蓉. 基于空间注意力机制的行人再识别方法[J]. 北京航空航天大学学报, 2020, 46(9): 1747-1755.
[6]	张子昊, 王蓉. 基于MobileFaceNet网络改进的人脸识别方法[J]. 北京航空航天大学学报, 2020, 46(9): 1756-1762.
[7]	邱博, 刘翔, 石蕴玉, 尚岩峰. 一种轻量化的多目标实时检测模型[J]. 北京航空航天大学学报, 2020, 46(9): 1778-1785.
[8]	陆展鸿, 单鲁斌, 苏立循, 焦雨欣, 王家骅, 王海霞. 基于U-Net的掌纹图像增强与ROI提取[J]. 北京航空航天大学学报, 2020, 46(9): 1807-1816.
[9]	李欣致, 董胜波, 崔向阳, 刘志哲, 郭广浩. 应用于智能芯片的可视化反馈系统研究[J]. 北京航空航天大学学报, 2020, 46(8): 1494-1502.
[10]	张阳, 牛之贤, 牛保宁, 常艳. 基于高分辨率网络的单声道歌声分离[J]. 北京航空航天大学学报, 2020, 46(8): 1555-1563.
[11]	李承昊, 茹乐, 何林远, 迟文升. 一种可变锚框候选区域网络的目标检测方法[J]. 北京航空航天大学学报, 2020, 46(8): 1610-1617.
[12]	吕娜, 周家欣, 陈卓, 刘鹏飞, 高维廷. 一种鲁棒性增强的机载网络流量分类方法[J]. 北京航空航天大学学报, 2020, 46(7): 1237-1246.
[13]	郑磊, 胡维多, 刘畅. 基于深度学习的大型陨石坑识别方法研究[J]. 北京航空航天大学学报, 2020, 46(5): 994-1004.
[14]	边亮, 罗霄阳, 李硕. 基于深度学习的图像拼接篡改检测[J]. 北京航空航天大学学报, 2020, 46(5): 1039-1044.
[15]	杨思晨, 王华锋, 王月海, 李锦涛, 王赟豪. 深度学习机制与小波融合的超分辨率重建算法[J]. 北京航空航天大学学报, 2020, 46(1): 189-197.