基于区域划分与标准时间的手部异常行为检测

doi:10.13700/j.bh.1001-5965.2020.0369

北京航空航天大学学报 ›› 2021, Vol. 47 ›› Issue (10): 1969-1979.doi: 10.13700/j.bh.1001-5965.2020.0369

基于区域划分与标准时间的手部异常行为检测

梁宇宁¹, 王绍华², 金向明², 周栋¹

1. 北京航空航天大学可靠性与系统工程学院, 北京 100083;
2. 中国航发湖南动力机械研究所, 株洲 412002

收稿日期:2020-07-29 发布日期:2021-11-08
通讯作者: 周栋 E-mail:zhoudong@buaa.edu.cn

Abnormal hand behavior detection based on area division and standard time

LIANG Yuning¹, WANG Shaohua², JIN Xiangming², ZHOU Dong¹

1. School of Reliability and Systems Engineering, Beihang University, Beijing 100083, China;
2. AECC Hunan Aviation Powerplant Research Institute, Zhuzhou 412002, China

Received:2020-07-29 Published:2021-11-08

摘要/Abstract

摘要： 通过监控视频自动检测操作任务中手部异常行为，能够预防人因差错，提高人因可靠性。针对手部操作任务运动特征不明显、常用异常检测和手势识别方法不适用的问题，提出基于区域划分与标准时间的手部异常行为检测技术。使用基于椭圆模型的肤色检测方法，检测视频中手部形心位置；提出工作区域划分方法，根据手部形心在操作过程中所处区域的不同，将连续操作分割为单元任务，获得各段单元任务的起止时间和持续时长；以正常工作时间为标准，对超出标准时间范围的单元任务提出异常警告。实验表明：所提方法的单元任务分割正确率高于93%，异常行为检测率高于86%，能够有效检测手部异常行为，为人为差错的监测与预警提供技术支持。

关键词: 异常行为检测, 肤色检测, 人为差错, 人因可靠性, 单元任务分割

Abstract: Abnormal hand behavior detection during operation based on intelligent video surveillance systems can prevent human errors and improve human reliability. In order to solve the problems that the motion characteristics of hand operation are not obvious, and common abnormal detection and gesture recognition methods are not applicable, a detection technology of abnormal hand behavior based on area division and standard time is proposed. The skin color detection method based on ellipse model was used to detect the hand centroids in the video. The work area division method is proposed to define the unit task. The continuous operation was divided into unit tasks according to the work area of the hand centroid in each frame, and the start and end time and the duration of each unit task were obtained. Standard time was defined by normal working hours. And warnings were given to the unit tasks which exceed the standard time range. Experimental results show that the accuracy rate of unit task segmentation is higher than 93%, and the detection rate of abnormal behavior is higher than 86%. The proposed method can effectively detect abnormal hand behavior and provide technical support for human error monitoring and early warning.

Key words: abnormal behavior detection, skin color detection, human error, human reliability, unit task segmentation

中图分类号:

TP391

梁宇宁, 王绍华, 金向明, 周栋. 基于区域划分与标准时间的手部异常行为检测[J]. 北京航空航天大学学报, 2021, 47(10): 1969-1979.

LIANG Yuning, WANG Shaohua, JIN Xiangming, ZHOU Dong. Abnormal hand behavior detection based on area division and standard time[J]. Journal of Beijing University of Aeronautics and Astronautics, 2021, 47(10): 1969-1979.

参考文献

[1] TAO J, QIU D, YANG F, et al.A bibliometric analysis of human reliability research[J].Journal of Cleaner Production, 2020, 260:121041.
[2] 朱旭东, 刘志镜.基于主题隐马尔科夫模型的人体异常行为识别[J].计算机科学, 2012, 39(3):251-255.ZHU X D, LIU Z J.Human abnormal behavior recognition based on topic hidden Markov model[J].Computer Science, 2012, 39(3):251-255(in Chinese).
[3] YI X, DONG H, DONG X, et al.Human reliability analysis method on armored vehicle system considering error correction[J].Journal of Shanghai Jiaotong University (Science), 2016, 21(4):472-477.
[4] 李鹏程, 陈国华, 张力, 等.人因可靠性分析技术的研究进展与发展趋势[J].原子能科学技术, 2011, 45(3):329-340.LI P C, CHEN G H, ZHANG L, et al.Research review and development trends of human reliability analysis technique[J].Atomic Energy Science and Technology, 2011, 45(3):329-340(in Chinese).
[5] LIU P, QIU Y, HU J, et al.Expert judgments for performance shaping factors' multiplier design in human reliability analysis[J].Reliability Engineering and System Safety, 2020, 194:106343.
[6] BEN MABROUK A, ZAGROUBA E.Abnormal behavior recognition for intelligent video surveillance systems:A review[J].Expert Systems with Applications, 2018, 91:480-491.
[7] ZHU B, XIE Y, LUO G, et al.An abnormal behavior detection method using optical flow model and openpose[J].International Journal of Advanced Computer Science and Applications, 2020, 11(5):28-34.
[8] LAZARIDIS L, DIMOU A, DARAS P.Abnormal behavior detection in crowded scenes using density heatmaps and optical flow[C]//Proceedings of the European Signal Processing Conference, 2018:2074-2078.
[9] MABROUK A B, ZAGROUBA E.Spatio-temporal feature using optical flow based distribution for violence detection[M].Amsterdam:Elsevier Science, 2017.
[10] MIN W, ZOU S, LI J.Human fall detection using normalized shape aspect ratio[J].Multimedia Tools and Applications, 2019, 78(11):14331-14353.
[11] WANG J, XU Z.Crowd anomaly detection for automated video surveillance[C]//Proceedings of the IET Seminar Digest, 2015:15382040.
[12] LI K, HUANG H, ZHENG Z, et al.Research of crowed abnormal behavior detection technology based on trajectory gradient[C]//International Symposium on Intelligence Computation and Applications, 2018:486-500.
[13] WANG T, LI Y, HU J, et al.A survey on vision-based hand gesture recognition[C]//1st International Conference on Smart Multimedia, 2018:219-231.
[14] XIA Z, LEI Q, YANG Y, et al.Vision-based hand gesture recognition for human-robot collaboration:A survey[C]//Proceedings of the 20195th International Conference on Control, Automation and Robotics, 2019:198-205.
[15] 郭全利.动态手势识别关键算法研究[D].锦州:辽宁工业大学, 2018.GUO Q L.Research on key algorithms of dynamic gesture recognition[D].Jinzhou:Liaoning University of Technology, 2018(in Chinese).
[16] 张兆杨, 杨高波, 刘志.视频对象分割提取的原理与应用[M].北京:科学出版社, 2009.ZHANG Z Y, YANG G B, LIU Z.Principle and application of video object segmentation and extraction[M].Beijing:Science Press, 2009(in Chinese).
[17] ZIVKOVIC Z, HEIJDEN F V D.Efficient adaptive density estimation per image pixel for the task of background subtraction[J].Pattern Recognition Letters, 2006, 27(7):773-780.
[18] ZIVKOVIC Z.Improved adaptive Gaussian mixture model for background subtraction[C]//Proceedings of the 17th International Conference on Pattern Recognition, 2004:28-31.
[19] SUTTON R S.Learning to predict by the methods of temporal differences[J].Machine Learning, 1988, 3(1):9-44.
[20] HSU R L, ABDEL-MOTTALEB M, JAIN A K.Face detection in color images[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5):696-706.
[21] 孙燮华.数字图像处理:原理与算法[M].北京:机械工业出版社, 2010.SUN X H.Digital image processing:Principle and algorithm[M].Beijing:China Machine Press, 2010(in Chinese).
[22] 易树平, 郭伏.基础工业工程[M].北京:机械工业出版社, 2014.YI S P, GUO F.Basic industrial engineering[M].Beijing:China Machine Press, 2014(in Chinese).
[23] 邱慧慧.面向离散制造业的标准时间制定系统研究[D].济南:山东大学, 2009.QIU H H.Research on discrete manufacturing industries-oriented standard time formulation system[D].Jinan:Shandong University, 2009(in Chinese).
[24] 陈琼, 鱼滨.基于手部轨迹识别的ATM智能视频监控系统[J].计算机工程, 2012, 38(11):143-146.CHEN Q, YU B.Intelligent video surveillance system of automatic teller machine based on hand trajectory recognition[J].Computer Engineering, 2012, 38(11):143-146(in Chinese).
[25] 陈若愚.超市中人体异常行为识别方法的研究[D].长沙:国防科学技术大学, 2013.CHEN R Y.A research on abnormal behavior detection methods in supermarket[D].Changsha:National University of Defense Technology, 2013(in Chinese).
[26] 刘刚.基于手部图像特征分析的超市中异常行为的检测[D].成都:西华大学, 2017.LIU G.Detection of abnormal behavior in supermarket based on hand image feature analysis[D].Chengdu:Xihua University, 2017(in Chinese).

基于区域划分与标准时间的手部异常行为检测

Abnormal hand behavior detection based on area division and standard time

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	廖泓真, 王亮, 孙宏伟, 刘云清. 一种改进的ORB特征匹配算法[J]. 北京航空航天大学学报, 2021, 47(10): 2149-2154.
[2]	魏宏喜, 张越. 基于生成对抗网络的零样本图像分类[J]. 北京航空航天大学学报, 2019, 45(12): 2345-2350.
[3]	杨勇, 卢航远, 黄淑英, 涂伟, 李露奕. 基于自适应注入模型的遥感图像融合方法[J]. 北京航空航天大学学报, 2019, 45(12): 2351-2363.
[4]	蔡轶珩, 王雪艳, 胡绍斌, 刘嘉琦. 基于多源图像弱监督学习的3D人体姿态估计[J]. 北京航空航天大学学报, 2019, 45(12): 2375-2384.
[5]	吴玲达, 张喜涛, 孟祥利. 基于社团结构节点重要性的网络可视化压缩布局[J]. 北京航空航天大学学报, 2019, 45(12): 2423-2430.
[6]	徐天宇, 王智. 基于美学评判的文本生成图像优化[J]. 北京航空航天大学学报, 2019, 45(12): 2438-2448.
[7]	张梦琴, 孟权令, 张维刚. 基于深度视觉语义嵌入的视频缩略图推荐[J]. 北京航空航天大学学报, 2019, 45(12): 2479-2486.
[8]	莫宇剑, 侯振杰, 常兴治, 梁久祯, 陈宸, 宦娟. 面向行为识别的人体空间协同运动结构特征表示与融合[J]. 北京航空航天大学学报, 2019, 45(12): 2495-2505.
[9]	佟骏超, 吴熙林, 丁丹丹. 时空域上下文学习的视频多帧质量增强方法[J]. 北京航空航天大学学报, 2019, 45(12): 2506-2513.
[10]	湛颖, 高妍, 谢凌云. 中国国画艺术美感特征分析与分类[J]. 北京航空航天大学学报, 2019, 45(12): 2514-2522.
[11]	卢勇强, 栗志扬, 陈祎楠, 刘朝斌, 黄一鸣. 结合轮廓及骨架序列编码的二维形状识别[J]. 北京航空航天大学学报, 2019, 45(12): 2523-2532.
[12]	张振良, 刘君强, 黄亮, 张曦. 基于半监督迁移学习的轴承故障诊断方法[J]. 北京航空航天大学学报, 2019, 45(11): 2291-2300.
[13]	田永亮, 王永庆, 熊培森, 郭宇, 武哲. 面向战斗机云作战的构造型仿真平台架构[J]. 北京航空航天大学学报, 2019, 45(10): 1938-1945.
[14]	贾瑞明, 刘圣杰, 李锦涛, 王赟豪, 潘海侠. 基于编解码双路卷积神经网络的视觉自定位方法[J]. 北京航空航天大学学报, 2019, 45(10): 1965-1972.
[15]	赵国, 秦世引. PMMWI与VI优势互补的人体隐蔽违禁物检测与定位[J]. 北京航空航天大学学报, 2019, 45(10): 2011-2025.