Intelligent criminal investigation system based on both footprint recognition and surveillance video analysis
-
摘要:
刑侦破案是打击违法犯罪和确保国家长治久安的基本要求。刑侦破案的一大关键是如何有效地利用采集到的信息。为了更好地配合刑侦工作,提出了联合足迹识别与监控视频分析的智能刑侦系统。该系统基于深度学习方法,首先根据足迹信息,包括鞋印长度、宽度、受力分布情况、步长、步幅等,利用卷积神经网络技术实现嫌疑人个人特征的预测;其次联合周边监控视频大数据进行智能分析比较,利用大数据技术快速处理信息,分析视频中行人的个人特点;最后运用虚拟现实仿真技术构建足部压力和鞋底受力分析有限元模型,利用模型获得各种复杂场景下的仿真足迹。三者相互印证,有机结合,快速筛选刑侦对象。实验结果表明,该系统可以高效准确地根据足迹特征实现身高预测,并且与视频监控大数据相结合,可以迅速缩小排查范围并锁定凶手。
Abstract:Criminal investigation is the basic requirement for cracking down on crimes and ensuring the long-term security of the country. One of the key points in criminal investigation is how to effectively use the collected information. In order to support criminal investigation better, an intelligent criminal investigation system based on both footprint recognition and surveillance video analysis is proposed. The system is powered by deep learning methods. First, using convolutional neural network technique, it predicts the characteristics of suspected individuals based on footprint information, including the footprint length, width, distribution of force, step length, stride, etc. Second, it uses the surrounding surveillance video big data for intelligent comparison to quickly screen criminal investigation objects and analyze the personal characteristics of pedestrians. Finally, the virtual reality simulation technology is used to construct a finite element model of foot pressure and sole stress analysis, and the model is used to obtain simulation footprints in various complex scenarios. The three confirmed each other and organically combined to quickly select criminal investigation targets. Experimental results show that the system can efficiently and accurately achieve people height prediction based on footprint characteristics. Combined with video surveillance big data, the proposed system can quickly narrow down the investigation range and find out the killer.
-
Key words:
- deep learning /
- big data /
- criminal investigations /
- surveillance video analysis /
- footprint recognition
-
表 1 三种方法预测结果准确率
Table 1. Accuracy of three methods for predicting results
方法 误差阈值/cm 训练准确率/% 测试准确率/% 本文 5 62.11±0.97 58.98±2.24 10 90.97±0.50 88.38±1.60 经验公式 5 38.31 10 66.67 最小二乘法 5 53.09 10 84.51 -
[1] 孙传森.浅议犯罪现场足迹检验[J].经济研究导刊, 2009(8):253-254. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jjyjdk200908102SUN C S.On the footprint inspection of crime scene[J].Economic Research Guide, 2009(8):253-254(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jjyjdk200908102 [2] ISHAK N I, HEMY N, FRANKLIN D.Estimation of stature from hand and handprint dimensions in a Western Australian population[J].Forensic Science International, 2012, 216(1-3):199.e1-199.e7. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=fa3ffe81f963e2b13c053f09f72eb367 [3] ISHAK N I, HEMY N, FRANKLIN D.Estimation of sex from hand and handprint dimensions in a Western Australian population[J].Forensic Science International, 2012, 221(1-3):154.e1-154.e6. http://cn.bing.com/academic/profile?id=1e85350c676c6660d30ec32dda6b82b3&encoded=0&v=paper_preview&mkt=zh-cn [4] HEMY N, FLAVEL A, AISHAK N I, et al.Sex estimation using anthropometry of feet and footprints in a Western Australian population[J].Forensic Science International, 2013, 231(1-3):402.e1-402.e6. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=c44385b64f3a3b4f9067c88363988d2f [5] REEL S, ROUSE S, VERNON W, et al.Reliability of a two-dimensional footprint measurement approach[J].Science & Justice, 2010, 50(3):113-118. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=48d792c4808269ead2b4c498435498aa [6] KRISHAN K.Individualizing characteristics of footprints in Gujjars of North India-Forensic aspects[J].Forensic Science International, 2006, 169(2):137-144. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=2b1239c24b2d08e19c1c999fa0c679b7 [7] MOORTHY T N, MOSTAPA A, BOOMINATHAN R, et al.Stature estimation from footprint measurements in Indian Tamils by regression analysis[J].Egyptian Journal of Forensic Sciences, 2014, 4(1):7-16. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=Doaj000003959056 [8] 高毅.基于Footscan足底压力步态分析系统的足迹动力形态特征研究[J].中国人民公安大学学报(自然科学版), 2011, 17(2):9-13. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=gadxxb-zrkxb201102003GAO Y.Research on the dynamic morphology of footprints on the bases of gait analysis system of plantar pressure[J].Journal of Chinese People's Public Security University(Science and Technology), 2011, 17(2):9-13(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=gadxxb-zrkxb201102003 [9] 振强.马玉林学术研究会在内蒙古赤峰成立[J].刑事技术, 1993(1):30. http://www.cnki.com.cn/Article/CJFDTotal-XSJS199301016.htmZHEN Q.Ma Yulin academic research association was established in Chifeng, Inner Mongolia[J].Criminal Technology, 1993(1):30(in Chinese). http://www.cnki.com.cn/Article/CJFDTotal-XSJS199301016.htm [10] 吴大有.足迹检验的历史与现状[J].中国刑事警察, 1995(2):48-49. http://www.cnki.com.cn/Article/CJFDTotal-XSJC199502024.htmWU D Y.History and current status of footprint inspection[J].Chinese Criminal Police, 1995(2):48-49(in Chinese). http://www.cnki.com.cn/Article/CJFDTotal-XSJC199502024.htm [11] 刘树权, 叶剑平, 温媛, 等.足迹个体识别技术自动化——足迹计算机自动鉴定系统[J].刑事技术, 1998(1):44-46. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=QK199800941015LIU S Q, YE J P, WEN Y, et al.Automation of individual footprint identification technology-Automatic footprint computer identification system[J].Criminal Technology, 1998(1):44-46(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=QK199800941015 [12] 王清举, 平西建, 王永栋.立体足迹计算机自动识别系统的应用[J].刑事技术, 2003(5):41-43. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=xsjs200305017WANG Q J, PING X J, WANG Y D.Application of automatic stereo footprint computer recognition system[J].Criminal Technology, 2003(5):41-43(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=xsjs200305017 [13] 闫旭琴.自动鞋印分析与比对系统中的关键技术的研究与实现[D].青岛: 山东科技大学, 2007.YAN X Q.Research and implementation of key technologies in automatic shoe print analysis and comparison system[D].Qingdao: Shandong University of Science and Technology, 2007(in Chinese). [14] 王永栋, 顾士清, 党素琴, 等.基于重压面形状分析的足迹识别系统的研究[C]//中国图象图形学学会.第十四届全国图象图形学学术会议论文集.北京: 中国图象图形学学会, 2008: 794-797.WANG Y D, GU S Q, DANG S Q, et al.Research on footprint recognition system based on shape analysis of pressure surfaces[C]//Chinese Society of Image Graphics.Proceedings of the 14th National Conference on Image Graphics.Beijing: Chinese Society of Image Graphics, 2008: 794-797(in Chinese). [15] 蒋晓玲.基于图像处理技术的足迹检验系统的设计与实现[D].南京: 南京理工大学, 2011.JIANG X L.Design and implementation of footprint inspection system based on image processing technology[D].Nanjing: Nanjing University of Science and Technology, 2011(in Chinese). [16] 董菲菲.基于三维鞋印的鞋底花纹分类及模块设计[D].南昌: 南昌大学, 2010.DONG F F.Sole pattern classification and module design based on three-dimensional shoe prints[D].Nanchang: Nanchang University, 2010(in Chinese). [17] 张彩霞, 付焕利.未标定视频下的动态人体身高测量[J].计算机工程与应用, 2017, 53(21):162-166. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=pre_29f3566f-7f3b-4920-a13c-e47fec726bc2ZHANG C X, FU H L.Dynamic human height measurement under uncalibrated video[J].Computer Engineering and Applications, 2017, 53(21):162-166(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=pre_29f3566f-7f3b-4920-a13c-e47fec726bc2