实时鲁棒的频域空间目标跟踪方法

doi:10.13700/j.bh.1001-5965.2016.0906

北京航空航天大学学报 ›› 2017, Vol. 43 ›› Issue (12): 2457-2465.doi: 10.13700/j.bh.1001-5965.2016.0906

实时鲁棒的频域空间目标跟踪方法

汪溁鹤¹, 陈裕雄², 马世龙¹, 吕江花¹

1. 北京航空航天大学计算机学院, 北京 100083;
2. 广东南方职业学院, 江门 529000

收稿日期:2016-12-01 修回日期:2017-02-24 出版日期:2017-12-20 发布日期:2017-04-07
通讯作者: 吕江花 E-mail:jhlv@nlsde.buaa.edu.cn
作者简介:汪溁鹤,男,博士研究生。主要研究方向:计算机视觉、图形图像、虚拟现实技术与系统;陈裕雄,男,硕士,讲师。主要研究方向:计算机软件与理论;马世龙,男,博士,教授,博士生导师。主要研究方向:计算机软件与理论;吕江花,女,博士,副教授,硕士生导师。主要研究方向:计算机软件与理论。
基金资助:
国家自然科学基金（61003016，61300007，61305054）；科技部基本科研业务费重点科技创新类项目（YWF-14-JSJXY-007）；中央高校基本科研业务费专项资金（YWF-15-GJSYS-106）；软件开发环境国家重点实验室自由探索基金（ZX2015ZX-09，SKLSDE-2014ZX-06，SKLSDE-2012ZX-28，SKLSDE-2015ZX-09，SKLSDE-2013ZX-11）

Real-time and robust object tracking method in frequency domain space

WANG Ronghe¹, CHEN Yuxiong², MA Shilong¹, LYU Jianghua¹

1. School of Computer Science and Engineering, Beijing University of Aeronautics and Astronautics, Beijing 100083, China;
2. Guangdong Nanfang Vocational College, Jiangmen 529000, China

Received:2016-12-01 Revised:2017-02-24 Online:2017-12-20 Published:2017-04-07
Supported by:
National Natural Science Foundation of China (61003016, 61300007, 61305054); Ministry of Science and Technology Basic Scientific Research Business Expenses Focused on Scientific and Technological Innovation Projects (YWF-14-JSJXY-007); the Fundamental Research Funds for the Central Universities (YWF-15-GJSYS-106); Free Discovery Funds of State Key Laboratory of Software Development Environment (ZX2015 ZX-09, SKLSDE-2014ZX-06, SKLSDE-2012ZX-28,SKLS-DE-2015 ZX-09, SKLSDE-2013 ZX-11)

摘要/Abstract

摘要： 本文中实现了一种实时鲁棒的目标跟踪方法，提出了新颖的基于目标形状和外观的稠密循环采样方法、循环矩阵和频域空间的能量最小化目标跟踪方法。本文方法总体上减少了需要处理的数据量，尤其是加入了循环矩阵，极大地简化了计算过程，并将目标特征转换到高维频域空间进行了线性表示，最后用高频空间能量最小化的方法实现了更加快速和精准的目标跟踪。通过大量的对比实验表明，本文方法的总体效果较好，在目标朝向变化、场景光照变化、视频抖动、目标尺度模式变化、目标部分遮挡等环境下，较目前效果最好、最新的方法，本文方法在综合的跟踪精度和效率方面更能取得较好的效果。

关键词: 频域空间, 稠密循环采样, 能量最小化方法, 目标跟踪, 计算机视觉

Abstract: This paper addresses real-time and robust object tracking method. In this paper, dense circulation sampling and frequency domain transform method were used in target tracking processing. This paper proposed energy minimization object tracking method in frequency domain space and put forward the concept of dense circulation sampling to solve object shape changes, appearance changes, object orientation changes, scene illumination changes, video jitter, objective scale changes and object occlusion problems in tracking processing. This method calculates a target by ten adjacent frames and circulation matrix in frequency domain space. This algorithm defines error as an energy function. This method proposed frequency domain energy minimum method firstly. Energy minimization make error between target and ground truth minimize. This algorithm can obtain more precision target results rapidly, so data quantity is sharp decreased. This algorithm use the dense circulation sampling and energy minimization method to implement a stable visual tracking in such situation as target orientation deformation, scene illumination changes, video stabilization, target scale transformation, target part occlusion. Compared with the latest and the best performance methods at present, the proposed method has significantly improved the tracking precision and efficiency.

Key words: frequency domain space, dense circulation sampling, energy minimization method, object tracking, computer vision

中图分类号:

TP391.41

汪溁鹤, 陈裕雄, 马世龙, 吕江花. 实时鲁棒的频域空间目标跟踪方法[J]. 北京航空航天大学学报, 2017, 43(12): 2457-2465.

WANG Ronghe, CHEN Yuxiong, MA Shilong, LYU Jianghua. Real-time and robust object tracking method in frequency domain space[J]. JOURNAL OF BEIJING UNIVERSITY OF AERONAUTICS AND A, 2017, 43(12): 2457-2465.

参考文献

[1] SUPANCIC J S,RAMANAN D.Self-paced learning for long-term tracking[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway,NJ:IEEE Press,2013:2379-2386.
[2] WU Y,LIM J,YANG M H.Online object tracking:A benchmark[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2013:2411-2418.
[3] GRABNER H,BISCHOF H.On-line boosting and vision[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2006:260-267.
[4] BABENKO B,YANG M H,BELONGIE S.Visual tracking with online multiple instance learning[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2009:983-990.
[5] HARE S,GOLODETZ S,SAFFARI A,et al.Struck:Structured output tracking with kernels[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,38(10):2096-2109.
[6] ROSS D A,LIM J,LIN R S,et al.Incremental learning for robust visual tracking[J].International Journal of Computer Version,2008,77(1-3):125-141.
[7] MEI X,LING H.Robust visual tracking and vehicle classification via sparse representation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(11):2259-2272.
[8] LIU B,HUANG J,KULIKOWSKI C,et al.Robust visual tracking using local sparse appearance model and k-selection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(12):2968-2981.
[9] LI M,MA F,NIAN F.Robust visual tracking via appearance modeling and sparse representation[J].Journal of Computers,2014,9(7):1612-1619.
[10] HUA Y,ALAHARI K,SCHMID C.Occlusion and motion reasoning for long-term tracking[C]//Proceedings of European Conference on Computer Vision.Berlin:Springer Verlag,2014:172-187.
[11] BROX T,MALIK J.Object segmentation by long term analysis of point trajectories[C]//Proceedings of European Conference on Computer Vision.Berlin:Springer Verlag,2010:282-295.
[12] BROX T,MALIK J.Large displacement opticalow:Descriptor matching in variational motion estimation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(3):510-513.
[13] FIASCHI L,DIEGO F,GREGOR K,et al.Tracking indistinguishable translucent objects over time using weakly supervised structured learning[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2014:2736-2743.
[14] BERCLAZ J,FLEURET F,TURETKEN E,et al.Multiple object tracking using k-shortest paths optimization[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(9):1806-1819.
[15] KALAL Z,MIKOLAJCZYK K,MATAS J.Tracking-learning-detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(7):1409-1422.
[16] JIA X,LU H,YANG M H.Visual tracking via adaptive structural local sparse appearance model[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2012:1822-1829.
[17] PATNAIK R.Distortion-invariant kernel correlation lters for general object recognition[D].Pittsburgh:Carnegie Mellon University,2009.
[18] GRABNER H,LEISTNER C,BISCHOF H.Semi-supervised on-line boosting for robust tracking[C]//Proceedings of European Conference on Computer Vision.Berlin:Springer Verlag,2008:234-247.
[19] BABENKO B,YANG M H,BELONGIE S.Robust object tracking with online multiple instance learning[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(8):1619-1632.
[20] KWON J,LEEK M.Visual tracking decomposition[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2010:1269-1276.
[21] HAN Z J,YE Q X,JIAO J B.Robust visual object tracking via sparse representation and reconstruction[C]//Proceedings of International Conference on Computer Analysis of Images and Patterns.Berlin:Springer Verlag,2013:282-289.
[22] KALAL Z,MATAS J,MIKOLAJCZYK K.PN learning:Bootstrapping binary classifiers by structural constraints[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2010:49-56.
[23] 石武祯,梅林,王文斐,等.面向复杂场景的局部分布场跟踪方法[J].计算机辅助设计与图形学学报,2014,26(11):2031-2038.SHI W Z,MEI L,WANG W F,et al.Local distribution fields for tracking in complex scenarios[J].Journal of Computer-Aided Design & Computer Graphics,2014,26(11):2031-2038(in Chinese).
[24] ZHANG T,GHANEM B,LIU S,et al.Robust visual tracking via multi-task sparse learning[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2012:2042-2049.
[25] DINH T B,VO N,MEDIONI G.Context tracker:Exploring supporters and distracters in unconstrained environments[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2011:1177-1184.
[26] BOLME D S,BEVERIDGE J R,DRAPER B A,et al.Visual object tracking using adaptive correlation filters[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2011:2544-2550.
[27] ZHANG K,ZHANG L,YANG M H.Real-time compressive tracking[C]//Proceedings of European Conference on Computer Vision.Berlin:Springer Verlag,2012:864-877.
[28] HENRIQUES J,CASEIRO R,MARTINS P,et al.Exploiting the circulant structure of tracking-by-detection with kernels[C]//Proceedings of European Conference on Computer Vision.Berlin:Springer Verlag,2012:702-715.
[29] CEHOVIN L,KRISTAN M,LEONARDIS A.Robust visual tracking using an adaptive coupledlayer visual model[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(4):941-953.
[30] BAO C,WU Y,LING H,et al.Real time robust tracker using accelerated proximal gradient approach[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2012:1830-1837.
[31] LIU B,HUANG J,YANG L,et al.Robust tracking using local sparse appearance model and k-selection[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2011:1313-1320.
[32] HENRIQUES J F,CASEIRO R,MARTINS P,et al.High-speed tracking with kernelized correlation filters[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(7):583-596.
[33] SEVILLA-LARA L,LEARNED-MILLER E.Distribution elds for tracking[C]//Proceedings of IEEE International Conference on Advanced Video and Signal Based Surveillance-AVSS 2015.Piscataway,NJ:IEEE Press,2015:474-479.
[34] KWON J,LEE K M.Tracking by sampling trackers[C]//Proceedings of the IEEE International Conference on Computer Vision,International Conference on Computer Vision.Piscataway,NJ:IEEE Press,2011:1195-1202.
[35] HONG S,KWAK S,HAN B.Orderless tracking through model-averaged posterior estimation[C]//Proceedings of the IEEE International Conference on Computer Vision.Piscataway,NJ:IEEE Press,2013:2296-2303.
[36] GU S,ZHENG Y,TOMASI C.Linear time offline tracking and lower envelope algorithms[C]//Proceedings of the IEEE International Conference on Computer Vision.Piscataway,NJ:IEEE Press,2011:1840-1846.

实时鲁棒的频域空间目标跟踪方法

Real-time and robust object tracking method in frequency domain space

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	庞策, 单甘霖, 段修生. 多传感器协同识别跟踪多目标管理方法[J]. 北京航空航天大学学报, 2019, 45(8): 1674-1680.
[2]	李惠峰, 易文峰, 程晓明. 基于近似动态规划的目标追踪控制算法[J]. 北京航空航天大学学报, 2019, 45(3): 597-605.
[3]	肖楚晗, 李炯, 雷虎民, 王华吉. 基于AVSIMM算法的高超声速再入滑翔目标跟踪[J]. 北京航空航天大学学报, 2019, 45(2): 413-421.
[4]	欧能杰, 汪圣利, 张直. 基于非等维状态的IMM混合估计方法[J]. 北京航空航天大学学报, 2019, 45(10): 2115-2122.
[5]	王国宏, 白杰, 孙殿星. 速度欺骗干扰下的机动目标跟踪技术[J]. 北京航空航天大学学报, 2018, 44(7): 1359-1370.
[6]	刘畅, 杨锁昌, 汪连栋, 张宽桥. 基于自适应强跟踪CQKF的目标跟踪算法[J]. 北京航空航天大学学报, 2018, 44(5): 982-990.
[7]	周卫东, 刘璐, 唐佳. 基于模糊逻辑的交互式多模型滤波算法[J]. 北京航空航天大学学报, 2018, 44(3): 413-419.
[8]	张凯, 熊家军, 付婷婷, 席秋实. 基于耦合气动参数的HGV多模型估计[J]. 北京航空航天大学学报, 2018, 44(10): 2156-2164.
[9]	甘林海, 刘进忙, 王刚, 李松. 多模型GGIW-GLMB算法跟踪机动群目标[J]. 北京航空航天大学学报, 2018, 44(10): 2185-2192.
[10]	朱日东, 杨小远, 王敬凯. 基于傅里叶域卷积表示的目标跟踪算法[J]. 北京航空航天大学学报, 2018, 44(1): 151-159.
[11]	滑维鑫, 慕德俊, 郭达伟, 刘航. 基于目标性权值度量的多示例学习目标跟踪[J]. 北京航空航天大学学报, 2017, 43(7): 1364-1372.
[12]	刘玉双, 赵剡, 吴发林. 基于外定界椭球集员估计的纯方位目标跟踪[J]. 北京航空航天大学学报, 2017, 43(3): 497-505.
[13]	袁常顺, 王俊, 向洪, 魏少明, 张耀天. 非线性量测下自适应噪声协方差PHD滤波[J]. 北京航空航天大学学报, 2017, 43(1): 53-60.
[14]	方君, 戴邵武, 许文明, 邹杰, 王永庭. 基于ST-SRCKF的超高速强机动目标跟踪算法[J]. 北京航空航天大学学报, 2016, 42(8): 1698-1708.
[15]	袁常顺, 王俊, 张耀天, 毕严先, 向洪. 基于PHD未知杂波密度多机动目标跟踪[J]. 北京航空航天大学学报, 2016, 42(10): 2082-2090.