电力场景下基于无人机视觉的运动目标追踪方法

doi:10.13700/j.bh.1001-5965.2020.0613

北京航空航天大学学报 ›› 2022, Vol. 48 ›› Issue (4): 586-594.doi: 10.13700/j.bh.1001-5965.2020.0613

电力场景下基于无人机视觉的运动目标追踪方法

冯雪, 杜猛俊, 向新宇, 钱锦, 张敏

国网浙江省电力有限公司杭州供电公司, 杭州 310000

收稿日期:2020-11-03 发布日期:2022-04-27
通讯作者: 杜猛俊 E-mail:du_mengjun@zj.sgcc.com.cn
基金资助:
国网浙江省电力有限公司科技项目（5211HZ19014U）

UAV-vision-based moving target tracking scheme in electric scenario

FENG Xue, DU Mengjun, XIANG Xinyu, QIAN Jin, ZHANG Min

Hangzhou Power Supply Company of Zhejiang Power Co. Ltd. of State Grid Corporation of China, Hangzhou 310000, China

Received:2020-11-03 Published:2022-04-27

摘要/Abstract

摘要： 随着人工智能技术的发展，面向电力系统的运动目标追踪技术逐渐得到关注，现有方法虽有一定成效，但是大多基于固定摄像头的监控视频录制，不能灵活追踪运动目标，当运动目标离开摄像头视野时，存在运动目标丢失问题。为此，利用无人机设备，并基于深度学习和核相关滤波技术，提出了一个电力场景下基于无人机视觉的运动目标追踪方法（MTTS_UAV）。所提方法采用改进的目标追踪方法与目标检测方法相结合的方式来追踪运动目标隐患，并引入2种无人机飞行控制模块：启发式和数据驱动式，使得无人机的飞行速度和方向可以根据目标移动情况自适应地调节。在真实变电站的安全帽人员数据集上进行了大量实验，对所提方法的追踪效果进行评估，结果表明：所提方法在真实数据集上的平均像素误差（APE）和平均重叠率（AOR）分别可达到2.37和0.67，验证了方法的有效性。

关键词: 目标追踪, 目标检测, 深度学习, 无人机视觉, 电力场景

Abstract: With the rapid development of artificial intelligence technology, the moving target tracking technology for the power system has gradually attracted researchers' attention. Although the existing methods have achieved great success, most of them are based on the fixed camera surveillance video recording, which cannot track the moving target flexibly. When the moving object leaves the camera's field of view, there is a problem of losing the moving object. In light of this, we propose a moving target tracking scheme based on UAV vision (MTTS_UAV) in electric scenario. In particular, to ensure the real-time feature, we combine the improved target tracking algorithm and target detection algorithm to track the hidden dangers. To ensure the accuracy, we introduce two UAV flight control modules:heuristic mode and data-driven mode, so that the UAV's flight speed and direction can be adjusted adaptively according to the target movement. Extensive experiments have been conducted on a real-world dataset of hardhat personnel in real substations, which demonstrate that the average pixel error (APE) and average overlap rate (AOR) are 2.37 and 0.67 respectively and verify the effectiveness of the proposed method.

Key words: target tracking, target detection, deep learning, UAV vision, electric scenario

中图分类号:

TP37

冯雪, 杜猛俊, 向新宇, 钱锦, 张敏. 电力场景下基于无人机视觉的运动目标追踪方法[J]. 北京航空航天大学学报, 2022, 48(4): 586-594.

FENG Xue, DU Mengjun, XIANG Xinyu, QIAN Jin, ZHANG Min. UAV-vision-based moving target tracking scheme in electric scenario[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(4): 586-594.

参考文献

[1] REDMON J,FARHADI A.YOLOv3:An incremental improvement[EB/OL].(2018-04-08)[2021-11-01].https://arxiv.org/abs/1804.02767.
[2] HENRIQUES J F,RUI C,MARTINS P,et al.High-speed tracking with kernelized correlation filters[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(3):583-596.
[3] CHO K,MERRIENBOER B V,GVLÇEHRE C,et al.Learning phrase representations using RNN encoder-decoder for statistical machine translation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing,2014:1724-1734.
[4] VIOLA P,JONES M.Rapid object detection using a boosted cascade of simple features[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2001,1:511.
[5] SUGIMURA D,FUJIMURA T,HAMAMOTO T.Enhanced cascading classifier using multi-scale HOG for pedestrian detection from aerial images[J].International Journal of Pattern Recognition and Artificial Intelligence,2016,30(3):1655009.
[6] DALAL N,TRIGGS B.Histograms of oriented gradients for human detection[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2005:886-893.
[7] ZHU Q,AVIDAN S,YEH M C,et al.Fast human detection using a cascade of histograms of oriented gradients[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2006:1491-1498.
[8] GIRSHICK R.Fast R-CNN[C]//International Conference on Computer Vision.Piscataway:IEEE Press,2015:1440-1448.
[9] REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.
[10] LIU W,ANGUELOV D,ERHAN D.SSD:Single shot multibox detector[C]//European Conference on Computer Vision.Berlin:Springer,2016,9905:21-37.
[11] 吴冬梅, 王慧,李佳.基于改进Faster RCNN的安全帽检测及身份识别[J].信息技术与信息化,2020(1):17-20.WU D M,WANG H,LI J.Helmet detection and identification based on improved Faster RCNN[J].Journal of Information Technology and Informatization,2020(1):17-20(in Chiense).
[12] 董召杰.基于YOLOv3的电力线关键部件实时检测[J].电子测量技术,2019,42(43):173-178.DONG Z J.Key components of power line based on YOLOv3 real-time detection[J].Journal of Electronic Measurement Technique,2019,42(43):173-178(in Chiense).
[13] XIANG G.Real-time follow up tracking fast moving object with an active camera[C]//2nd Internationl Congress on Image and Signal Processing.Piscataway:IEEE Press,2009:2075-2078.
[14] ZHANG J E,WANG Y T,CHEN J,et al.A framework of surveillance system using a PTZ camera[C]//IEEE International Conference on Computer Science and Information Technology(ICCSIT).Piscataway:IEEE Press,2010:658-662.
[15] DONG Q,ZOU Q H.Visual UAV detection method with online feature classification[C]//Proceedings of 2017 IEEE 2nd Information Technology,Networking,Electronic and Automation Control Conference.Piscataway:IEEE Press,2017:464-467.
[16] 林勇,秦文静,戚国庆.基于机载视觉引导的无人机自主循迹研究[J].电子设计工程,2018,26(8):21-24.LIN Y,QING W J,QI G Q.Autonomous tracking research of UAV based on airborne visual guidance[J].Journal of Electronic Design Engineering,2018,26(8):21-24(in Chiense).
[17] XU Z H,ZHANG Y,LI H B,et al.A new shadow tracking method to locate the moving target in SAR imagery based on KCF[C]//Proceedings of the 2017 International Conference on Communications,Signal Processing,and Systems.Berlin:Springer,2017:2661-2669.
[18] FAN J X,LI D W,WANG H L,et al.UAV low altitude flight threat perception based on improved SSD and KCF[C]//International Conference on Control and Automation.Piscataway:IEEE Press,2019:356-361.
[19] 徐小超,严华.引入目标分块模型的核相关滤波目标追踪算法[J].计算机应用,2020,40(3):683-688.XU X C,YAN H.A target tracking algorithm based on kernel correlation filter is introduced[J].Computer Application,2020,40(3):683-688(in Chinese).
[20] HAN S B,XIE Z J,LI H J,et al.Scale estimation for KCF tracker based on feature fusion[C]//The 4th International Conference on Innovation in Artificial Intelligence.New York:ACM,2020:32-36.
[21] SIMON M,AMENDE K,KRAUS A,et al.Complexer-YOLO:Real-time 3D object detection and tracking on semantic point clouds[C]//Conference on Computer Vision and Pattern Recognition Workshops.Piscataway:IEEE Press,2019:1190-1199.
[22] ZHANG H B,QIN L F,LI J,et al.Real-time detection method for small traffic signs based on Yolov3[J].IEEE Access,2020,PP(99):1.
[23] WU Y,LIM J,YANG M H.Object tracking benchmark[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(9):1834-1848.
[24] KRISTAN M,MATAS J,LEONARDIS A,et al.The visual object tracking VOT2013 challenge results[C]//IEEE International Conference on Computer Vision Workshops.Piscataway:IEEE Press,2013:98-111.
[25] KRISTAN M,JIRI M,LEONARDIS A.The visual object tracking VOT2015 challenge results[C]//IEEE International Conference on Computer Vision Workshop.Piscataway:IEEE Press,2015:564-586.

电力场景下基于无人机视觉的运动目标追踪方法

UAV-vision-based moving target tracking scheme in electric scenario

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	罗杨宇, 贺佳宾, 谢东升, 陆珅宇, 宫剑. 颅缝早闭手术中颅骨切割方案生成方法[J]. 北京航空航天大学学报, 2022, 48(4): 578-585.
[2]	朱甜甜, 宋波, 毛捷, 廉国选. 基于深度学习的焊缝PAUT数据智能化分析方法[J]. 北京航空航天大学学报, 2022, 48(3): 504-513.
[3]	黄晨威, 程景春, 潘雄, 宋凝芳, 刘冰. 基于深度神经网络的像素级别可见光图像配准[J]. 北京航空航天大学学报, 2022, 48(3): 522-532.
[4]	刘春辉, 王美琳, 董赞亮, 王沛. 基于调制卷积神经网络的空地数据链信道估计[J]. 北京航空航天大学学报, 2022, 48(3): 533-543.
[5]	沈元, 严寒冰, 夏春和, 韩志辉. 一种基于深度学习的恶意代码克隆检测技术[J]. 北京航空航天大学学报, 2022, 48(2): 282-290.
[6]	兰凌强, 刘淇缘, 卢树华. 基于注意力机制与特征相关性的人脸表情识别[J]. 北京航空航天大学学报, 2022, 48(1): 147-155.
[7]	包壮壮, 赵学军. 基于EfficientDet的无预训练SAR图像船舶检测器[J]. 北京航空航天大学学报, 2021, 47(8): 1664-1672.
[8]	韩永赛, 马时平, 何林远, 李承昊, 朱明明, 许悦雷. 改进的深度神经网络下遥感机场区域目标检测[J]. 北京航空航天大学学报, 2021, 47(7): 1470-1480.
[9]	陆婷婷, 张尧, 阎岩, 杨利民, 杨卫东. 一种基于自动特征学习的陨石坑区域检测算法[J]. 北京航空航天大学学报, 2021, 47(5): 939-952.
[10]	陈科山, 郝宇, 何泓波, 李坤龙. 基于R-D SSD模型航空发动机安装工位检测算法[J]. 北京航空航天大学学报, 2021, 47(4): 682-689.
[11]	陈智能, 史存存, 李轩涯, 贾彩燕, 黄磊. 一种时空特征聚合的水下珊瑚礁鱼检测方法[J]. 北京航空航天大学学报, 2021, 47(3): 509-519.
[12]	徐晓华, 钱平, 王一达, 周昕悦, 徐汉麟, 徐李冰. 面向电力系统的多粒度隐患检测方法[J]. 北京航空航天大学学报, 2021, 47(3): 520-530.
[13]	李昊, 管荑, 王杉, 石玮, 刘子鑫, 刘晓川. 电力系统厂站接线图拓扑关系检测技术[J]. 北京航空航天大学学报, 2021, 47(3): 531-538.
[14]	李昊, 王杉, 耿玉杰, 王黎, 孙文昌, 苗纯源. 基于深度学习和图匹配的接线图检测与校核[J]. 北京航空航天大学学报, 2021, 47(3): 539-548.
[15]	谢彭宇, 徐新. 基于多尺度联合学习的行人重识别[J]. 北京航空航天大学学报, 2021, 47(3): 613-622.