基于态势认知的无人机集群围捕方法

doi:10.13700/j.bh.1001-5965.2020.0274

北京航空航天大学学报 ›› 2021, Vol. 47 ›› Issue (2): 424-430.doi: 10.13700/j.bh.1001-5965.2020.0274

• 论文 • 上一篇

基于态势认知的无人机集群围捕方法

吴子沉, 胡斌

空军工程大学航空工程学院, 西安 710038

收稿日期:2020-06-17 发布日期:2021-03-08
通讯作者: 胡斌 E-mail:singer533@163.com
作者简介:吴子沉,男,硕士研究生。主要研究方向:飞行器导航制导与智能控制;胡斌,男,硕士,副教授。主要研究方向:导弹制导与控制。
基金资助:
科技创新2030-“新一代人工智能”重大项目（2018AAA0102403）；国家自然科学基金（61573373）

Swarm rounding up method of UAV based on situation cognition

WU Zichen, HU Bin

Aeronautics Engineering College, Air Force Engineering University, Xi'an 710038, China

Received:2020-06-17 Published:2021-03-08

摘要/Abstract

摘要： 无人机集群围捕是智能无人机“蜂群”作战的一种重要任务方式。现有集群围捕方法大多建立在环境已知的基础上，面对未知的任务环境时围捕策略经常性失效。针对此问题，提出了基于态势认知的发育模型，探索一种对环境适应性较佳的围捕方法。首先，对集群围捕行为分解，将围捕离散化；然后，基于深度Q神经网络（DQN），设计一种围捕策略的生成方法；最后，建立状态-策略知识库，并通过大量有效数据的训练，针对不同环境获得不同的策略，对知识库进行发育。仿真结果表明：提出的基于态势认知的发育模型，能够有效适应不同环境，完成不同环境下的围捕。

关键词: 无人机, 集群围捕, 态势认知, 深度Q神经网络(DQN), 自主发育

Abstract: UAV swarm rounding up is an important mission mode of intelligent UAV swarm operation. Most of the existing swarm rounding up methods are based on the known environment, and the strategy often fails in the face of unknown mission environment. To solve this problem, a developmental model based on situation cognition is proposed in this paper to explore a better adaptive method of rounding up. First, the swarm rounding up behavior is decomposed and the rounding up is discretized. Then, based on the Deep Q-Network (DQN), a method of generating the rounding up strategy is designed. Finally, the state-strategy knowledge base is established, and through the training of a large amount of effective data, different strategies are obtained according to different environments to develop the knowledge base. The simulation results show that the proposed developmental model based on situation cognition can effectively adapt to different environments and complete the rounding up in different environments.

Key words: UAV, swarm rounding up, situation cognition, Deep Q-Network (DQN), autonomous development

中图分类号:

V249.3
TP24

吴子沉, 胡斌. 基于态势认知的无人机集群围捕方法[J]. 北京航空航天大学学报, 2021, 47(2): 424-430.

WU Zichen, HU Bin. Swarm rounding up method of UAV based on situation cognition[J]. Journal of Beijing University of Aeronautics and Astronautics, 2021, 47(2): 424-430.

参考文献

[1] 段海滨,李沛.基于生物群集行为的无人机集群控制[J].科技导报,2017,35(7):17-25.DUAN H B,LI P.Autonomous control for unmanned aerial vehicle swarms based on biological collective behaviors[J].Science & Technology Review,2017,35(7):17-25(in Chinese).
[2] OLFATISABER R.Flocking for multi-agent dynamic systems:Algorithms and theory[J].IEEE Transactions on Automatic Control,2006,51(3):401-420.
[3] 黄天云,陈雪波,徐望宝.基于松散偏好规则的群体机器人系统自组织协作围捕[J].自动化学报,2013,39(1):57-68.HUANG T Y,CHEN X B,XU W B.A self-organizing cooperative hunting by swarm robotic systems based on loose-preference rule[J].Acta Automatica Sinica,2013,39(1):57-68(in Chinese).
[4] 李瑞珍,杨惠珍,萧丛杉.基于动态围捕点的多机器人协同策略[J].控制工程,2019,26(3):510-514.LI R Z,YANG H Z,XIAO C S.Cooperative hunting strategy for multi-mobile robot systems based on dynamic hunting points[J].Control Engineering of China,2019,26(3):510-514(in Chinese).
[5] 张子迎,吕骏,徐东,等.能量均衡的围捕任务分配方法[J].国防科技大学学报,2019,41(2):107-114.ZHANG Z Y,LV J,XU D,et al.Method of capturing task allocation based on energy balabce[J].Journal of National University of Defense Technology,2019,41(2):107-114(in Chinese).
[6] UEHARA S,TAKIMOTO M,KAMBAYASHI Y.Mobile agent based obstacle avoidance in multi-robot hunting[M]//GEN M,GREEN D,KATAI O,et al.Intelligent and evolutionary systems.Berlin:Springer,2017:443-452.
[7] VLAHOV B,SQUIRES E,STRICKLAND L,et al.On developing a UAV pursuit-evasion policy using reinforcement learning[C]//201817th IEEE International Conference on Machine Learning and Applications (ICMLA).Piscataway:IEEE Press,2018:859-864.
[8] 谭浪,巩庆海,王会霞.基于深度强化学习的追逃博弈算法[J].航天控制,2018,36(6):3-8.TAN L,GONG Q H,WANG H X.Pursuit-evasion game algorithm based on deep reinforcement learning[J].Aerospace Control,2018,36(6):3-8(in Chinese).
[9] TENG T H,TAN A H,ZURADA J M.Selforganizing neural networks integrating domain knowledge and reinforcement learning[J].IEEE Transactions on Neural Networks and Learning Systems,2014,26(5):889-902.
[10] BEVERIDGE A,CAI Y.Pursuit-evasion in a two-dimensional domain[J].ARS Mathematica Contemporanea,2017,13(1):187-206.
[11] LIU J,LIU S,WU H,et al.A pursuit-evasion algorithm based on hierarchical reinforcement learning[C]//2009 International Conference on Measuring Technology and Mechatronics Automation.Piscataway:IEEE Press,2009,2:482-486.
[12] BILGIN A T,KADIOGLU-URTIS E.An approach to multiagent pursuit evasion games using reinforcement learning[C]//2015 International Conference on Advanced Robotics (ICAR).Piscataway:IEEE Press,2015:164-169.
[13] AWHEDA M D,SCHWARTZ H M.A fuzzy reinforcement learning algorithm using a predictor for pursuit-evasion games[C]//2016 Annual IEEE Systems Conference(SysCon).Piscataway:IEEE Press,2016:1-8.
[14] LOWE R,WU Y I,TAMAR A,et al.Multi-agent actor-critic for mixed cooperative-competitive environments[C]//Advances in Neural Information Processing Systems,2017:6379-6390.
[15] VAN HASSELT H,GUEZ A,SILVER D,et al.Deep reinforcement learning with double Q-learning[C]//National Conference on Artificial Intelligence,2016:2094-2100.
[16] HAUSKNECHT M,STONE P.Deep recurrent Q-learning for partially observable MDPS[EB/OL].(2015-07-23)[2020-06-01].https://arxiv.org/abs/1507.06527.
[17] HESTER T,VECERIK M,PIETQUIN O,et al.Deep Q-learning from demonstrations[C]//National Conference on Artificial Intelligence,2018:3223-3230.
[18] 魏瑞轩,张启瑞,许卓凡.类脑发育无人机防碰撞控制[J].控制理论与应用,2019,36(2):13-20.WEI R X,ZHANG Q R,XU Z F.A brain-like mechanism for developmental UAVs' collision avoidance[J].Control Theory & Applications,2019,36(2):13-20(in Chinese).
[19] MNIH V,KAVUKCUOGLU K,SILVER D,et al.Human-level control through deep reinforcement learning[J].Nature,2015,518:529-533.
[20] MORDATCH I,ABBEEL P.Emergence of grounded compositional language in multi-agent populations[EB/OL].(2017-03-15)[2020-06-01].https://arxiv.org/abs/1703.04908.

基于态势认知的无人机集群围捕方法

Swarm rounding up method of UAV based on situation cognition

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	沈林成, 孔维玮, 牛轶峰. 无人机自主降落地基/舰基引导方法综述[J]. 北京航空航天大学学报, 2021, 47(2): 187-196.
[2]	吴江, 陈恩民, 高翼捷, 刘一芃, 高鑫, 夏洁. 小型旋翼无人机潜射控制器设计[J]. 北京航空航天大学学报, 2021, 47(2): 213-222.
[3]	梁天骄, 陈晓明, 杨朝旭, 王海峰, 梁庆. 舰载无人机滑行轨迹控制方法[J]. 北京航空航天大学学报, 2021, 47(2): 289-296.
[4]	刘森琪, 王鸿, 于宁宇, 郝礼楷. 基于信息素启发狼群算法的UAV集群火力分配[J]. 北京航空航天大学学报, 2021, 47(2): 297-305.
[5]	丁超, 魏瑞轩, 周凯. 基于时域映射的多无人机系统给定时间分布式最优集结[J]. 北京航空航天大学学报, 2021, 47(2): 315-322.
[6]	张令, 段海滨, 雍婷, 邓亦敏, 魏晨. 基于寒鸦配对交互行为的无人机集群编队控制[J]. 北京航空航天大学学报, 2021, 47(2): 391-397.
[7]	李桂亮, 毕海洋, 洪雪健, 金琳乘. 基于DE-DPSO-GT-SA算法的协同多任务分配[J]. 北京航空航天大学学报, 2021, 47(1): 90-96.
[8]	张启钱, 许卫卫, 张洪海, 邹依原, 陈雨童. 复杂低空物流无人机路径规划[J]. 北京航空航天大学学报, 2020, 46(7): 1275-1286.
[9]	赵炜, 黄江流, 周洲, 张顺家, 毕鹏. 菱形翼布局太阳能无人机螺旋桨滑流影响研究[J]. 北京航空航天大学学报, 2020, 46(7): 1296-1306.
[10]	孙逸轩, 白俊强, 刘金龙, 孙智伟. 基于受限参变率的飞翼无人机舵面阵风减缓控制[J]. 北京航空航天大学学报, 2020, 46(7): 1387-1397.
[11]	崔恺, 曾国奇, 林伟, 全权. 一种基于图论的机场空域无人机流量控制方法[J]. 北京航空航天大学学报, 2020, 46(5): 978-987.
[12]	柳亚川, 寇艳红. 同步式GPS欺骗干扰信号生成技术研究与设计[J]. 北京航空航天大学学报, 2020, 46(4): 814-821.
[13]	李继广, 董彦非, 杨芳, 申洋. 基于反步控制方法的菱形翼无人机起飞滑跑控制[J]. 北京航空航天大学学报, 2020, 46(3): 496-504.
[14]	陈映雪, 丁文锐, 李红光, 王蒙, 王旭. 基于视频帧间运动估计的无人机图像车辆检测[J]. 北京航空航天大学学报, 2020, 46(3): 634-642.
[15]	何吕龙, 张佳强, 侯岳奇, 梁晓龙, 柏鹏. 有向通信拓扑和时延条件下的无人机集群时变编队控制[J]. 北京航空航天大学学报, 2020, 46(2): 314-323.