| Citation: | LI Huifeng, YI Wenfeng, CHENG Xiaominget al. Target tracking control algorithm based on approximate dynamic programming[J]. Journal of Beijing University of Aeronautics and Astronautics, 2019, 45(3): 597-605. doi: 10.13700/j.bh.1001-5965.2018.0353(in Chinese)
|
The control algorithm for the target tracking problem cannot be well adapted to the problem of large-scale maneuver flight or even game with us. This paper proposes a control algorithm for target tracking using approximate dynamic programming. The game algorithm is used to train our UAV to form an experience. The positions of both sides are taken as known quantity and the roll direction as the control quantity. The relative positions of two objects are used to derive their features and then an approximate function is formed. The rollout algorithm is used to obtain the optimal decision, and the flexible and effective tracking of tracking targets and even gaming targets can be achieved. The simulation results verify the effectiveness of approximate dynamic programming for control algorithms.
| [1] |
卢虎川, 李佩霞, 王栋.目标跟踪算法综述[J].模式识别与人工智能, 2018, 31(1):61-76.
LU H C, LI P X, WANG D.Visual object tracking:A survey[J].Pattern Recognition and Artificial Intelligence, 2018, 31(1):61-76(in Chinese).
|
| [2] |
CHENG Y Z. Meanshift, mode seeking, and clustering[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, 17(8):790-799. doi: 10.1109/34.400568
|
| [3] |
ADAM A, RIVLIN E, SHIMSHONI I.Robust fragments-based tracking using the integral histogram[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Piscataway, NJ: IEEE Press, 2006: 798-805.
|
| [4] |
TURK M, PENTLAND A.Eigenfaces for recognition[J].Journal of Cognitive Neuroscience, 1991, 3(1):71-86. doi: 10.1162/jocn.1991.3.1.71
|
| [5] |
TANG M, FENG J.Multi-kernel correlation filter for visual tracking[C]//Proceedings of the IEEE International Conference on Computer Vision.Piscataway, NJ: IEEE Press, 2016: 3038-3046.
|
| [6] |
LI Y, ZHU J K.A scale adaptive kernel correlation filter tracker with feature integration[C]//Proceedings of the European Conference on Computer Vision.Berlin: Springer, 2014: 254-265.
|
| [7] |
DANELLJAN M, HGER G, KHAN F S.Accurate scale estimation for robust visual tracking[EB/OL].[2017-11-27].
|
| [8] |
HENRIQUES J F, CASEIRO R, MARINS P, et al. High-speed tracking with kernelized correlation filters[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 37(3):583-596.
|
| [9] |
LI Y, ZHU J K, HOI S C H.Reliable patch trackers: Robust visual tracking by exploiting reliable patches[C]//Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.Piscataway, NJ: IEEE Press, 2015: 353-361.
|
| [10] |
MA C, HUANG J B, YANG X K, et al.Hierarchical convolutional features for visual tracking[C]//Proceedings of the IEEE International Conference on Computer Vision.Piscataway, NJ: IEEE Press, 2015: 3074-3082.
|
| [11] |
魏庆来.基于近似动态规划的非线性系统最优控制研究[D].沈阳: 东北大学, 2008: 6-8.
WEI Q L.Researches on optimal control of nonlinear systems based on approximate dynamic programming[D].Shenyang: Northeastern University, 2008: 6-8(in Chinese).
|
| [12] |
BELLMAN R.On the theory of dynamic programming[J].Proceedings of the National Academy of Sciences of the United States of America, 1952, 38(8):716-719. doi: 10.1073/pnas.38.8.716
|
| [13] |
ISAACS R.Games of pursuit[M].Santa Monica, CA:The Rand Corporation, 1951:256-257.
|
| [14] |
AUSTIN F, CARBONE G, FALCO M, et al.Game theory for automated maneuvering during air-to-air combat[J] Journal of Guidance, Control, and Dynamics, 1990, 13(6):1143-1149. doi: 10.2514/3.20590
|
| [15] |
MCGREW J S, HOW J P, WILLIAMS B, et al.Air combat strategy using approximate dynamic programming[C]//AIAA Guidance, Navigation, and Control Conference and Exhibit.Reston: AIAA, 2008: 6-13. doi: 10.2514/1.46815
|
| [16] |
ANWAR H, ZHU Q Y.Minimax game-theoretic approach to multiscale H-infinity optimal filtering[C]//2017 IEEE Global Conference on Signal and Information Processing(GlobalSIP).Piscataway, NJ: IEEE Press, 2017: 853-857.
|
| [17] |
SPRINKLE J, EKLUND J, KIM H, et al.Encoding aerial pursuit/evasion games with fixed wing aircraft into a nonlinear model predictive tracking controller[C]//Proceedings of 200443rd IEEE Conference on Decision and Control(CDC).Piscataway, NJ: IEEE Press, 2004: 2609-2614.
|
| [18] |
EKLUND J, SPRINKLE J, KIM H, et al.Implementing and testing a nonlinear model predictive tracking controller for aerial pursuit/evasion games on a fixed wing aircraft[C]//Proceedings of 2005 American Control Conference.Piscataway, NJ: IEEE Press, 2005: 1509-1514.
|
| [19] |
SHAW R.Fighter combat tactics and maneuvering[M].Annapolis:Naval Institute Press, 1985:12-15.
|
| [20] |
POWELLW B.Approximate dynamic programming solving the curses of dimensionality[M].2nd ed.Hoboken:John Wiley & Sons, Inc., 2011:305-307.
|
| [1] | LIU Guanmian, ZHANG Fan, WEN Qing, YANG Kangzhi, QIN Hejun, CHENG Zhihang. Research on installation location of ice detector for large amphibious aircraft[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2025.0061 |
| [2] | LI L Y，YANG R N，WANG Y，et al. CAP planning method based on elliptic fitting of optimal detection routes[J]. Journal of Beijing University of Aeronautics and Astronautics，2025，51（1）：293-302 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0978. |
| [3] | LI Y，ZHOU Z Y，CAI J. Extensible evaluation model of aircraft tire hydroplaning risk based on connection cloud[J]. Journal of Beijing University of Aeronautics and Astronautics，2025，51（3）：705-711 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2023.0136. |
| [4] | XU Zhiqiang, GUO Yudong, ZHANG Wenqiang, LIU Yatong, LI Ang, WANG Anni. Research on aerodynamic flow field characteristics of guide-injected icing detector[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0767 |
| [5] | HE T Y，DONG Y，ZHOU S M，et al. Performance analysis and optimization of buffering/walking integrated lunar probe[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（8）：2547-2556 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0634. |
| [6] | LIU G X，ZHANG J T，DING D D. Lossy point cloud geometry compression based on Transformer[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（2）：634-642 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0412. |
| [7] | XING H X，XING Q H. An optimal scheduling model for scintillation detection of netted radars[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（12）：3884-3893 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0924. |
| [8] | YANG Yue, MA Bo-kai, CHENG Long. A cognitive load assessment method for multifactorial flight conflict detection[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0816 |
| [9] | YIN Jihao, WEI Xiaodong, CUI Linyan, WU Wenjun, ZHANG Xiaoming, LIU Chuankai. A survey of artificial intelligence technology for asteroid exploration[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0724 |
| [10] | JING Quan, LI Mingtao, WANG Youliang. Optimization and Search Sequence for Transfer Trajectory Status in Callisto Exploration Mission[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0158 |
| [11] | HE Lan, LIU Qiang, YANG Yan-chu, ZHU Rong-chen, ZHOU Jiang-hua. Influence of cold cloud radiation to the thermal-dynamic characteristics of super-pressure balloon[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0435 |
| [12] | SHI F Y，ZHENG X J，JIANG L H，et al. Point cloud registration algorithm for non-cooperative targets based on Hough transform[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（8）：2071-2078 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2021.0575. |
| [13] | MIAO D，YANG D K，XU Z C，et al. Low-altitude, slow speed and small target detection probability of passive radar based on GNSS signals[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（3）：657-664 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2021.0271. |
| [14] | GAO T F，KONG L G，SU B，et al. Design and simulation of detector for outer heliosphere pickup ions[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（2）：367-377 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2021.0243. |
| [15] | ZHANG Wen-qiang, CHEN Yi-yi, LEI Guo-qiang, WANG Guang-yu, ZHI Ya-fei, MAO Xue-rui. Data Processing Methodology of the Icing Meteorological Detection in FAR 25 Appendix C[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0569 |
| [16] | LI J，ZHANG R C，PAN C Y，et al. Micro immune optimization algorithm for single objective probabilistic constrained programming[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（3）：525-537 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2021.0288. |
| [17] | LI Jingqiang, FAN Tianchen, ZHOU Yanru, FANG Qiu. Comprehensive evaluation on capability of civil aviation supervisor team based on cloud model[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(12): 2425-2433. doi: 10.13700/j.bh.1001-5965.2022.0363 |
| [18] | LIAO Xiang, ZHENG Jing, XU Yongsheng, XIE Chengqing, DING Qiangqiang. Precise references orbit design of miniSAR satellite[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(12): 2442-2449. doi: 10.13700/j.bh.1001-5965.2021.0141 |
| [19] | HU Kai, ZHAO Jian, LIU Yu, NIU Yukai, JI Gang. Images inpainting via structure guidance[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(7): 1269-1277. doi: 10.13700/j.bh.1001-5965.2021.0004 |
| [20] | LI Yongping, ZHU Guangwu, ZHENG Xiaoliang, AI Jiangzhao, YAN Yafei, ZHOU Jianhua. In-situ measurement of atmospheric density in very low Earth orbits[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(10): 1875-1882. doi: 10.13700/j.bh.1001-5965.2021.0618 |
Figures(20) / Tables(5)
Copyright © Journal of Beijing University of Aeronautics and Astronautics
Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn
Supported by:
Beijing Renhe Information Technology Co., Ltd.
Liu Chengrui, Zhang Qingzhen, Ren Zhanget al. Fault diagnosis technology of launch vehicle based on distributed expert system[J]. Journal of Beijing University of Aeronautics and Astronautics, 2007, 33(08): 930-932. (in Chinese)
DownLoad:
