Citation: | ZHOU H,HOU Q Y,BIAN C J,et al. An infrared small target detection network under various complex backgrounds realized on FPGA[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(2):295-310 (in Chinese) doi: 10.13700/j.bh.1001-5965.2021.0221 |
The infrared (IR) small target detection algorithm with high detection rate, low false alarm rate and good real-time performance has important application value in the field of IR remote sensing. Traditional IR small targets detection algorithms cannot guarantee the detection performance due to the low contrast and low signal-to-noise ratio (SNR) of small targets under various complex backgrounds. Based on robust infrared small target detection network (RISTDnet) proposed, for more diverse target structure characteristics and higher real-time processing performance requirements, an enhanced infrared small target detection network (EISTDnet) and its field programmable logic gate array (FPGA) based high-performance parallel processing method are proposed. In EISTDnet, a multi-scale small target feature extraction framework that combines manual feature methods and convolutional neural networks is constructed, the size of the convolution kernel is normalized by the idea of multi-level expansion, and real-time processing performance in the inference stage is effectively improved through deep data reuse and multi-dimensional loop parallel unfolding. Experimental results show that the EISTDnet realized on a single FPGA can quickly detect small targets with different sizes and low SNR in various complex backgrounds in real time. Compared with the existing 5 algorithms, the average detection rate is increased by 49.5% with a low false alarm rate of 10−3. Compared with RISTDnet, the real-time processing speed is increased by 1.33 times, and the detection rate of low SNR strip small targets is increased by 29.4%. EISTDnet has better effectiveness and robustness.
[1] |
CHEN C L P, LI H, WEI Y, et al. A local contrast method for small infrared target detection[J]. IEEE Transactions on Geoscience and Remote Sensing, 2014, 52(1): 574-581. doi: 10.1109/TGRS.2013.2242477
|
[2] |
HAN J, MA Y, ZHOU B, et al. A robust infrared small target detection algorithm based on human visual system[J]. IEEE Geoscience and Remote Sensing Letters, 2014, 11(12): 2168-2172. doi: 10.1109/LGRS.2014.2323236
|
[3] |
WEI Y, YOU X, LI H. Multiscale patch-based contrast measure for small infrared target detection[J]. Pattern Recognition, 2016, 58: 216-226. doi: 10.1016/j.patcog.2016.04.002
|
[4] |
HAN J, LIANG K, ZHOU B, et al. Infrared small target detection utilizing the multiscale relative local contrast measure[J]. IEEE Geoscience and Remote Sensing Letters, 2018, 15(4): 612-616. doi: 10.1109/LGRS.2018.2790909
|
[5] |
YAO S, CHANG Y, QIN X. A coarse-to-fine method for infrared small target detection[J]. IEEE Geoscience and Remote Sensing Letters, 2019, 16(2): 256-260. doi: 10.1109/LGRS.2018.2872166
|
[6] |
HAN J, LIU S, QIN G, et al. A local contrast method combined with adaptive background estimation for infrared small target detection[J]. IEEE Geoscience and Remote Sensing Letters, 2019, 16(9): 1442-1446. doi: 10.1109/LGRS.2019.2898893
|
[7] |
GAO C, MENG D, YANG Y, et al. Infrared patch-image model for small target detection in a single image[J]. IEEE Transactions on Image Processing, 2013, 22(12): 4996-5009. doi: 10.1109/TIP.2013.2281420
|
[8] |
DAI Y, WU Y, SONG Y, et al. Non-negative infrared patch-image model: Robust target-background separation via partial sum minimization of singular values[J]. Infrared Physics and Technology, 2017, 81: 182-194. doi: 10.1016/j.infrared.2017.01.009
|
[9] |
DAI Y, WU Y. Reweighted infrared patch-tensor model with both nonlocal and local priors for single-frame small target detection[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017, 10(8): 3752-3767. doi: 10.1109/JSTARS.2017.2700023
|
[10] |
ZHANG L, PENG L, ZHANG T, et al. Infrared small target detection via non-convex rank approximation minimization joint l2, 1 norm[J]. Remote Sensing, 2018, 10(11): 1821. doi: 10.3390/rs10111821
|
[11] |
ZHOU F, WU Y, DAI Y, et al. Detection of small target using schatten 1/2 quasi-norm regularization with reweighted sparse enhancement in complex infrared scenes[J]. Remote Sensing, 2019, 11(17): 2058. doi: 10.3390/rs11172058
|
[12] |
REN S, HE K, GIRSHICK R, et al. Faster r-cnn: Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149. doi: 10.1109/TPAMI.2016.2577031
|
[13] |
REDMON J, FARHADI A. Yolo9000: Better, faster, stronger[C]//In 30th IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2014: 6517–6525.
|
[14] |
JOSEPH R, ALI F. Yolov3: An incremental improvement[EB/OL]. (2018-04-08)[2021-04-21]. http: //arxiv. org/abs/1804.02767.
|
[15] |
LIU W, ANGUELOV D, ERHAN D, et al. SSD: Single shot multibox detector[C]//in 32th IEEE Conference on Computer Vision and Pattern Recognition. Amsterdam: University of Amsterdam, 2016.
|
[16] |
HOU Q, WANG Z, TAN F, et al. RISTDnet: Robust infrared small target detection network[EB/OL]. (2020-12-27) [2021-04-20]. https://doi.org/10.1109/LGRS.2021.3050828.
|
[17] |
李岩. 基于"高分五号"卫星红外影像的舰船尾迹特征分析[J]. 航天返回与遥感, 2020, 41(5): 106-113.
LI Y.The ship wake characterization study based on GF-5 infrared images[J]. Spacecraft Recovery & Remote Sensing,2020,41(5):106-113(in Chinese).
|