| Citation: | Zhao C G，Hu J Y，Yang X Y，et al. A post-training quantization method for CNN-Transformer hybrid models on UAV platforms[J]. Journal of Beijing University of Aeronautics and Astronautics，2026，52（9）：3066-3074 （in Chinese）
|
In recent years, drones have played increasingly important roles in various low-altitude production and service scenarios. Due to the limited storage and computing resources of edge computing platforms, the deployment performance of vision models becomes a bottleneck for various algorithm applications. The long-tail distribution of activation values in convolutional neural network (CNN)-Transformer hybrid models causes substantial quantization accuracy deterioration, an efficient post-training quantization method is proposed, which this study addresses by suggesting an effective post-training quantization technique. This method uses activation noise compensation (ANC) and adaptive difficulty migration to suppress the impact of outliers on quantization accuracy and improve inference efficiency. According to experimental results, the proposed method achieves less than 1% accuracy loss on typical models under 8-bit quantization, and it improves inference time after quantization by at most 200%. In summary, the proposed method significantly enhances vision model inference performance on edge devices and supports model deployment on low-altitude drone platforms.
| [1] |
Dai Z, Liu H, Le Q V, et al. Coatnet: marrying convolution and attention for all data sizes[J]. Advances in neural information processing systems, 2021, 34: 3965-3977.
|
| [2] |
KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[J]. Communications of the ACM, 2017, 60(6): 84-90.
|
| [3] |
Zeiler M D, Fergus R. Visualizing and understanding convolutional networks[C]//Proceedings of the Computer Vision-ECCV. Berlin: Springer, 2014: 818-833.
|
| [4] |
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[EB/OL]. (2014-09-04)[2025-06-20]. https://arxiv.org/abs/1409.1556.
|
| [5] |
Shafiq M, Gu Z Q. Deep residual learning for image recognition: a survey[J]. Applied Sciences, 2022, 12(18): 8972.
|
| [6] |
Liu Z, Lin Y T, Cao Y, et al. Swin transformer: hierarchical vision transformer using shifted windows[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2022: 9992-10002.
|
| [7] |
Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16x16 words: transformers for image recognition at scale[EB/OL]. (2020-12-22)[2025-06-20]. https://arxiv.org/abs/2010.11929.
|
| [8] |
Touvron H, Cord M, Douze M, et al. Training data-efficient image transformers & distillation through attention[EB/OL]. (2020-12-23)[2025-06-20]. https://arxiv.org/abs/2012.12877.
|
| [9] |
Selva J, Johansen A S, Escalera S, et al. Video transformers: a survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(11): 12922-12943.
|
| [10] |
Hashiguchi R, Tamaki T. Vision transformer with cross-attention by temporal shift for efficient action recognition[EB/OL]. (2022-04-01)[2025-06-21]. https://arxiv.org/abs/2204.00452.
|
| [11] |
Manzari O N, Ahmadabadi H, Kashiani H, et al. MedViT: a robust vision transformer for generalized medical image classification[J]. Computers in Biology and Medicine, 2023, 157: 106791.
|
| [12] |
Mehta S, Rastegari M. MobileViT: light-weight, general-purpose, and mobile-friendly vision transformer[EB/OL]. (2021-10-05)[2025-06-21]. https://arxiv.org/abs/2110.02178.
|
| [13] |
Maaz M, Shaker A, Cholakkal H, et al. EdgeNeXT: efficiently amalgamated CNN-transformer architecture forMobile vision applications[C]//Proceedings of the Computer Vision-ECCV Workshops. Berilin: Springer, 2023: 3-20.
|
| [14] |
Evangelidis G, Hu J, Li Y Y, et al. EfficientFormer: vision transformers at MobileNet speed[C]//Proceedings of the Advances in Neural Information Processing Systems 35. San Diego: Neural Information Processing Systems Foundation, Inc., 2022: 12934-12949.
|
| [15] |
Zhang D Q, Yang J L, Ye D, et al. LQ-nets: learned quantization for highly accurate and compact deep neural networks[C]//Proceedings of the Computer Vision-ECCV. Berlin: Springer, 2018: 373-390.
|
| [16] |
Dong P Y, Lu L, Lyu C, et al. PackQViT: faster sub-8-bit vision transformers via full and packed quantization on the mobile[C]// Proceedings of the Advances in Neural Information Processing Systems 36. San Diego: Neural Information Processing Systems Foundation, Inc., 2023: 9015-9028.
|
| [17] |
Liu Z H, Wang Y H, Han K, et al. Post-training quantization for vision transformer[EB/OL]. (2021-06-27)[2025-06-21]. https://arxiv.org/abs/2106.14156.
|
| [18] |
Lin Y, Zhang T Y, Sun P Q, et al. FQ-ViT: post-training quantization for fully quantized vision transformer[EB/OL]. (2021-11-27)[2025-06-21]. https://arxiv.org/abs/2111.13824.
|
| [19] |
Yuan Z H, Xue C H, Chen Y Q, et al. PTQ4ViT: post-training quantization for vision transformers with twin uniform quantization[C]//Proceedings of the Computer Vision-ECCV. Berlin: Springer, 2022: 191-207.
|
| [20] |
Jacob B, Kligys S, Chen B, et al. Quantization and training of neural networks for efficient integer-arithmetic-only inference[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2018: 2704-2713.
|
| [21] |
Nagel M, Ali Amjad R, Van Baalen M, et al. Up or down adaptive rounding for post-training quantization[C]//Proceedings of the 37th International Conference on Machine Learning. New York: ACM, 2020: 7197-7206.
|
| [22] |
Lee J, Kwon Y, Park S, et al. Q-HyViT: post-training quantization of hybrid vision transformers with bridge block reconstruction for IoT systems[J]. IEEE Internet of Things Journal, 2024, 11(22): 36384-36396.
|
| [23] |
Kim N J, Lee J, Kim H. HyQ: hardware-friendly post-training quantization for CNN-transformer hybrid networks[C]//Proceedings of the 33th International Joint Conference on Artificial Intelligence . New York: ACM, 2024: 4291-4299.
|
| [24] |
Mehta S, Rastegari M. Separable self-attention for mobile vision transformers[EB/OL]. (2022-06-06)[2025-06-21]. https://arxiv.org/abs/2206.02680.
|
| [25] |
Li Z K, Xiao J R, Yang L W, et al. RepQ-ViT: scale reparameterization for post-training quantization of vision transformers[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2024: 17181-17190.
|
| [26] |
Wu D, Tang Q, Zhao Y L, et al. EasyQuant: post-training quantization via scale optimization[EB/OL]. (2020-06-30)[2025-06-21]. https://arxiv.org/abs/2006.16669.
|
| [27] |
Chen J M, Chao Y H, Wang Y J, et al. QuantTune: optimizing model quantization with adaptive outlier-driven fine tuning[EB/OL]. (2024-03-11)[2025-06-21]. https://arxiv.org/abs/2403.06497.
|
Figures(4) / Tables(3)
Copyright © Journal of Beijing University of Aeronautics and Astronautics
Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn
Supported by:
Beijing Renhe Information Technology Co., Ltd.
DownLoad:
