LCU-level video bit allocation algorithm based on two-layer game in low-altitude communication environment
-
摘要:
针对低空通信场景下视频编码效率低与码率利用率不足的问题,提出一种基于双层混合博弈模型的最大编码单元(LCU)级比特分配(BA)优化(HGLA)算法。该算法以LCU为基本单元,依据纹理复杂度、运动强度与边缘信息进行区域划分,并构建高、低复杂度区域的差异化BA机制,其中,高复杂度区域通过非合作博弈与合作博弈相结合实现比特协调分配,低复杂度区域引入空间加权机制以提高码率利用率,并采用全局量化参数(QP)平滑策略增强视觉连续性。在4种低码率场景下进行实验验证,所提算法在峰值信噪比(PSNR)、结构相似性指数(SSIM)和主观质量方面均取得显著提升,特别是在目标码率为16 Kbit/s时,相比高效视频编码(HEVC)模型采用的码率控制(RC)算法HM-RC、基于帧级多层感知机(MLP)的BA 算法、基于简化立方率失真模型的帧内RC算法、基于通用视频编码(VVC)的变分辨率RC算法4种典型算法,PSNR、SSIM和主观意见得分(MOS)分别平均提升了3.34%、2.16%和9.8%,表明其在码率利用效率和图像质量保持方面具有良好的实用性与适应性。
Abstract:This paper addresses the issues of low video coding efficiency and insufficient bit rate utilization in low-altitude communication scenarios by proposing an largest coding unit (LCU)-level bit allocation (BA) optimization based on two-layer hybrid game model (HGLA) algorithm. Using the LCU as the basic unit, the algorithm performs region partitioning according to texture complexity, motion intensity, and edge information, and establishes a differentiated BA mechanism for high- and low-complexity regions. In particular, a combination of cooperative and non-cooperative game models is used for high-complexity regions to achieve coordinated BA; for low-complexity regions, a global quantization parameter (QP) smoothing strategy and a spatial weighting mechanism are introduced to improve bit rate utilization efficiency and visual continuity. Finally, experimental validation under four low-bit rate scenarios demonstrates that the proposed method achieves significant improvements in peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and subjective quality. Specifically, at the target bit rate of 16 Kbit/s, compared with four baseline methods including the high efficiency video coding (HEVC) rate control (RC) algorithm HM-RC and the frame-level multilayer perceptron (MLP)-based BA algorithm, the intra-frame rate control algorithm based on a simplified cubic rate-distortion model, and the variable-resolution rate control algorithm based on versatile video coding (VVC), the proposed method achieves average performance gains of 3.34%, 2.16%, and 9.8% in PSNR, SSIM, and mean opinion score (MOS), respectively, demonstrating its excellent practicality and adaptability in improving bit rate utilization efficiency and preserving image quality.
-
Key words:
- rate control /
- low bit rate /
- game theory /
- bit allocation /
- reliable transmission of low-altitude video
-
表 1 HEVC 测试序列
Table 1. HEVC test sequence
类别 序列名称 帧数 帧率/(帧·s−1) A Traffic 150 30 A PeopleOnStreet 150 30 A Nebuta 300 60 A SteamLocomotive 300 60 B Kimono 240 24 B ParkScene 240 24 B Cactus 500 50 B BasketballDrive 500 50 C RaceHorses 300 30 C BQMall 600 60 C PartyScene 500 50 C BasketballDrill 500 50 D RaceHorses 300 30 D BQSquare 600 60 D BlowingBubbles 500 50 D BasketballPass 500 50 表 2 目标码率为16 Kbit/s场景下实验对比
Table 2. Experimental comparison under the target bit rate of 16 Kbit/s
表 3 目标码率为128 Kbit/s场景下实验对比
Table 3. Experimental comparison under the target bit rate of 128 Kbit/s
表 4 目标码率为256 Kbit/s场景下实验对比
Table 4. Experimental comparison under the target bit rate of 256 Kbit/s
表 5 目标码率为512 Kbit/s场景下实验对比
Table 5. Experimental comparison under the target bit rate of 512 Kbit/s
表 6 本文提出的各项因子对HGLA算法的影响
Table 6. The influence of various factors proposed in this paper on the HGLA algorithm
实验配置 PSNR/dB SSIM MOS HGLA 41.76 0.957 4.41 无区域划分模型 40.05 0.944 3.92 仅非合作博弈 40.49 0.948 4.01 无空间权重 41.31 0.949 4.07 无QP平滑处理 41.54 0.951 4.10 -
[1] 余润泽, 苏敏杰, 周烨挺, 等. 低空智慧城市无人机系统网络安全分析及防护策略研究[J]. 电信工程技术与标准化, 2025, 38(3): 61-67.Yu R Z, Su M J, Zhou Y T, et al. Analysis of network security and research on protection strategies for low altitude smart city unmanned aerial vehicle systems[J]. Telecom Engineering Technics and Standardization, 2025, 38(3): 61-67(in Chinese). [2] 朱迪锋, 张雅霏, 龚轩, 等. 高动态链路下基于主机状态感知的视频码率自适应算法[J/OL]. 北京航空航天大学学报, 2024 (2024-10-10)[2025-03-20]. https://link.cnki.net/urlid/11.2625.V.20241009.1858.002.Zhu D F, Zhang Y F, Gong X, et al. Host-state awareness based video bitrate adaptation algorithm in highly dynamic links[J/OL]. Journal of Beijing University of Aeronautics and Astronautics, 2024 (2024-10-10)[2025-03-20]. https://link.cnki.net/urlid/11.2625.V.20241009.1858.002(in Chinese). [3] He J, Yang F Z. Efficient frame-level bit allocation algorithm for H. 265/HEVC[J]. IET Image Processing, 2017, 11(4): 245-257. [4] Liu Z Z, Pan X, Li Y M, et al. A game theory based CTU-level bit allocation scheme for HEVC region of interest coding[J]. IEEE Transactions on Image Processing, 2021, 30: 794-805. [5] Gao W, Kwong S, Jia Y H. Joint machine learning and game theory for rate control in high efficiency video coding[J]. IEEE Transactions on Image Processing, 2017, 26(12): 6074-6089. [6] Ahmad I, Luo J C. On using game theory to optimize the rate control in video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2006, 16(2): 209-219. [7] Luo J C, Ahmad I, Sun Y. Controlling the bit rate of multi-object videos with noncooperative game theory[J]. IEEE Transactions on Multimedia, 2010, 12(2): 97-107. [8] Park H, Van Der Schaar M. Bargaining strategies for networked multimedia resource management[J]. IEEE Transactions on Signal Processing, 2007, 55(7): 3496-3511. [9] Wang X, Kwong S, Zhang Y. Applying game theory to rate control optimization for hierarchical B-pictures[J]. IEEE Transactions on Broadcasting, 2013, 59(4): 591-601. [10] Gao W, Kwong S, Zhou Y, et al. SSIM-based game theory approach for rate-distortion optimized intra frame CTU-level bit allocation[C]//Proceedings of the IEEE Transactions on Multimedia. Piscataway: IEEE Press, 2016: 988-999. [11] Lin J L, Huang A P, Zhao T S, et al. λ-domain VVC rate control based on Nash equilibrium[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2023, 33(7): 3477-3487. [12] Zhao T S, Lin J L, Song Y J, et al. Game theory-driven rate control for 360-degree video coding[C]//Proceedings of the 29th ACM International Conference on Multimedia. New York: ACM, 2021: 3998-4006. [13] 公衍超, 王玲, 刘颖, 等. 视频主观观测实验启发的HEVC感知帧内码率控制[J]. 通信学报, 2021, 42(8): 90-102.Gong Y C, Wang L, Liu Y, et al. HEVC perceptual intra-frame rate control inspired by video subjective observation experiment[J]. Journal on Communications, 2021, 42(8): 90-102(in Chinese). [14] 李维, 杨付正, 任鹏. 考虑视频内容的H.265/HEVC帧层码率分配算法[J]. 通信学报, 2015, 36(9): 76-81.Li W, Yang F Z, Ren P. H.265/HEVC frame-level bitrate allocation algorithm considering video content[J]. Journal on Communications, 2015, 36(9): 76-81(in Chinese). [15] 崔士明, 黄新彭, 林兴斌, 等. 基于感兴趣区域及LCU特征的码率分配算法[J]. 工业控制计算机, 2024, 37(3): 15-17.Cui S M, Huang X P, Lin X B, et al. Rate allocation algorithm based on region of interest and LCU feature[J]. Industrial Control Computer, 2024, 37(3): 15-17(in Chinese). [16] Liu F Y, Chen Z Z. Multi-objective optimization of quality in VVC rate control for low-delay video coding[J]. IEEE Transactions on Image Processing, 2021, 30: 4706-4718. [17] He L Q, He X H, Xiong S H, et al. Efficient rate control in versatile video coding with adaptive spatial-temporal bit allocation and parameter updating[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2023, 33(6): 2920-2934. [18] Biatek T, Raulet M, Travers J F, et al. Efficient quantization parameter estimation in HEVC based on ρ-domain[C]//Proceedings of the 2014 22nd European Signal Processing Conference. Piscataway: IEEE Press, 2014: 296-300. [19] Nash J. Non-cooperative games[J]. The Annals of Mathematics, 1951, 54(2): 286. [20] Driessen T. Cooperative games, solutions and applications[M]. Berlin: Springer, 1988. [21] Zhu D F, Zhang Y F, Gong X, et al. DTS-BWpredictor: dual-scale temporal strategy based bandwidth prediction in highly dynamic links[J]. Computer Networks, 2025, 259: 111071. [22] Raufmehr F, Salehi M R, Abiri E. A frame-level MLP-based bit-rate controller for real-time video transmission using VVC standard[J]. Journal of Real-Time Image Processing, 2021, 18(3): 751-763. [23] Wang Y Z, Zhang J Q, Sun S L. Rate control for VVC intra coding with simplified cubic rate-distortion model[C]//Proceedings of the 2023 IEEE 25th International Workshop on Multimedia Signal Processing. Piscataway: IEEE Press, 2023: 1-6. [24] Fu T L, Zhang K, Zhang L, et al. Rate control with resolution changes for VVC[C]//Proceedings of the 2023 IEEE International Symposium on Circuits and Systems. Piscataway: IEEE Press, 2023: 1-5. -


下载: