-
摘要:
在虚拟现实(VR)视频流媒体传输中,如何在带宽受限的条件下提高用户的质量体验(QoE)是一项巨大的挑战。为了更好地提高资源利用率和用户的QoE,提出了一个面向多用户的QoE驱动上下行链路联合的VR视频流媒体自适应采集与传输系统。与传统的VR视频无线传输系统不同的是,所提系统考虑了上行传输部分。其中,视频服务器根据上行链路和下行链路的带宽信息、用户的实时视角信息,以速率自适应为基础进行码率选择和资源分配。定义了QoE驱动的码率选择和资源分配问题,以最大化整个系统所有用户的QoE值。提出了联合KKT条件和分支定界法的速率自适应选择算法。实验结果表明:所提系统可以有效提高所有用户的QoE值,与上行链路平均分配资源算法相比,系统QoE值提高了14.27%,同时与传统的VR视频速率自适应算法相比,系统QoE值提高了23.47%。
Abstract:In virtual reality (VR) video streaming media transmission, how to further improve user's quality of experience (QoE) under bandwidth-constrained conditions is a huge challenge. In order to improve resource utilization rate and user QoE, a multi-user QoE-driven uplink and downlink joint VR video streaming media adaptive acquisition and transmission system is proposed, which is different from the traditional VR video wireless transmission system. The proposed system considers the uplink transmission part. The video server selects code rate and allocates resources based on the rate adaptation based on the bandwidth information of the uplink channel and the downlink channel and the real-time view information of the user. In addition, we define the problem of QoE-driven rate selection and resource allocation to maximize the QoE value of all users across the system. Finally, we propose an optimal adaptive rate selection algorithm combining the KKT condition and the branch and bound method. The experimental results show that the system can effectively improve the QoE value of the total system users, improve the system performance by 14.27% based on the average uplink allocation, and improve the performance of the VR video rate adaptive algorithm by 23.47%.
-
表 1 MCS方案
Table 1. MCS scheme
等级 调制方式 每个资源块的数据率/(Kbit·s-1) 1 QPSK 1/2 4.8 2 QPSK 3/4 7.2 3 QAM16 1/2 9.6 4 QAM16 3/4 21.6 表 2 不同算法QoE值比较
Table 2. QoE value comparison among different algorithms
算法 QoE值 本文算法 5.828 上行平均分配资源算法 5.1 下行视角自适应算法 5.223 下行速率自适应算法 4.72 -
[1] Cisco.Cisio visual networking index: Forecast and methodology 2016-2021[R].San Jose: Cisco, 2016. [2] ZHAO T, LIU Q, CHEN C W.QoE in video transmission:A user experience-driven strategy[J].IEEE Communications Surveys Tutorials, 2017, 19(1):285-302. doi: 10.1109/COMST.2016.2619982 [3] LI J, FENG R S, LIU Z, et al.Modeling QoE of virtual reality video transmission over wireless networks[C]//Proceedings of the 2018 IEEE Global Communications Conference (GLOBECOM).Piscataway, NJ: IEEE Press, 2018: 1-7. [4] LIU C, KAN N, ZOU J, et al.Server-side rate adaptation for multi-user 360-degree video streaming[C]//Proceedings of the 25th IEEE International Conference on Image Processing(ICIP).Piscataway, NJ: IEEE, 2018: 3264-3268. [5] SODAGAR I.The MPEG-DASH standard for multimedia streaming over the internet[J].IEEE Multimedia, 2011, 18(4):62-67. doi: 10.1109/MMUL.2011.71 [6] GUO C J, YING C, LIU Z.Optimal multicast of tiled 360 VR video[J].IEEE Wireless Communications Letters, 2019, 8(1):145-148. doi: 10.1109/LWC.2018.2864151 [7] LIU Y, XU M, LI C, et al.A novel rate control scheme for panoramic video coding[C]//Proceedings of the 2017 IEEE International Conference on Multimedia and Expo(ICME).Piscataway, NJ: IEEE Press, 2017: 691-696. https://www.researchgate.net/publication/319569940_A_novel_rate_control_scheme_for_panoramic_video_coding [8] XU Z, BAN Y, ZHANG K, et al.Tile-based QoE-driven http/2 streaming system for 360 video[C]//Proceedings of the 2018 IEEE International Conference on Multimedia Expo Workshops(ICMEW).Piscataway, NJ: IEEE Press, 2018: 1-4. https://www.researchgate.net/publication/329317914_Tile-Based_Qoe-Driven_Http2_Streaming_System_For_360_Video [9] QIAN F, HAN B, XIAO Q, et al.Flare: Practical viewport-adaptive 360-degree video streaming for mobile devices[C]//Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (MobiCom).New York: ACM, 2018: 99-114. [10] CORBILLON X, DEVLIC A, SIMON G, et al.Optimal set of 360-degree videos for viewport-adaptive streaming[C]//Proceedings of the 25th ACM International Conference on Multimedia.New York: ACM, 2018: 943-951. https://www.researchgate.net/publication/320542094_Optimal_Set_of_360-Degree_Videos_for_Viewport-Adaptive_Streaming [11] GHOSH A, VANEET A, FENG Q.A rate adaptation algorithm for tile-based 360-degree video streaming[EB/OL].(2017-04-26)[2019-09-21].https://arxiv.org/abs/1704.08215. [12] XIE L, XU Z, BAN Y, et al.360ProbDASH: Improving QoE of 360 video streaming using tile-based HTTP adaptive streaming[C]//Proceedings of the 25th ACM International Conference on Multimedia.New York: ACM, 2017: 315-323. [13] HUNG Y, WANG C, HWANG R.Optimizing social welfare of live video streaming services in mobile edge computing[J/OL].IEEE Transactions on Mobile Computing(2019-02-26)[2019-09-21].https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8653413. [14] ZHANG L, SUN L, WANG W, et al.Unlocking the door to mobile social VR:Architecture, experiments and challenges[J].IEEE Network, 2018, 32(1):160-165. doi: 10.1109/MNET.2017.1700014 [15] KIM H J, SON Y S, KIM J T.KKT-conditions based resource allocation algorithm for DASH streaming service over LTE[C]//2018 IEEE International Conference on Consumer Electronics(ICCE).Piscataway, NJ: IEEE Press, 2018: 1-3. [16] XU M, LI C, WANG Z L, et al.Visual quality assessment of panoramic video[EB/OL].(2019-01-15)[2019-07-01].https://arxiv.org/abs/1709.06342v1.