北京航空航天大学学报 ›› 2019, Vol. 45 ›› Issue (12): 2385-2392.doi: 10.13700/j.bh.1001-5965.2019.0364

• 论文 • 上一篇    下一篇

QoE驱动的VR视频自适应采集与传输

黎洁1, 冯燃生1, 杨阳朝2, 孙伟3, 李奇越3   

  1. 1. 合肥工业大学 计算机与信息学院, 合肥 230000;
    2. 中国电子科技集团公司电子科学研究院, 北京 100084;
    3. 合肥工业大学 电气与自动化工程学院, 合肥 230000
  • 收稿日期:2019-07-08 出版日期:2019-12-20 发布日期:2019-12-31
  • 通讯作者: 黎洁 E-mail:lijie@hfut.edu.cn
  • 作者简介:黎洁 女,博士,副研究员。主要研究方向:视频流媒体传输、虚拟现实;冯燃生 男,硕士研究生。主要研究方向:虚拟现实流媒体传输;杨阳朝 男,博士。主要研究方向:无线通信;孙伟 男,博士,副教授。主要研究方向:无线通信;李奇越 男,博士,副研究员。主要研究方向:无线通信。
  • 基金资助:
    国家自然科学基金(51877060);中央高校基本科研业务费专项资金(JZ2019HGTB0089,JZ2018HGTB0253,PA2019GDQT0006)

QoE driven adaptation for VR video capturing and transmission

LI Jie1, FENG Ransheng1, YANG Yangzhao2, SUN Wei3, LI Qiyue3   

  1. 1. School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230000, China;
    2. Academy of Electronics and Information Technology, China Electronics Technology Group Corporation, Beijing 100084, China;
    3. School of Electrical Engineering and Automation, Hefei University of Technology, Hefei 230000, China
  • Received:2019-07-08 Online:2019-12-20 Published:2019-12-31
  • Supported by:
    National Natural Science Foundation of China (51877060); the Fundamental Research Funds for the Central Universities (JZ2019HGTB0089,JZ2018HGTB0253,PA2019GDQT0006)

摘要: 在虚拟现实(VR)视频流媒体传输中,如何在带宽受限的条件下提高用户的质量体验(QoE)是一项巨大的挑战。为了更好地提高资源利用率和用户的QoE,提出了一个面向多用户的QoE驱动上下行链路联合的VR视频流媒体自适应采集与传输系统。与传统的VR视频无线传输系统不同的是,所提系统考虑了上行传输部分。其中,视频服务器根据上行链路和下行链路的带宽信息、用户的实时视角信息,以速率自适应为基础进行码率选择和资源分配。定义了QoE驱动的码率选择和资源分配问题,以最大化整个系统所有用户的QoE值。提出了联合KKT条件和分支定界法的速率自适应选择算法。实验结果表明:所提系统可以有效提高所有用户的QoE值,与上行链路平均分配资源算法相比,系统QoE值提高了14.27%,同时与传统的VR视频速率自适应算法相比,系统QoE值提高了23.47%。

关键词: 虚拟现实(VR), 质量体验(QoE), 资源分配, 流媒体传输, KKT条件, 分支定界法

Abstract: In virtual reality (VR) video streaming media transmission, how to further improve user's quality of experience (QoE) under bandwidth-constrained conditions is a huge challenge. In order to improve resource utilization rate and user QoE, a multi-user QoE-driven uplink and downlink joint VR video streaming media adaptive acquisition and transmission system is proposed, which is different from the traditional VR video wireless transmission system. The proposed system considers the uplink transmission part. The video server selects code rate and allocates resources based on the rate adaptation based on the bandwidth information of the uplink channel and the downlink channel and the real-time view information of the user. In addition, we define the problem of QoE-driven rate selection and resource allocation to maximize the QoE value of all users across the system. Finally, we propose an optimal adaptive rate selection algorithm combining the KKT condition and the branch and bound method. The experimental results show that the system can effectively improve the QoE value of the total system users, improve the system performance by 14.27% based on the average uplink allocation, and improve the performance of the VR video rate adaptive algorithm by 23.47%.

Key words: virtual reality (VR), quality of experience (QoE), resource allocation, streaming media transmission, KKT condition, branch and bound method

中图分类号: 


版权所有 © 《北京航空航天大学学报》编辑部
通讯地址:北京市海淀区学院路37号 北京航空航天大学学报编辑部 邮编:100191 E-mail:jbuaa@buaa.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发