留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

QoE驱动的VR视频自适应采集与传输

黎洁 冯燃生 杨阳朝 孙伟 李奇越

黎洁, 冯燃生, 杨阳朝, 等 . QoE驱动的VR视频自适应采集与传输[J]. 北京航空航天大学学报, 2019, 45(12): 2385-2392. doi: 10.13700/j.bh.1001-5965.2019.0364
引用本文: 黎洁, 冯燃生, 杨阳朝, 等 . QoE驱动的VR视频自适应采集与传输[J]. 北京航空航天大学学报, 2019, 45(12): 2385-2392. doi: 10.13700/j.bh.1001-5965.2019.0364
LI Jie, FENG Ransheng, YANG Yangzhao, et al. QoE driven adaptation for VR video capturing and transmission[J]. Journal of Beijing University of Aeronautics and Astronautics, 2019, 45(12): 2385-2392. doi: 10.13700/j.bh.1001-5965.2019.0364(in Chinese)
Citation: LI Jie, FENG Ransheng, YANG Yangzhao, et al. QoE driven adaptation for VR video capturing and transmission[J]. Journal of Beijing University of Aeronautics and Astronautics, 2019, 45(12): 2385-2392. doi: 10.13700/j.bh.1001-5965.2019.0364(in Chinese)

QoE驱动的VR视频自适应采集与传输

doi: 10.13700/j.bh.1001-5965.2019.0364
基金项目: 

国家自然科学基金 51877060

中央高校基本科研业务费专项资金 JZ2019HGTB0089

中央高校基本科研业务费专项资金 JZ2018HGTB0253

中央高校基本科研业务费专项资金 PA2019GDQT0006

详细信息
    作者简介:

    黎洁  女, 博士, 副研究员。主要研究方向:视频流媒体传输、虚拟现实

    冯燃生  男, 硕士研究生。主要研究方向:虚拟现实流媒体传输

    杨阳朝  男, 博士。主要研究方向:无线通信

    孙伟  男, 博士, 副教授。主要研究方向:无线通信

    李奇越  男, 博士, 副研究员。主要研究方向:无线通信

    通讯作者:

    黎洁. E-mail: lijie@hfut.edu.cn

  • 中图分类号: V221+.3;TB553

QoE driven adaptation for VR video capturing and transmission

Funds: 

National Natural Science Foundation of China 51877060

the Fundamental Research Funds for the Central Universities JZ2019HGTB0089

the Fundamental Research Funds for the Central Universities JZ2018HGTB0253

the Fundamental Research Funds for the Central Universities PA2019GDQT0006

More Information
  • 摘要:

    在虚拟现实(VR)视频流媒体传输中,如何在带宽受限的条件下提高用户的质量体验(QoE)是一项巨大的挑战。为了更好地提高资源利用率和用户的QoE,提出了一个面向多用户的QoE驱动上下行链路联合的VR视频流媒体自适应采集与传输系统。与传统的VR视频无线传输系统不同的是,所提系统考虑了上行传输部分。其中,视频服务器根据上行链路和下行链路的带宽信息、用户的实时视角信息,以速率自适应为基础进行码率选择和资源分配。定义了QoE驱动的码率选择和资源分配问题,以最大化整个系统所有用户的QoE值。提出了联合KKT条件和分支定界法的速率自适应选择算法。实验结果表明:所提系统可以有效提高所有用户的QoE值,与上行链路平均分配资源算法相比,系统QoE值提高了14.27%,同时与传统的VR视频速率自适应算法相比,系统QoE值提高了23.47%。

     

  • 图 1  系统应用场景

    Figure 1.  System application scenario

    图 2  系统结构

    Figure 2.  System structure

    图 3  6个原始视频的缩略图

    Figure 3.  Thumbnail of six original videos

    图 4  采用分块后的全景视频

    Figure 4.  Tiled panoramic video

    图 5  上行链路与系统QoE值的关系

    Figure 5.  Relationship between uplink and system QoE value

    图 6  下行链路与系统QoE值的关系

    Figure 6.  Relationship between downlink and system QoE value

    图 7  用户数目与系统QoE值的关系

    Figure 7.  Relationship between user number and system QoE value

    表  1  MCS方案

    Table  1.   MCS scheme

    等级 调制方式 每个资源块的数据率/(Kbit·s-1)
    1 QPSK 1/2 4.8
    2 QPSK 3/4 7.2
    3 QAM16 1/2 9.6
    4 QAM16 3/4 21.6
    下载: 导出CSV

    表  2  不同算法QoE值比较

    Table  2.   QoE value comparison among different algorithms

    算法 QoE值
    本文算法 5.828
    上行平均分配资源算法 5.1
    下行视角自适应算法 5.223
    下行速率自适应算法 4.72
    下载: 导出CSV
  • [1] Cisco.Cisio visual networking index: Forecast and methodology 2016-2021[R].San Jose: Cisco, 2016.
    [2] ZHAO T, LIU Q, CHEN C W.QoE in video transmission:A user experience-driven strategy[J].IEEE Communications Surveys Tutorials, 2017, 19(1):285-302. doi: 10.1109/COMST.2016.2619982
    [3] LI J, FENG R S, LIU Z, et al.Modeling QoE of virtual reality video transmission over wireless networks[C]//Proceedings of the 2018 IEEE Global Communications Conference (GLOBECOM).Piscataway, NJ: IEEE Press, 2018: 1-7.
    [4] LIU C, KAN N, ZOU J, et al.Server-side rate adaptation for multi-user 360-degree video streaming[C]//Proceedings of the 25th IEEE International Conference on Image Processing(ICIP).Piscataway, NJ: IEEE, 2018: 3264-3268.
    [5] SODAGAR I.The MPEG-DASH standard for multimedia streaming over the internet[J].IEEE Multimedia, 2011, 18(4):62-67. doi: 10.1109/MMUL.2011.71
    [6] GUO C J, YING C, LIU Z.Optimal multicast of tiled 360 VR video[J].IEEE Wireless Communications Letters, 2019, 8(1):145-148. doi: 10.1109/LWC.2018.2864151
    [7] LIU Y, XU M, LI C, et al.A novel rate control scheme for panoramic video coding[C]//Proceedings of the 2017 IEEE International Conference on Multimedia and Expo(ICME).Piscataway, NJ: IEEE Press, 2017: 691-696. https://www.researchgate.net/publication/319569940_A_novel_rate_control_scheme_for_panoramic_video_coding
    [8] XU Z, BAN Y, ZHANG K, et al.Tile-based QoE-driven http/2 streaming system for 360 video[C]//Proceedings of the 2018 IEEE International Conference on Multimedia Expo Workshops(ICMEW).Piscataway, NJ: IEEE Press, 2018: 1-4. https://www.researchgate.net/publication/329317914_Tile-Based_Qoe-Driven_Http2_Streaming_System_For_360_Video
    [9] QIAN F, HAN B, XIAO Q, et al.Flare: Practical viewport-adaptive 360-degree video streaming for mobile devices[C]//Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (MobiCom).New York: ACM, 2018: 99-114.
    [10] CORBILLON X, DEVLIC A, SIMON G, et al.Optimal set of 360-degree videos for viewport-adaptive streaming[C]//Proceedings of the 25th ACM International Conference on Multimedia.New York: ACM, 2018: 943-951. https://www.researchgate.net/publication/320542094_Optimal_Set_of_360-Degree_Videos_for_Viewport-Adaptive_Streaming
    [11] GHOSH A, VANEET A, FENG Q.A rate adaptation algorithm for tile-based 360-degree video streaming[EB/OL].(2017-04-26)[2019-09-21].https://arxiv.org/abs/1704.08215.
    [12] XIE L, XU Z, BAN Y, et al.360ProbDASH: Improving QoE of 360 video streaming using tile-based HTTP adaptive streaming[C]//Proceedings of the 25th ACM International Conference on Multimedia.New York: ACM, 2017: 315-323.
    [13] HUNG Y, WANG C, HWANG R.Optimizing social welfare of live video streaming services in mobile edge computing[J/OL].IEEE Transactions on Mobile Computing(2019-02-26)[2019-09-21].https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8653413.
    [14] ZHANG L, SUN L, WANG W, et al.Unlocking the door to mobile social VR:Architecture, experiments and challenges[J].IEEE Network, 2018, 32(1):160-165. doi: 10.1109/MNET.2017.1700014
    [15] KIM H J, SON Y S, KIM J T.KKT-conditions based resource allocation algorithm for DASH streaming service over LTE[C]//2018 IEEE International Conference on Consumer Electronics(ICCE).Piscataway, NJ: IEEE Press, 2018: 1-3.
    [16] XU M, LI C, WANG Z L, et al.Visual quality assessment of panoramic video[EB/OL].(2019-01-15)[2019-07-01].https://arxiv.org/abs/1709.06342v1.
  • 加载中
图(7) / 表(2)
计量
  • 文章访问数:  926
  • HTML全文浏览量:  106
  • PDF下载量:  394
  • 被引次数: 0
出版历程
  • 收稿日期:  2019-07-08
  • 录用日期:  2019-08-23
  • 网络出版日期:  2019-12-20

目录

    /

    返回文章
    返回
    常见问答