| Citation: | ZHAI Yuxuan, LIU Yisang, XU Yiwen, et al. 3D video quality evaluation based on adaptive streaming over HTTP[J]. Journal of Beijing University of Aeronautics and Astronautics, 2019, 45(12): 2456-2462. doi: 10.13700/j.bh.1001-5965.2019.0383(in Chinese)
|
The key for 3D video network service is to improve the quality of experience (QoE) of users, which can be, however, affected by mutable network conditions and video contents. For conventional 2D videos, the HTTP adaptive streaming (HAS) technique has demonstrated its significance in improving user QoE by utilizing dynamically switched bitrates, while for 3D video transmission with at least two video streams, this technique has not yet been extensively explored. Dynamic conversion policy of the video quality level is the core of HAS technique. In this work, we investigate the impact on user QoE when introducing dynamic bitrates to different 3D videos. A subjective database is built to illustrate the connection between block-level objective quality, which changes with bitrates, and the QoE of 3D vision. Through this, we propose a convolutional neural network (CNN) based QoE model that effectively assesses the QoE by block-level objective quality. The Pearson linear correlation coefficient (PLCC) of the model predictive value and the mean opinion score (MOS) is 0.906.The proposed framework can provide guidance to inter-view bitrate balancing of HAS for 3D video transmission.
| [1] |
MILLER K, QUACCHIO E, GENNARI G, et al.Adaptation algorithm for adaptive streaming over HTTP[C]//Proceedings of the 19th International Packet Video Workshop.Piscataway, NJ: IEEE Press, 2012: 173-178.
|
| [2] |
ZHANG X, TONI L, FROSSARD P, et al.Adaptive streaming in interactive multiview video systems[J].IEEE Transactions on Circuits and Systems for Video Technology, 2019, 29(4):1130-1144. doi: 10.1109/TCSVT.2018.2819804
|
| [3] |
ZHAO S, MEDHI D.SDN-Assisted adaptive streaming framework for tile-based immersive content using MPEG-DASH[C]//Proceedings of the IEEE Conference on Network Function Virtualization and Software Defined Networks.Piscataway, NJ: IEEE Press, 2017: 1-6.
|
| [4] |
PARK G, LEE J, LEE G, et al.Efficient 3D adaptive HTTP streaming scheme over internet TV[C]//Proceedings of the IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.Piscataway, NJ: IEEE Press, 2012: 1-6.
|
| [5] |
GARCIA M N, SIMONE F D, TAVAKOLI S, et al.Quality of Experience and HTTP adaptive streaming: A review of subjective studies[C]//Proceedings of the 6th International Workshop on Quality of Multimedia Experience, QoMEX.Piscataway, NJ: IEEE Press, 2014: 141-146
|
| [6] |
MOK R, LUO X, CHAN E, et al.QDASH: A QoE-aware DASH system[C]//Proceedings of the 3rd Multimedia Systems Conference.New York: ACM Press, 2012: 11-22.
|
| [7] |
TAVAKOLI S, GUTIERREZ J, GARCIA N.Subjective quality study of adaptive streaming of monoscopic and stereoscopic video[J].IEEE Journal on Selected Areas in Communications, 2014, 32(4):684-692. doi: 10.1109/JSAC.2014.140402
|
| [8] |
SHAO F, LIN W, GU S, et al.Perceptual full-reference quality assessment of stereoscopic images by considering binocular visual characteristics[J].IEEE Transactions on Image Processing, 2013, 22(5):1940-1953. doi: 10.1109/TIP.2013.2240003
|
| [9] |
LIN Y H, WU J L.Quality assessment of stereoscopic 3D image compression by binocular integration behaviors[J].IEEE Transactions on Image Processing, 2014, 23(4):1527-1542. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=c49707e5d9668bd777d4e6776fcb177c
|
| [10] |
ZHANG Y, CHANDLER D M.3D-MAD:A full reference stereoscopic image quality estimator based on binocular lightness and contrast perception[J].IEEE Transactions on Image Processing, 2015, 24(11):3810-3825. doi: 10.1109/TIP.2015.2456414
|
| [11] |
BATTISTI F, CARLI M, L E CALLET P, et al.Toward the assessment of quality of experience for asymmetric encoding in immersive media[J].IEEE Transactions on Broadcasting, 2018, 64(2):392-406. doi: 10.1109/TBC.2018.2828607
|
| [12] |
RUSANOVSKYY D, MVLLER K, VETRO A.Common test conditions of 3DV core experiments[EB/OL].(2013-08-02)[2019-07-06]. https://phenix.int-evry.fr/jct2/doc_end_user/current_document.php?id=1344.
|
| [13] |
AVS Video Group.General test conditions of stereoscopic video coding[EB/OL]. (2010-12-16)[2019-07-06]. http://www.avs.org.cn/FileList.asp?meetingid=53&filetype=output.
|
| [14] |
ITU-Recommendation.BT.1788.Methodology for the subjective assessment of video quality in multimedia applications[S].Geneva: ITU, 2007.
|
| [15] |
ITU-Recommendation.BT.500-11.Methodology for the subjective assessment of the quality of television pictures[S].Geneva: ITU, 2012.
|
| [16] |
ZHANG W, LIU H.Toward a reliable collection of eye-tracking data for image quality research:Challenges, solutions, and applications[J].IEEE Transactions on Image Processing, 2017, 26(5):2424-2437. doi: 10.1109/TIP.2017.2681424
|
| [17] |
ZHAO Y, CHEN Z, ZHU C, et al.Binocular just-noticeable-difference model for stereoscopic images[J].IEEE Signal Processing Letters, 2010, 18(1):19-22. http://cn.bing.com/academic/profile?id=f1eedbfa8ade2a0f4dea5dc1224e6ceb&encoded=0&v=paper_preview&mkt=zh-cn
|
| [18] |
SHAO F, JIANG G, WANG X, et al.Stereoscopic video coding with asymmetric luminance and chrominance qualities[J].IEEE Transactions on Consumer Electronics, 2011, 56(4):2460-2468. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=bf798162da11ad193a1a02391fe6af1c
|
| [19] |
HUANG Y H, HUANG Y H, LIU W C.Quality-efficient upsampling method for asymmetric resolution stereoscopic video coding with interview motion compensation and error compensation[J].IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(3):430-442. doi: 10.1109/TCSVT.2013.2276877
|
| [20] |
SAYGILI G, GURLER C G, TEKALP A M.Evaluation of asymmetric stereo video coding and rate scaling for adaptive 3D video streaming[J].IEEE Transactions on Broadcasting, 2011, 57(2):593-601. doi: 10.1109/TBC.2011.2131450
|
| [21] |
CHEN C, CHOI L K, DE VECIANA G, et al.Modeling the time-varying subjective quality of HTTP video streams with rate adaptations[J].IEEE Transactions on Image Processing, 2014, 23(5):2206-2221. doi: 10.1109/TIP.2014.2312613
|
| [22] |
ZHENGFANG D M, MA K D, WANG Z.Quality-of-experience for adaptive streaming videos:An expectation confirmation theory motivated approach[J].IEEE Transactions on Image Processing, 2018, 27(12):6135-6146. doi: 10.1109/TIP.2018.2855403
|
| [23] |
WANG Z, BOVIK A C, SHEIKH H R, et al.Image quality assessment:from error visibility to structural similarity[J].IEEE Transactions on Image Processing, 2004, 13(4):600-612. doi: 10.1089-fpd.2009.0394/
|
| [24] |
ZHANG W, QU C, MA L, et al.Learning structure of stereoscopic image for no-reference quality assessment with convolutional neural network[J].Pattern Recognition, 2016, 59:176-187. doi: 10.1016/j.patcog.2016.01.034
|
Figures(4) / Tables(4)
Copyright © Journal of Beijing University of Aeronautics and Astronautics
Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn
Supported by:
Beijing Renhe Information Technology Co., Ltd.
DownLoad:
