Abstract
With advance in mobile 3D display, mobile 3D video is already enabled by the wireless multimedia networking, and it will be gradually popular since it can make people enjoy the natural 3D experience anywhere and anytime. In current stage, mobile 3D video is generally delivered over the heterogeneous network combined by wired and wireless channels. How to guarantee the optimal 3D visual quality of experience (QoE) for the mobile 3D video streaming is one of the important topics concerned by the service provider. In this article, we propose a QoE-oriented transcoding approach to enhance the quality of mobile 3D video service. By learning the pre-controlled QoE patterns of 3D contents, the proposed 3D visual QoE inferring model can be utilized to regulate the transcoding configurations in real-time according to the feedbacks of network and user-end device information. In the learning stage, we propose a piecewise linear mean opinion score (MOS) interpolation method to further reduce the cumbersome manual work of preparing QoE patterns. Experimental results show that the proposed transcoding approach can provide the adapted 3D stream to the heterogeneous network, and further provide superior QoE performance to the fixed quantization parameter (QP) transcoding and mean squared error (MSE) optimized transcoding for mobile 3D video streaming.
- Ameigeiras, P., Ramos-Munoz, J. J., Navarro-Ortiz, J., and Mogensen, P. 2010. QoE oriented cross-layer design of a resource allocation algorithm in beyond 3G systems. Elsevier Computer Commun. 33, 5, 571--582. Google Scholar
Digital Library
- Brust, H., Smolic, A., Müller, K., Tech, G., and Wiegand, T. 2009. Mixed resolution coding of stereoscopic video for mobile devices. In Proceedings of 3DTV-CON. 1--4.Google Scholar
- Chen, Z., Lin, W., and Ngan, K. N. 2010a. Perceptual video coding: Challenges and approaches. In Proceedings of IEEE International Conference on Multimedia & Expo. 19--23.Google Scholar
- Chen, W., Fournier, J., Barkowsky, M., and Le Callet, P. 2010b. New requirements of subjective video quality assessment methodologies for 3DTV. In Proceedings of VPQM.Google Scholar
- Domański, M., Grajek, T., Klimaszewski, K., Kurc, M., Stankiewicz, O., Stankowski, J., and Wegner, K. 2009. Poznan multiview video test sequences and camera parameters. ISO/IEC JTC1/SC29/WG11, MPEG 2009/M17050.Google Scholar
- Girod, B. 1993. What's wrong with mean-squared error. In Digital Images and Human Vision. The MIT Press, 207--220. Google Scholar
Digital Library
- Ho, Y.-S., Lee, E.-K., and Lee, C. 2008. Multiview video test sequence and camera parameters. ISO/IEC JTC1/SC29/WG11, MPEG2008/m15419.Google Scholar
- ITU-R. 2002. Methodology for the Subjective Assessment of the Quality of Television Pictures. Recommendation BT.500-11.Google Scholar
- ITU-T. 2007. New appendix I -Definition of quality of experience (QoE). Recommentation G.100/P.10 Amendment 1.Google Scholar
- Jumisko-Pyykkö, S., Haustola, T., Boev, A., and Gotchev, A. 2011. Subjective evaluation of mobile 3D video content: Depth range versus compression artifacts. Proc. SPIE, vol. 7881, 78810C.Google Scholar
- Khan, A., Sun, L., and Ifeachor, E. 2012. QoE Prediction Model and its Application in Video Quality Adaptation over UMTS Networks. IEEE Trans. Multimedia 14, 2, 431--442.Google Scholar
Digital Library
- Liang, Y. J., Apostolopoulos, J. G., and Girod, B. 2008. Analysis of packet loss for compressed video: effect of burst losses and correlation between error frames. IEEE Trans. Circ. Syst. Video Tech. 18, 7, 861--874. Google Scholar
Digital Library
- Liu, S. and Chen, C. W. 2010. 3D video transcoding for virtual views. In Proceedings of ACM Multimedia. 795--798. Google Scholar
Digital Library
- Liu, Y., Huang, Q., Ma, S., Zhao, D., and Gao, W. 2009. Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model. Signal Process. Image Commun. 24, 8, 666--681. Google Scholar
Digital Library
- Liu, Y., Peng, G., Hu, Y., Ci, S., and Tang, H. 2010. A multi-pass VBR rate control method for video plus depth based mobile 3D video coding. In Proceedings of 11th Pacific-Rim Conference on Multimedia (PCM'10). Google Scholar
Digital Library
- Liu, Y., Ci, S., Tang, H., and Ye, Y. 2012. Application-Adapted Mobile 3D Video Coding and Streaming—A Survey. 3D Res. J. 3, 01(2012)5, Springer. Google Scholar
Digital Library
- Mohamed, S. and Rubino, G. 2002. A study of real-time packet video quality using random neural networks. IEEE Trans. Circ. Syst. Video Tech. 12, 12, 1071--1083. Google Scholar
Digital Library
- Ma, S., Gao, W., and Lu, Y. 2005. Rate-distortion analysis for H.264/AVC video coding and its application to rate control. IEEE Trans. Circ. Syst. Video Tech. 15, 12, 1533--1544. Google Scholar
Digital Library
- Mendiburu, B. 2008. 3D Movie Making-Stereoscopic Digital Cinema from Script to Screen. Elsevier, New York, 2008978-0-240-81137-6.Google Scholar
- Merkle, P., Wang, Y., Müller, K., Smolic, A., and Wiegand, T. 2009. Video plus depth compression for mobile 3D services. In Proceedings of IEEE 3DTV Conference. Potsdam, Germany.Google Scholar
- Piamrat, K., Ksentini, A., Bonnin, J.-M., and Viho, C. 2009. Q-DRAM: QoE based dynamic rate adaptation mechanism for multicast in wireless networks. In Proceedings of IEEE GLOBECOM. Google Scholar
Digital Library
- Perkins, M. G. 1992. Data compression of stereopairs. IEEE Trans. Comm. 40, 4, 684--696.Google Scholar
Cross Ref
- Piamrat, K., Ksentini, A., Viho, C., and Bonnin, J.-M. 2008. QoE-aware admission control for multimedia applications in IEEE 802.11 Wireless Networks. In Proceedings of IEEE VTC.Google Scholar
- Rückert, J., Abboud, O., Zinner, T., Steinmetz, R., and Hausheer, D. 2012. Quality adaptation in P2P video streaming based on objective QoE metrics. IFIP Networking. Google Scholar
Digital Library
- Seuntïens, P. J. H. 2006. Visual experience of 3DTV. Ph.D. Thesis, Technische Universiteit Eindhoven.Google Scholar
- Smolic, A., Kauff, P., Knorr, S., Hornung, A., Kunter, M., Müller, M., and Lang, M. 2011. Three-dimensional video postproduction and processing. Proc. IEEE 99, 4, 607--625.Google Scholar
Cross Ref
- Thakolsri, S., Kellerer, W., and Steinbach, E. 2010. QoE-based rate adaptation scheme selection for resource-constrained wireless video transmission. In Proceedings of ACM Multimedia. 783--786. Google Scholar
Digital Library
- Tanimoto Lab at Nagoya University. 2008. http://www.tanimoto.nuee.nagoya-u.ac.jp/.Google Scholar
- Vetro, A., Xin, J., and Sun, H. 2005. Error resilience video transcoding for wireless communications. IEEE Wirel. Comm. 12, 4, 14--21. Google Scholar
Digital Library
- Vetro, A., Tourapis, A. M., Müller K., and Chen, T. 2011. 3D-TV Content Storage and Transmission. IEEE Trans. Broadcast. 57, 2, part 2, 348--394.Google Scholar
Cross Ref
- Wang, Z., Bovik, A. C., and Lu, L. 2002. Why is image quality assessment so difficult?. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing.Google Scholar
- Worrall, S. T., Kondoz, A. M., Driesnack, D., Tekalp, M., Kovacs, P., Adari, T., and Gokmen, H. 2010. DIOMEDES: Content Aware Delivery of 3D Media Using P2P and DVB-T2. 2010 NEM Summit: Towards Future Media Internet, Barcelona, Spain.Google Scholar
- Yin, P., Vetro, A., Xia, M., and Liu, B. 2003. Rate-distortion models for video transcoding. In Proceedings of the Conference on Image and Video Communications and Processing. 479--488.Google Scholar
- Zou, W. 2009. An overview for developing end-to-end standards for 3-D TV in the home. Inf. Display, 25, 7, 14--19.Google Scholar
Cross Ref
Index Terms
QoE-oriented 3D video transcoding for mobile streaming
Recommendations
Multiview video transcoding: from multiple views to single view
PCS'09: Proceedings of the 27th conference on Picture Coding SymposiumAs multiview video is gaining more and more attentions, Multiview Video Coding (MVC) standard has been under development by the Joint Video Team as an extension to H.264/AVC. There will be increasingly more multiview video sources for both high end and ...
Spatial transcoding from scalable video coding to H.264/AVC
ICME'09: Proceedings of the 2009 IEEE international conference on Multimedia and ExpoScalable Video Coding (SVC) is backwards compatible to H.264/AVC in the sense that the base layer sub-bitstream is decodable by an H.264/AVC decoder. However, there are applications wherein it is desirable for an H.264/AVC decoder to obtain a higher ...
Fast Transcoding from H.264 AVC to High Efficiency Video Coding
ICME '12: Proceedings of the 2012 IEEE International Conference on Multimedia and ExpoIn this paper, we present several strategies for transcoding from H.264/AVC bit streams to High Efficiency Video Coding (HEVC) bit streams. Because HEVC and AVC share the similar coding architecture, we try to exploit the information in AVC bit streams ...






Comments