skip to main content
research-article

QoE-oriented 3D video transcoding for mobile streaming

Authors Info & Claims
Published:16 October 2012Publication History
Skip Abstract Section

Abstract

With advance in mobile 3D display, mobile 3D video is already enabled by the wireless multimedia networking, and it will be gradually popular since it can make people enjoy the natural 3D experience anywhere and anytime. In current stage, mobile 3D video is generally delivered over the heterogeneous network combined by wired and wireless channels. How to guarantee the optimal 3D visual quality of experience (QoE) for the mobile 3D video streaming is one of the important topics concerned by the service provider. In this article, we propose a QoE-oriented transcoding approach to enhance the quality of mobile 3D video service. By learning the pre-controlled QoE patterns of 3D contents, the proposed 3D visual QoE inferring model can be utilized to regulate the transcoding configurations in real-time according to the feedbacks of network and user-end device information. In the learning stage, we propose a piecewise linear mean opinion score (MOS) interpolation method to further reduce the cumbersome manual work of preparing QoE patterns. Experimental results show that the proposed transcoding approach can provide the adapted 3D stream to the heterogeneous network, and further provide superior QoE performance to the fixed quantization parameter (QP) transcoding and mean squared error (MSE) optimized transcoding for mobile 3D video streaming.

References

  1. Ameigeiras, P., Ramos-Munoz, J. J., Navarro-Ortiz, J., and Mogensen, P. 2010. QoE oriented cross-layer design of a resource allocation algorithm in beyond 3G systems. Elsevier Computer Commun. 33, 5, 571--582. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Brust, H., Smolic, A., Müller, K., Tech, G., and Wiegand, T. 2009. Mixed resolution coding of stereoscopic video for mobile devices. In Proceedings of 3DTV-CON. 1--4.Google ScholarGoogle Scholar
  3. Chen, Z., Lin, W., and Ngan, K. N. 2010a. Perceptual video coding: Challenges and approaches. In Proceedings of IEEE International Conference on Multimedia & Expo. 19--23.Google ScholarGoogle Scholar
  4. Chen, W., Fournier, J., Barkowsky, M., and Le Callet, P. 2010b. New requirements of subjective video quality assessment methodologies for 3DTV. In Proceedings of VPQM.Google ScholarGoogle Scholar
  5. Domański, M., Grajek, T., Klimaszewski, K., Kurc, M., Stankiewicz, O., Stankowski, J., and Wegner, K. 2009. Poznan multiview video test sequences and camera parameters. ISO/IEC JTC1/SC29/WG11, MPEG 2009/M17050.Google ScholarGoogle Scholar
  6. Girod, B. 1993. What's wrong with mean-squared error. In Digital Images and Human Vision. The MIT Press, 207--220. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Ho, Y.-S., Lee, E.-K., and Lee, C. 2008. Multiview video test sequence and camera parameters. ISO/IEC JTC1/SC29/WG11, MPEG2008/m15419.Google ScholarGoogle Scholar
  8. ITU-R. 2002. Methodology for the Subjective Assessment of the Quality of Television Pictures. Recommendation BT.500-11.Google ScholarGoogle Scholar
  9. ITU-T. 2007. New appendix I -Definition of quality of experience (QoE). Recommentation G.100/P.10 Amendment 1.Google ScholarGoogle Scholar
  10. Jumisko-Pyykkö, S., Haustola, T., Boev, A., and Gotchev, A. 2011. Subjective evaluation of mobile 3D video content: Depth range versus compression artifacts. Proc. SPIE, vol. 7881, 78810C.Google ScholarGoogle Scholar
  11. Khan, A., Sun, L., and Ifeachor, E. 2012. QoE Prediction Model and its Application in Video Quality Adaptation over UMTS Networks. IEEE Trans. Multimedia 14, 2, 431--442.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Liang, Y. J., Apostolopoulos, J. G., and Girod, B. 2008. Analysis of packet loss for compressed video: effect of burst losses and correlation between error frames. IEEE Trans. Circ. Syst. Video Tech. 18, 7, 861--874. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Liu, S. and Chen, C. W. 2010. 3D video transcoding for virtual views. In Proceedings of ACM Multimedia. 795--798. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Liu, Y., Huang, Q., Ma, S., Zhao, D., and Gao, W. 2009. Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model. Signal Process. Image Commun. 24, 8, 666--681. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Liu, Y., Peng, G., Hu, Y., Ci, S., and Tang, H. 2010. A multi-pass VBR rate control method for video plus depth based mobile 3D video coding. In Proceedings of 11th Pacific-Rim Conference on Multimedia (PCM'10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Liu, Y., Ci, S., Tang, H., and Ye, Y. 2012. Application-Adapted Mobile 3D Video Coding and Streaming—A Survey. 3D Res. J. 3, 01(2012)5, Springer. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Mohamed, S. and Rubino, G. 2002. A study of real-time packet video quality using random neural networks. IEEE Trans. Circ. Syst. Video Tech. 12, 12, 1071--1083. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Ma, S., Gao, W., and Lu, Y. 2005. Rate-distortion analysis for H.264/AVC video coding and its application to rate control. IEEE Trans. Circ. Syst. Video Tech. 15, 12, 1533--1544. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Mendiburu, B. 2008. 3D Movie Making-Stereoscopic Digital Cinema from Script to Screen. Elsevier, New York, 2008978-0-240-81137-6.Google ScholarGoogle Scholar
  20. Merkle, P., Wang, Y., Müller, K., Smolic, A., and Wiegand, T. 2009. Video plus depth compression for mobile 3D services. In Proceedings of IEEE 3DTV Conference. Potsdam, Germany.Google ScholarGoogle Scholar
  21. Piamrat, K., Ksentini, A., Bonnin, J.-M., and Viho, C. 2009. Q-DRAM: QoE based dynamic rate adaptation mechanism for multicast in wireless networks. In Proceedings of IEEE GLOBECOM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Perkins, M. G. 1992. Data compression of stereopairs. IEEE Trans. Comm. 40, 4, 684--696.Google ScholarGoogle ScholarCross RefCross Ref
  23. Piamrat, K., Ksentini, A., Viho, C., and Bonnin, J.-M. 2008. QoE-aware admission control for multimedia applications in IEEE 802.11 Wireless Networks. In Proceedings of IEEE VTC.Google ScholarGoogle Scholar
  24. Rückert, J., Abboud, O., Zinner, T., Steinmetz, R., and Hausheer, D. 2012. Quality adaptation in P2P video streaming based on objective QoE metrics. IFIP Networking. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Seuntïens, P. J. H. 2006. Visual experience of 3DTV. Ph.D. Thesis, Technische Universiteit Eindhoven.Google ScholarGoogle Scholar
  26. Smolic, A., Kauff, P., Knorr, S., Hornung, A., Kunter, M., Müller, M., and Lang, M. 2011. Three-dimensional video postproduction and processing. Proc. IEEE 99, 4, 607--625.Google ScholarGoogle ScholarCross RefCross Ref
  27. Thakolsri, S., Kellerer, W., and Steinbach, E. 2010. QoE-based rate adaptation scheme selection for resource-constrained wireless video transmission. In Proceedings of ACM Multimedia. 783--786. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Tanimoto Lab at Nagoya University. 2008. http://www.tanimoto.nuee.nagoya-u.ac.jp/.Google ScholarGoogle Scholar
  29. Vetro, A., Xin, J., and Sun, H. 2005. Error resilience video transcoding for wireless communications. IEEE Wirel. Comm. 12, 4, 14--21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Vetro, A., Tourapis, A. M., Müller K., and Chen, T. 2011. 3D-TV Content Storage and Transmission. IEEE Trans. Broadcast. 57, 2, part 2, 348--394.Google ScholarGoogle ScholarCross RefCross Ref
  31. Wang, Z., Bovik, A. C., and Lu, L. 2002. Why is image quality assessment so difficult?. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing.Google ScholarGoogle Scholar
  32. Worrall, S. T., Kondoz, A. M., Driesnack, D., Tekalp, M., Kovacs, P., Adari, T., and Gokmen, H. 2010. DIOMEDES: Content Aware Delivery of 3D Media Using P2P and DVB-T2. 2010 NEM Summit: Towards Future Media Internet, Barcelona, Spain.Google ScholarGoogle Scholar
  33. Yin, P., Vetro, A., Xia, M., and Liu, B. 2003. Rate-distortion models for video transcoding. In Proceedings of the Conference on Image and Video Communications and Processing. 479--488.Google ScholarGoogle Scholar
  34. Zou, W. 2009. An overview for developing end-to-end standards for 3-D TV in the home. Inf. Display, 25, 7, 14--19.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. QoE-oriented 3D video transcoding for mobile streaming

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Multimedia Computing, Communications, and Applications
      ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 8, Issue 3s
      Special section of best papers of ACM multimedia 2011, and special section on 3D mobile multimedia
      September 2012
      173 pages
      ISSN:1551-6857
      EISSN:1551-6865
      DOI:10.1145/2348816
      Issue’s Table of Contents

      Copyright © 2012 ACM

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 16 October 2012
      • Accepted: 1 May 2012
      • Revised: 1 April 2012
      • Received: 1 January 2012
      Published in tomm Volume 8, Issue 3s

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!