skip to main content
research-article

Low-Complexity Scalable Extension of the High-Efficiency Video Coding (SHVC) Encoding System

Published:05 June 2019Publication History
Skip Abstract Section

Abstract

The scalable extension of the high-efficiency video coding (SHVC) system adopts a hierarchical quadtree-based coding unit (CU) that is suitable for various texture and motion properties of videos. Currently, the test model of SHVC identifies the optimal CU size by performing an exhaustive quadtree depth-level search, which achieves a high compression efficiency at a heavy cost in terms of the computational complexity. However, many interactive multimedia applications, such as remote monitoring and video surveillance, which are sensitive to time delays, have insufficient computational power for coding high-definition (HD) and ultra-high-definition (UHD) videos. Therefore, it is important, yet challenging, to optimize the SHVC coding procedure and accelerate video coding. In this article, we propose a fast CU quadtree depth-level decision algorithm for inter-frames on enhancement layers that is based on an analysis of inter-layer, spatial, and temporal correlations. When motion/texture properties of coding regions can be identified early, a fast algorithm can be designed for adapting CU depth-level decision procedures to video contents and avoiding unnecessary computations during CU depth-level traversal. The proposed algorithm determines the motion activity level at the treeblock size of the hierarchical quadtree by utilizing motion vectors from its corresponding blocks at the base layer. Based on the motion activity level, neighboring encoded CUs that have larger correlations are preferentially selected to predict the optimal depth level of the current treeblock. Finally, two parameters, namely, the motion activity level and the predicted CU depth level, are used to identify a subset of candidate CU depth levels and adaptively optimize CU depth-level decision processes. The experimental results demonstrate that the proposed scheme can run approximately three times faster than the most recent SHVC reference software, with a negligible loss of compression efficiency. The proposed scheme is efficient for all types of scalable video sequences under various coding conditions and outperforms state-of-the-art fast SHVC and HEVC algorithms. Our scheme is a suitable candidate for interactive HD/UHD video applications that are expected to operate in real-time and power-constrained scenarios.

References

  1. R. Bailleul, J. De Cock, and R. Van de Walle. 2014. Fast mode decision for SNR scalability in SHVC digest of technical papers. In Proceedings of IEEE International Conference on Consumer Electronics (ICCE). 193--194.Google ScholarGoogle Scholar
  2. G. Bjontegaard. 2001. Calculation of average PSNR difference between RD-curves. 13th VCEG-M33 Meeting.Google ScholarGoogle Scholar
  3. J. M. Boyce, Y. Ye, J. Chen, and A. K. Ramasubramonian. 2016. Overview of SHVC: Scalable extensions of the High Efficiency Video Coding (HEVC) standard. IEEE Trans. Circuits Video Technol. 26, 1 (2016), 20--34.Google ScholarGoogle ScholarCross RefCross Ref
  4. G. Correa, P. Assuncao, L. A. Da Silva Cruz, and L. Agostini. 2015. Encoding time control system for HEVC based on rate-distortion-complexity analysis. In Proceedings of IEEE International Symposium on Circuits and Systems (ISCAS). 1114--1117.Google ScholarGoogle Scholar
  5. W. Chiang, J. Chen, and Y. Tsai. 2017. A fast SHVC coding scheme based on base layer co-located CU and cross-layer PU mode information. In Proceedings of IEEE International Conference on Multimedia 8 Expo Workshops (ICMEW). 381--386.Google ScholarGoogle Scholar
  6. A. J. Diaz-Honrubia, J. L. Martinez, P. Cuenca, J. A. Gamez, and J. M. Puerta. 2016. Adaptive fast quadtree level decision algorithm for H.264 to HEVC video transcoding. IEEE Trans. Circuits Syst. Video Technol. 26, 1 (2016), 154--168.Google ScholarGoogle ScholarCross RefCross Ref
  7. J. De Cock, S. Notebaert, P. Lambert, and R. Van de Walle. 2009. Architectures for fast transcoding of H.264/AVC to quality-scalable SVC streams. IEEE Trans. Multimedia. 11, 7 (2009), 1209--1224. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. H. Fan, R. Wang, L. Ding, X. Xie, H. Jia, and W. Gao. 2016. Hybrid zero block detection for high efficiency video coding. IEEE Trans. Multimedia. 18, 3 (2016), 537--543. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. B. Fu, D. Staehle, G. Kunzmann, E. Steinbach, and W. Kellerer. 2015. QoE-based SVC layer dropping in LTE networks using content-aware layer priorities. ACM Trans. Multimedia Comput. Commun. Appl. 12, 1, Article 7 (2015), 23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. G. Fu, L. Shen, H. Yang, X. Hu, and P. An. 2018. Fast intra coding of high dynamic range videos in SHVC. IEEE Signal Process. Lett. 25, 11 (2018), 1665--1669.Google ScholarGoogle ScholarCross RefCross Ref
  11. Q. Ge and D. Hu. 2014. Fast encoding method using CU depth for quality scalable HEVC. In Proceedings of IEEE Workshop on Advanced Research and Technology in Industry Applications (WARTIA). 1366--1370.Google ScholarGoogle Scholar
  12. D. Grois and O. Hadar. 2014. Complexity-aware adaptive preprocessing scheme for region-of-interest spatial scalable video coding. IEEE Trans. Circuits Syst. Video Technol. 24, 6 (2014), 1025--1039.Google ScholarGoogle ScholarCross RefCross Ref
  13. A. Heindel and A. Kaup. 2015. Fast intra mode decision in HEVC using early distortion estimation. In Proceedings of IEEE China Summit and International Conference on Signal and Information Processing (China SIP). 559--563.Google ScholarGoogle Scholar
  14. B. Hilmi, K. Goswami, J. Lee, and B. Kim. 2012. Fast inter-mode decision algorithm for H.264/AVC using macroblock correlation and motion complexity analysis. In Proceedings of IEEE International Conference on Consumer Electronics (ICCE). 90--91.Google ScholarGoogle Scholar
  15. C. Hsu and M. Hefeeda. 2008. On the accuracy and complexity of rate-distortion models for fine-grained scalable video sequences. ACM Trans. Multimedia Comput. Commun. Appl. 4, 2, Article 15 (2008), 22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. JCTVC-F092. 2011. Coding tree pruning based CU early termination. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Torino, IT.Google ScholarGoogle Scholar
  17. JCTVC-F045. 2011. Early termination of CU encoding to reduce HEVC complexity. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Torino, IT.Google ScholarGoogle Scholar
  18. JCTVC-E090. 2011. Adaptive CU depth range. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Geneva, Switzerland.Google ScholarGoogle Scholar
  19. JCTVC-O0022. 2013. Test sequence material (AHG22). ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Geneva, Switzerland.Google ScholarGoogle Scholar
  20. JCTVC-P1009. 2014. Common SHM test Conditions and Software Reference Configurations. San José, NM.Google ScholarGoogle Scholar
  21. A. Jiménez-Moreno, E. Martínez-Enríquez, and F. Díaz-de-María. 2016. Complexity control based on a fast coding unit decision method in the HEVC video coding standard. IEEE Trans. Multimedia. 18, 4 (2016), 563--575.Google ScholarGoogle ScholarCross RefCross Ref
  22. M. Kang, R. Ma, Z. Li, X. Hu, and P. An. 2016. Fast mode decision algorithm for quality scalable HEVC. In Proceedings of Digital TV and Wireless Multimedia Communication. 349--357.Google ScholarGoogle Scholar
  23. H. Kim and R. Park. 2016. Fast CU partitioning algorithm for HEVC using online learning based Bayesian decision rule. IEEE Trans. Circuits Syst. Video Technol. 26, 1 (2016), 130--138.Google ScholarGoogle ScholarCross RefCross Ref
  24. B. Lee and M. Kim. 2012. An efficient inter-prediction mode decision method for temporal scalability coding with hierarchical B-picture structure. IEEE Trans. Broadcast. 58, 2 (2012), 285--290.Google ScholarGoogle ScholarCross RefCross Ref
  25. B. Lee, J. Jung, and M. Kim. 2016. An all-zero block detection scheme for low-complexity HEVC encoders. IEEE Trans. Multimedia. 18, 7 (2016), 1257--1268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. C. Li, H. Xiong, J. Zou, and D. Wu. 2018. Joint dynamic rate control and transmission scheduling for scalable video multirate multicast over wireless networks. IEEE Trans. Multimedia. 20, 2 (2018), 361--378. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. J. Lee, K. Goswami, B. Kim, S. Jeong, and J. Choi. 2016. Fast encoding algorithm for high-efficiency video coding (HEVC) system based on spatio-temporal correlation. J. Real-Time Image Proc. 12, 2 (2016), 407--418. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. J. Lei, D. Li, Z. Pan, Z. Sun, S. Kwong, and C. Hou. 2017. Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding. IEEE Trans. Broadcasting 63, 1 (2017), 48--58.Google ScholarGoogle ScholarCross RefCross Ref
  29. H. Li, Z. Li, and C. Wen. 2006. Fast mode decision algorithm for inter-frame coding in fully scalable video coding. IEEE Trans. Circuits Syst. for Video Technol. 16, 7 (2006), 889--895. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. G. Li and T. Chang. 2011. An efficient mode pre-selection algorithm for fractional motion estimation in H.264/AVC scalable video extension. In 17th International Conference on Digital Signal Processing (DSP). 1--5.Google ScholarGoogle Scholar
  31. Q. Li, B. Liu, and D. Wang. 2018. Fast CU size decision and PU mode decision algorithm for quality SHVC inter coding. Multimedia Tools Appl. 1--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. X. Li, M. Chen, Z. Qu, J. Xiao, and M. Gabbouj. 2017. An effective CU size decision method for quality scalability in SHVC. Multimedia Tools Appl. 76, 6 (2017), 8011--8030. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. X. Lu, C. Yu, and Y. Gu. 2018. A fast intra coding algorithm for spatial scalability in SHVC. In Proceedings of IEEE International Conference on Image Processing (ICIP). 1792--1796.Google ScholarGoogle Scholar
  34. D. Miao, J. Fu, Y. Lu, S. Li, and C. Chen. 2016. A high-fidelity and low-interaction-delay screen sharing system. ACM Trans. Multimedia Comput. Commun. Appl. 12, 3, Article 44 (2016), 23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Z. Pan, S. Kwong, M. T. Sun, and J. Lei. 2014. Early MERGE mode decision based on motion estimation and hierarchical depth correlation for HEVC. IEEE Trans. Broadcast. 60, 2 (2014), 405--412.Google ScholarGoogle ScholarCross RefCross Ref
  36. H. Schwarz, D. Marpe, and T. Wiegand. 2014. Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17, 9 (2014), 1103--1120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. L. Shen, P. An, Z. Zhang, Q. Hu, and Z. Chen. 2015. A 3D-HEVC fast mode decision algorithm for real-time applications. ACM Trans. Multimedia Comput. Commun. Appl. 11, 3, Article 34 (2015), 23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. L. Shen, P. An, and Z. Liu. 2017. Context-adaptive based CU processing for 3D-HEVC. PLOS ONE 23.Google ScholarGoogle Scholar
  39. L. Shen, Z. Liu, X. Zhang, W. Zhao, and Z. Zhang. 2013. An effective CU size decision method for HEVC encoders. IEEE Trans. Multimedia. 15, 2 (2013), 465--470. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. L. Shen and Z. Zhang. 2012. Content-adaptive motion estimation algorithm for coarse-grain SVC. IEEE Trans. Image Processing. 21, 5 (2012), 2582--2591. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. L. Shen, Z. Zhang, and Z. Liu. 2014. Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatiotemporal correlations. IEEE Trans. Circuits Syst. Video Technol. 24, 10 (2014), 1709--1722.Google ScholarGoogle ScholarCross RefCross Ref
  42. Z. Shi, X. Sun, and Wu F. 2012. Spatially scalable video coding for HEVC. IEEE Trans. Circuits Syst. Video Technol. 22, 12 (2012), 1813--1826. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. G. J. Sullivan, J. Ohm, W. Han, and T. Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22, 12 (2012), 1649--1668. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. H. R. Tohidypour, H. Bashashati, M. T. Pourazad, and P. Nasiopoulos. 2013. Fast mode assignment for quality scalable extension of the high efficiency video coding (HEVC) standard: A Bayesian approach. In Proceedings of the 6th Balkan Conference in Informatics. 61--65. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. H. R. Tohidypour, M. T. Pourazad, and P. Nasiopoulos. 2014. Adaptive search range method for spatial scalable HEVC. In Proceedings of IEEE International Conference on Consumer Electronics (ICCE). 191--192.Google ScholarGoogle Scholar
  46. H. R. Tohidypour, M. T. Pourazad, and P. Nasiopoulos. 2016. Probabilistic approach for predicting the size of coding units in the quad-tree structure of the quality and spatial scalable HEVC. IEEE Trans. Multimedia. 18, 2 (2016), 182--195.Google ScholarGoogle ScholarCross RefCross Ref
  47. H. Wang, Y. Heng, and H. Du. 2014. Optimal stopping theory based algorithm for coding unit size decision in HEVC. In Proceedings of Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). 1--4.Google ScholarGoogle Scholar
  48. D. Wang, C. Yuan, Y. Sun, J. Zhang, and Zhou H. 2014. Fast mode and depth decision algorithm for intra prediction of quality SHVC. In Proceedings of International Conference on Intelligent Computing. 693--699.Google ScholarGoogle Scholar
  49. M. Xu, Z. Ma, and Wang Y. 2015. One-pass mode and motion decision for multilayer quality scalable video coding. IEEE Trans. Image Processing 24, 11 (2015), 4250--4262.Google ScholarGoogle ScholarCross RefCross Ref
  50. C. Yeh, K. Fan, M. Chen, and G. Li. 2010. Fast mode decision algorithm for scalable video coding using Bayesian theorem detection and Markov process. IEEE Trans. Circuits Syst. Video Technol. 20, 4 (2010) 563--574. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. X. Zuo and L. Yu. 2014. Fast mode decision method for all intra spatial scalability in SHVC. In Proceedings of IEEE Conference on Visual Communications and Image Processing. 394--397.Google ScholarGoogle Scholar
  52. Y. Zhang, S. Huang, H. Li, and H. Chao. 2013. An optimally complexity scalable multi-mode decision algorithm for HEVC. In Proceedings of IEEE International Conference on Image Processing. 2000--2004.Google ScholarGoogle Scholar

Index Terms

(auto-classified)
  1. Low-Complexity Scalable Extension of the High-Efficiency Video Coding (SHVC) Encoding System

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Multimedia Computing, Communications, and Applications
      ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 15, Issue 2
      May 2019
      375 pages
      ISSN:1551-6857
      EISSN:1551-6865
      DOI:10.1145/3339884
      Issue’s Table of Contents

      Copyright © 2019 ACM

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 5 June 2019
      • Accepted: 1 February 2019
      • Revised: 1 December 2018
      • Received: 1 June 2018
      Published in tomm Volume 15, Issue 2

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!