Abstract
The scalable extension of the high-efficiency video coding (SHVC) system adopts a hierarchical quadtree-based coding unit (CU) that is suitable for various texture and motion properties of videos. Currently, the test model of SHVC identifies the optimal CU size by performing an exhaustive quadtree depth-level search, which achieves a high compression efficiency at a heavy cost in terms of the computational complexity. However, many interactive multimedia applications, such as remote monitoring and video surveillance, which are sensitive to time delays, have insufficient computational power for coding high-definition (HD) and ultra-high-definition (UHD) videos. Therefore, it is important, yet challenging, to optimize the SHVC coding procedure and accelerate video coding. In this article, we propose a fast CU quadtree depth-level decision algorithm for inter-frames on enhancement layers that is based on an analysis of inter-layer, spatial, and temporal correlations. When motion/texture properties of coding regions can be identified early, a fast algorithm can be designed for adapting CU depth-level decision procedures to video contents and avoiding unnecessary computations during CU depth-level traversal. The proposed algorithm determines the motion activity level at the treeblock size of the hierarchical quadtree by utilizing motion vectors from its corresponding blocks at the base layer. Based on the motion activity level, neighboring encoded CUs that have larger correlations are preferentially selected to predict the optimal depth level of the current treeblock. Finally, two parameters, namely, the motion activity level and the predicted CU depth level, are used to identify a subset of candidate CU depth levels and adaptively optimize CU depth-level decision processes. The experimental results demonstrate that the proposed scheme can run approximately three times faster than the most recent SHVC reference software, with a negligible loss of compression efficiency. The proposed scheme is efficient for all types of scalable video sequences under various coding conditions and outperforms state-of-the-art fast SHVC and HEVC algorithms. Our scheme is a suitable candidate for interactive HD/UHD video applications that are expected to operate in real-time and power-constrained scenarios.
- R. Bailleul, J. De Cock, and R. Van de Walle. 2014. Fast mode decision for SNR scalability in SHVC digest of technical papers. In Proceedings of IEEE International Conference on Consumer Electronics (ICCE). 193--194.Google Scholar
- G. Bjontegaard. 2001. Calculation of average PSNR difference between RD-curves. 13th VCEG-M33 Meeting.Google Scholar
- J. M. Boyce, Y. Ye, J. Chen, and A. K. Ramasubramonian. 2016. Overview of SHVC: Scalable extensions of the High Efficiency Video Coding (HEVC) standard. IEEE Trans. Circuits Video Technol. 26, 1 (2016), 20--34.Google Scholar
Cross Ref
- G. Correa, P. Assuncao, L. A. Da Silva Cruz, and L. Agostini. 2015. Encoding time control system for HEVC based on rate-distortion-complexity analysis. In Proceedings of IEEE International Symposium on Circuits and Systems (ISCAS). 1114--1117.Google Scholar
- W. Chiang, J. Chen, and Y. Tsai. 2017. A fast SHVC coding scheme based on base layer co-located CU and cross-layer PU mode information. In Proceedings of IEEE International Conference on Multimedia 8 Expo Workshops (ICMEW). 381--386.Google Scholar
- A. J. Diaz-Honrubia, J. L. Martinez, P. Cuenca, J. A. Gamez, and J. M. Puerta. 2016. Adaptive fast quadtree level decision algorithm for H.264 to HEVC video transcoding. IEEE Trans. Circuits Syst. Video Technol. 26, 1 (2016), 154--168.Google Scholar
Cross Ref
- J. De Cock, S. Notebaert, P. Lambert, and R. Van de Walle. 2009. Architectures for fast transcoding of H.264/AVC to quality-scalable SVC streams. IEEE Trans. Multimedia. 11, 7 (2009), 1209--1224. Google Scholar
Digital Library
- H. Fan, R. Wang, L. Ding, X. Xie, H. Jia, and W. Gao. 2016. Hybrid zero block detection for high efficiency video coding. IEEE Trans. Multimedia. 18, 3 (2016), 537--543. Google Scholar
Digital Library
- B. Fu, D. Staehle, G. Kunzmann, E. Steinbach, and W. Kellerer. 2015. QoE-based SVC layer dropping in LTE networks using content-aware layer priorities. ACM Trans. Multimedia Comput. Commun. Appl. 12, 1, Article 7 (2015), 23. Google Scholar
Digital Library
- G. Fu, L. Shen, H. Yang, X. Hu, and P. An. 2018. Fast intra coding of high dynamic range videos in SHVC. IEEE Signal Process. Lett. 25, 11 (2018), 1665--1669.Google Scholar
Cross Ref
- Q. Ge and D. Hu. 2014. Fast encoding method using CU depth for quality scalable HEVC. In Proceedings of IEEE Workshop on Advanced Research and Technology in Industry Applications (WARTIA). 1366--1370.Google Scholar
- D. Grois and O. Hadar. 2014. Complexity-aware adaptive preprocessing scheme for region-of-interest spatial scalable video coding. IEEE Trans. Circuits Syst. Video Technol. 24, 6 (2014), 1025--1039.Google Scholar
Cross Ref
- A. Heindel and A. Kaup. 2015. Fast intra mode decision in HEVC using early distortion estimation. In Proceedings of IEEE China Summit and International Conference on Signal and Information Processing (China SIP). 559--563.Google Scholar
- B. Hilmi, K. Goswami, J. Lee, and B. Kim. 2012. Fast inter-mode decision algorithm for H.264/AVC using macroblock correlation and motion complexity analysis. In Proceedings of IEEE International Conference on Consumer Electronics (ICCE). 90--91.Google Scholar
- C. Hsu and M. Hefeeda. 2008. On the accuracy and complexity of rate-distortion models for fine-grained scalable video sequences. ACM Trans. Multimedia Comput. Commun. Appl. 4, 2, Article 15 (2008), 22. Google Scholar
Digital Library
- JCTVC-F092. 2011. Coding tree pruning based CU early termination. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Torino, IT.Google Scholar
- JCTVC-F045. 2011. Early termination of CU encoding to reduce HEVC complexity. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Torino, IT.Google Scholar
- JCTVC-E090. 2011. Adaptive CU depth range. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Geneva, Switzerland.Google Scholar
- JCTVC-O0022. 2013. Test sequence material (AHG22). ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Geneva, Switzerland.Google Scholar
- JCTVC-P1009. 2014. Common SHM test Conditions and Software Reference Configurations. San José, NM.Google Scholar
- A. Jiménez-Moreno, E. Martínez-Enríquez, and F. Díaz-de-María. 2016. Complexity control based on a fast coding unit decision method in the HEVC video coding standard. IEEE Trans. Multimedia. 18, 4 (2016), 563--575.Google Scholar
Cross Ref
- M. Kang, R. Ma, Z. Li, X. Hu, and P. An. 2016. Fast mode decision algorithm for quality scalable HEVC. In Proceedings of Digital TV and Wireless Multimedia Communication. 349--357.Google Scholar
- H. Kim and R. Park. 2016. Fast CU partitioning algorithm for HEVC using online learning based Bayesian decision rule. IEEE Trans. Circuits Syst. Video Technol. 26, 1 (2016), 130--138.Google Scholar
Cross Ref
- B. Lee and M. Kim. 2012. An efficient inter-prediction mode decision method for temporal scalability coding with hierarchical B-picture structure. IEEE Trans. Broadcast. 58, 2 (2012), 285--290.Google Scholar
Cross Ref
- B. Lee, J. Jung, and M. Kim. 2016. An all-zero block detection scheme for low-complexity HEVC encoders. IEEE Trans. Multimedia. 18, 7 (2016), 1257--1268. Google Scholar
Digital Library
- C. Li, H. Xiong, J. Zou, and D. Wu. 2018. Joint dynamic rate control and transmission scheduling for scalable video multirate multicast over wireless networks. IEEE Trans. Multimedia. 20, 2 (2018), 361--378. Google Scholar
Digital Library
- J. Lee, K. Goswami, B. Kim, S. Jeong, and J. Choi. 2016. Fast encoding algorithm for high-efficiency video coding (HEVC) system based on spatio-temporal correlation. J. Real-Time Image Proc. 12, 2 (2016), 407--418. Google Scholar
Digital Library
- J. Lei, D. Li, Z. Pan, Z. Sun, S. Kwong, and C. Hou. 2017. Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding. IEEE Trans. Broadcasting 63, 1 (2017), 48--58.Google Scholar
Cross Ref
- H. Li, Z. Li, and C. Wen. 2006. Fast mode decision algorithm for inter-frame coding in fully scalable video coding. IEEE Trans. Circuits Syst. for Video Technol. 16, 7 (2006), 889--895. Google Scholar
Digital Library
- G. Li and T. Chang. 2011. An efficient mode pre-selection algorithm for fractional motion estimation in H.264/AVC scalable video extension. In 17th International Conference on Digital Signal Processing (DSP). 1--5.Google Scholar
- Q. Li, B. Liu, and D. Wang. 2018. Fast CU size decision and PU mode decision algorithm for quality SHVC inter coding. Multimedia Tools Appl. 1--18. Google Scholar
Digital Library
- X. Li, M. Chen, Z. Qu, J. Xiao, and M. Gabbouj. 2017. An effective CU size decision method for quality scalability in SHVC. Multimedia Tools Appl. 76, 6 (2017), 8011--8030. Google Scholar
Digital Library
- X. Lu, C. Yu, and Y. Gu. 2018. A fast intra coding algorithm for spatial scalability in SHVC. In Proceedings of IEEE International Conference on Image Processing (ICIP). 1792--1796.Google Scholar
- D. Miao, J. Fu, Y. Lu, S. Li, and C. Chen. 2016. A high-fidelity and low-interaction-delay screen sharing system. ACM Trans. Multimedia Comput. Commun. Appl. 12, 3, Article 44 (2016), 23. Google Scholar
Digital Library
- Z. Pan, S. Kwong, M. T. Sun, and J. Lei. 2014. Early MERGE mode decision based on motion estimation and hierarchical depth correlation for HEVC. IEEE Trans. Broadcast. 60, 2 (2014), 405--412.Google Scholar
Cross Ref
- H. Schwarz, D. Marpe, and T. Wiegand. 2014. Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17, 9 (2014), 1103--1120. Google Scholar
Digital Library
- L. Shen, P. An, Z. Zhang, Q. Hu, and Z. Chen. 2015. A 3D-HEVC fast mode decision algorithm for real-time applications. ACM Trans. Multimedia Comput. Commun. Appl. 11, 3, Article 34 (2015), 23. Google Scholar
Digital Library
- L. Shen, P. An, and Z. Liu. 2017. Context-adaptive based CU processing for 3D-HEVC. PLOS ONE 23.Google Scholar
- L. Shen, Z. Liu, X. Zhang, W. Zhao, and Z. Zhang. 2013. An effective CU size decision method for HEVC encoders. IEEE Trans. Multimedia. 15, 2 (2013), 465--470. Google Scholar
Digital Library
- L. Shen and Z. Zhang. 2012. Content-adaptive motion estimation algorithm for coarse-grain SVC. IEEE Trans. Image Processing. 21, 5 (2012), 2582--2591. Google Scholar
Digital Library
- L. Shen, Z. Zhang, and Z. Liu. 2014. Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatiotemporal correlations. IEEE Trans. Circuits Syst. Video Technol. 24, 10 (2014), 1709--1722.Google Scholar
Cross Ref
- Z. Shi, X. Sun, and Wu F. 2012. Spatially scalable video coding for HEVC. IEEE Trans. Circuits Syst. Video Technol. 22, 12 (2012), 1813--1826. Google Scholar
Digital Library
- G. J. Sullivan, J. Ohm, W. Han, and T. Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22, 12 (2012), 1649--1668. Google Scholar
Digital Library
- H. R. Tohidypour, H. Bashashati, M. T. Pourazad, and P. Nasiopoulos. 2013. Fast mode assignment for quality scalable extension of the high efficiency video coding (HEVC) standard: A Bayesian approach. In Proceedings of the 6th Balkan Conference in Informatics. 61--65. Google Scholar
Digital Library
- H. R. Tohidypour, M. T. Pourazad, and P. Nasiopoulos. 2014. Adaptive search range method for spatial scalable HEVC. In Proceedings of IEEE International Conference on Consumer Electronics (ICCE). 191--192.Google Scholar
- H. R. Tohidypour, M. T. Pourazad, and P. Nasiopoulos. 2016. Probabilistic approach for predicting the size of coding units in the quad-tree structure of the quality and spatial scalable HEVC. IEEE Trans. Multimedia. 18, 2 (2016), 182--195.Google Scholar
Cross Ref
- H. Wang, Y. Heng, and H. Du. 2014. Optimal stopping theory based algorithm for coding unit size decision in HEVC. In Proceedings of Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). 1--4.Google Scholar
- D. Wang, C. Yuan, Y. Sun, J. Zhang, and Zhou H. 2014. Fast mode and depth decision algorithm for intra prediction of quality SHVC. In Proceedings of International Conference on Intelligent Computing. 693--699.Google Scholar
- M. Xu, Z. Ma, and Wang Y. 2015. One-pass mode and motion decision for multilayer quality scalable video coding. IEEE Trans. Image Processing 24, 11 (2015), 4250--4262.Google Scholar
Cross Ref
- C. Yeh, K. Fan, M. Chen, and G. Li. 2010. Fast mode decision algorithm for scalable video coding using Bayesian theorem detection and Markov process. IEEE Trans. Circuits Syst. Video Technol. 20, 4 (2010) 563--574. Google Scholar
Digital Library
- X. Zuo and L. Yu. 2014. Fast mode decision method for all intra spatial scalability in SHVC. In Proceedings of IEEE Conference on Visual Communications and Image Processing. 394--397.Google Scholar
- Y. Zhang, S. Huang, H. Li, and H. Chao. 2013. An optimally complexity scalable multi-mode decision algorithm for HEVC. In Proceedings of IEEE International Conference on Image Processing. 2000--2004.Google Scholar
Index Terms
(auto-classified)Low-Complexity Scalable Extension of the High-Efficiency Video Coding (SHVC) Encoding System
Recommendations
Low-complexity inter-layer residual prediction for scalable video coding
In this work, an inter-layer residual prediction method that has low complexity and minimal syntax changes is proposed to improve the rate-distortion RD performance of scalable video coding. The proposed method employs a new inter-layer reference ...
Multi-view video coding based on high efficiency video coding
PSIVT'11: Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part IIMultiview video coding is one of the key techniques to realize the 3D video system. MPEG started a standardization activity on 3DVC (3D video coding) in 2007. 3DVC is based on multiview video coding. MPEG finalized the standard for multiview video ...
A new approach to scalable video coding
DCC '95: Proceedings of the Conference on Data CompressionThis paper introduces a new framework for video coding that facilitates operation over a wide range of transmission rates. The new method is a subband coding approach that employs motion compensation, and uses prediction-frame and intra-frame coding ...






Comments