Abstract
In this article, statistical Early Termination (ET) and Early Skip (ES) models are proposed for fast Coding Unit (CU) and prediction mode decision in HEVC INTRA coding, in which three categories of ET and ES sub-algorithms are included. First, the CU ranges of the current CU are recursively predicted based on the texture and CU depth of the spatial neighboring CUs. Second, the statistical model based ET and ES schemes are proposed and applied to optimize the CU and INTRA prediction mode decision, in which the coding complexities over different decision layers are jointly minimized subject to acceptable rate-distortion degradation. Third, the mode correlations among the INTRA prediction modes are exploited to early terminate the full rate-distortion optimization in each CU decision layer. Extensive experiments are performed to evaluate the coding performance of each sub-algorithm and the overall algorithm. Experimental results reveal that the overall proposed algorithm can achieve 45.47% to 74.77%, and 58.09% on average complexity reduction, while the overall Bjøntegaard delta bit rate increase and Bjøntegaard delta peak signal-to-noise ratio degradation are 2.29% and −0.11 dB, respectively.
- G. J. Sullivan, J. R. Ohm, W. J. Han, and T. Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circ. Syst. Video Technol. 22, 12 (2012) 1649--1668. Google Scholar
Digital Library
- Y. Li, G. Yang, Y. Zhu, X. Ding, and R. Gong. 2018. Probability model-based early merge mode decision for dependent views coding in 3D-HEVC. ACM Trans. Multimedia Comput. Commun. Appl. 14, 4 85 (2018) 15 pages. Google Scholar
Digital Library
- J. Lainema, F. Bossen, W. J. Han, J. Min, and K. Ugur. 2012. Intra coding of the HEVC standard. IEEE Trans. Circ. Syst. Video Technol. 22, 12 (2012) 1792--1801. Google Scholar
Digital Library
- Y. Zhang, S. Kwong, X. Wang, Z. Pan, H. Yuan, and L. Xu. 2015. Machine learning based coding unit depth decisions for flexible complexity allocation in high efficiency video coding. IEEE Trans. Image Proc. 24, 7 (2015) 2225--2238.Google Scholar
Digital Library
- L. Shen, P. An, Z. Zhang, Q. Hu, and Z. Chen. 2015. A 3D-HEVC fast mode decision algorithm for real-time applications. ACM Trans. Multimedia Comput. Commun. Appl. 11, 3 (2015) 23 pages. Google Scholar
Digital Library
- L. Shen, Z. Zhang, and Z. Liu. 2014. Effective CU size decision for HEVC Intracoding. IEEE Trans. Image Proc. 23, 10 (2014) 4232--4241.Google Scholar
Cross Ref
- Y. Zhang, S. Kwong, G. Zhang, Z. Pan, Y. Hui, and G. Jiang. 2015. Low complexity HEVC INTRA coding for high quality mobile video communication. IEEE Trans. Industr. Inform. 11, 6, (2015) 1492--1504.Google Scholar
Cross Ref
- B. Min and R. C. C. Cheung. 2015. A fast CU size decision algorithm for the HEVC intra encoder. IEEE Trans. Circ. Syst. Video Technol. 25, 5 (2015) 892--896.Google Scholar
Digital Library
- K. Lim, J. Lee, S. Kim, and S. Lee. 2015. Fast PU skip and split termination algorithm for HEVC intra prediction. IEEE Trans. Circ. Syst. Video Technol. 25, 8 (2015) 1335--1346.Google Scholar
Digital Library
- M. Jamali and S. Coulombe. 2018. Fast HEVC intra mode decision based on RDO cost prediction. IEEE Trans. Broad. 65, 1 (2019), 109--122.Google Scholar
Cross Ref
- F. Luo, S. Wang, S. Ma, N. Zhang, Y. Zhou, and W. Gao. 2017. Fast intra coding unit size decision for HEVC with GPU based keypoint detection. In Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS’17). 1--4.Google Scholar
- J. Chen and L. Yu. 2016. Effective HEVC intra coding unit size decision based on online progressive Bayesian classification. In Proceedings of the IEEE International Conference on Multimedia and Expo. (ICME’16). 1--6.Google Scholar
- X. Liu, Y. Li, D. Liu, P. Wang, and L. T. Yang. 2019. An adaptive CU size decision algorithm for HEVC intra prediction based on complexity classification using machine learning. IEEE Trans. Circ. Syst. Video Technol. 29, 1, (2019) 144--155. Google Scholar
Digital Library
- Z. Liu, X. Yu, Y. Gao, S. Chen, X. Ji, and D. Wang. 2016. CU partition mode decision for HEVC hardwired intra encoder using convolution neural network. IEEE Trans. Image Proc. 25, 11 (2016) 5088--5103. Google Scholar
Digital Library
- M. Xu, T. Li, Z. Wang, X. Deng, R. Yang, and Z. Guan. 2018. Reducing complexity of HEVC: A deep learning approach. IEEE Trans. Image Proc. 27, 10 (2018) 5044--5059.Google Scholar
Cross Ref
- Y. Zhang, Z. Pan, N. Li, X. Wang, G. Jiang, and S. Kwong, 2018. Effective data driven coding unit size decision approaches for HEVC intra coding. IEEE Trans. Circ. Syst. Video Technol. 28, 11 (2018) 3208--3222.Google Scholar
Digital Library
- L. L. Wang and W. C. Siu. 2013. Novel adaptive algorithm for intra prediction with compromised modes skipping and signaling processes in HEVC. IEEE Trans. Circ. Syst. Video Technol. 23, 10 (2013) 1686--1694. Google Scholar
Digital Library
- M. Alwani and S. Johar. 2013. A method for fast rough mode decision in HEVC. In Proceedings of the Data Compression Conference. 476--476. Google Scholar
Digital Library
- M. Abdelrasoul, M. S. Sayed, and V. Goulart. 2017. Diagonal-based fast intra-mode decision algorithm for HEVC. IET Image Proc. 11, 10 (2017) 888--898.Google Scholar
Cross Ref
- W. Zhao, T. Onoye, and T. Song. 2015. Hierarchical structure-based fast mode decision for H.265/HEVC. IEEE Trans. Circ. Syst. Video Technol. 25, 10 (2015) 1651--1664.Google Scholar
Digital Library
- J. Lei, D. Li, Z. Pan, Z. Sun, S. Kwong, and C. Hou. 2017. Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding. IEEE Trans. Broad. 63, 1 (2017) 48--58.Google Scholar
Cross Ref
- M. Bichon, J. Le Tanou, M. Ropert, W. Hammidouche, L. Morin, and L. Zhang. 2018. Low complexity joint RDO of prediction units couples for HEVC intra coding. In Proceedings of the IEEE International Conference on Acoustics, Speech &Signal Processing (ICASSP’18). 1733--1737.Google Scholar
- S. Ryu and J. Kang. 2018. Machine learning-based fast angular prediction mode decision technique in video coding. IEEE Trans. Image Proc. 27, 11 (2018) 5525--5538. Google Scholar
Digital Library
- C. F. Tseng and Y. T. Lai. 2016. Fast coding unit decision and mode selection for intra-frame coding in high-efficiency video coding. IET Image Proc. 10, 3 (2016) 215--221.Google Scholar
Cross Ref
- X. Shang, G. Wang, T. Fan, and Y. Li. 2015. Fast CU size decision and PU mode decision algorithm in HEVC intra coding. In Proceedings of the IEEE International Conference on Image Processing (ICIP’15). 1593--1597.Google Scholar
- M. Zhang, X. Zhai, and Z. Liu. 2017. Fast and adaptive mode decision and CU partition early termination algorithm for intra-prediction in HEVC, J. Image Video Proc. 2017 86 (2017).Google Scholar
Cross Ref
- F. Chen, D. Jin, Z. Peng, G. Jiang, M. Yu, and H. Chen. 2018. Fast intra coding algorithm for HEVC based on depth range prediction and mode reduction. Multimedia Tools Appl. 77, 10 (2018). Google Scholar
Digital Library
- X. Liu, Y. Liu, P. Wang, C.-F. Lai, and H.-C. Chao. 2017. An adaptive mode decision algorithm based on video texture characteristics for HEVC intra prediction. IEEE Trans. Circ. Syst. Video Technol. 27, 8 (2017), 1737--1748.Google Scholar
Digital Library
- H. Zhang and Z. Ma. 2014. Fast intra mode decision for high efficiency video coding (HEVC). IEEE Trans. Circ. Syst. Video Technol. 24, 4 (2014) 660--668.Google Scholar
Cross Ref
- L. Shen, K. Li, G. Feng, P. An, and Z. Liu. 2018. Efficient intra mode selection for depth-map coding utilizing spatiotemporal, inter-component and inter-view correlations in 3D-HEVC. IEEE Trans. Image Proc. 27, 9 (2018) 4195--4206.Google Scholar
Cross Ref
- T. Zhang, M. T. Sun, D. Zhao, and W. Gao. 2017. Fast intra-mode and CU size decision for HEVC. IEEE Trans. Circ. Syst. Video Technol. 27, 8 (2017) 1714--1724.Google Scholar
Digital Library
Index Terms
Statistical Early Termination and Early Skip Models for Fast Mode Decision in HEVC INTRA Coding
Recommendations
CU encoding depth prediction, early CU splitting termination and fast mode decision for fast HEVC intra-coding
High Efficiency Video Coding (HEVC) is a new video coding standard achieving about a 50% bit rate reduction compared to the popular H.264/AVC High Profile with the same subjective reproduced video quality. Better coding efficiency is attained, however, ...
Fast intra mode decision for depth coding in 3D-HEVC
The emergent 3D High Efficiency Video Coding (3D-HEVC) is an extension of the High Efficiency Video Coding (HEVC) standard for the compression of the multi-view texture videos plus depth maps format. Since depth maps have different statistical ...
Fast mode decision algorithm for intra prediction in HEVC
ICIMCS '13: Proceedings of the Fifth International Conference on Internet Multimedia Computing and ServiceThe High Efficiency Video Coding (HEVC) standard achieves much better efficiency than previous video coding standards. One contributor to this improvement is the large set of intra prediction modes that it supports. While resulting in the better Rate-...






Comments