skip to main content
research-article

Statistical Early Termination and Early Skip Models for Fast Mode Decision in HEVC INTRA Coding

Authors Info & Claims
Published:29 July 2019Publication History
Skip Abstract Section

Abstract

In this article, statistical Early Termination (ET) and Early Skip (ES) models are proposed for fast Coding Unit (CU) and prediction mode decision in HEVC INTRA coding, in which three categories of ET and ES sub-algorithms are included. First, the CU ranges of the current CU are recursively predicted based on the texture and CU depth of the spatial neighboring CUs. Second, the statistical model based ET and ES schemes are proposed and applied to optimize the CU and INTRA prediction mode decision, in which the coding complexities over different decision layers are jointly minimized subject to acceptable rate-distortion degradation. Third, the mode correlations among the INTRA prediction modes are exploited to early terminate the full rate-distortion optimization in each CU decision layer. Extensive experiments are performed to evaluate the coding performance of each sub-algorithm and the overall algorithm. Experimental results reveal that the overall proposed algorithm can achieve 45.47% to 74.77%, and 58.09% on average complexity reduction, while the overall Bjøntegaard delta bit rate increase and Bjøntegaard delta peak signal-to-noise ratio degradation are 2.29% and −0.11 dB, respectively.

References

  1. G. J. Sullivan, J. R. Ohm, W. J. Han, and T. Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circ. Syst. Video Technol. 22, 12 (2012) 1649--1668. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Y. Li, G. Yang, Y. Zhu, X. Ding, and R. Gong. 2018. Probability model-based early merge mode decision for dependent views coding in 3D-HEVC. ACM Trans. Multimedia Comput. Commun. Appl. 14, 4 85 (2018) 15 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. J. Lainema, F. Bossen, W. J. Han, J. Min, and K. Ugur. 2012. Intra coding of the HEVC standard. IEEE Trans. Circ. Syst. Video Technol. 22, 12 (2012) 1792--1801. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Y. Zhang, S. Kwong, X. Wang, Z. Pan, H. Yuan, and L. Xu. 2015. Machine learning based coding unit depth decisions for flexible complexity allocation in high efficiency video coding. IEEE Trans. Image Proc. 24, 7 (2015) 2225--2238.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. L. Shen, P. An, Z. Zhang, Q. Hu, and Z. Chen. 2015. A 3D-HEVC fast mode decision algorithm for real-time applications. ACM Trans. Multimedia Comput. Commun. Appl. 11, 3 (2015) 23 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. L. Shen, Z. Zhang, and Z. Liu. 2014. Effective CU size decision for HEVC Intracoding. IEEE Trans. Image Proc. 23, 10 (2014) 4232--4241.Google ScholarGoogle ScholarCross RefCross Ref
  7. Y. Zhang, S. Kwong, G. Zhang, Z. Pan, Y. Hui, and G. Jiang. 2015. Low complexity HEVC INTRA coding for high quality mobile video communication. IEEE Trans. Industr. Inform. 11, 6, (2015) 1492--1504.Google ScholarGoogle ScholarCross RefCross Ref
  8. B. Min and R. C. C. Cheung. 2015. A fast CU size decision algorithm for the HEVC intra encoder. IEEE Trans. Circ. Syst. Video Technol. 25, 5 (2015) 892--896.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. K. Lim, J. Lee, S. Kim, and S. Lee. 2015. Fast PU skip and split termination algorithm for HEVC intra prediction. IEEE Trans. Circ. Syst. Video Technol. 25, 8 (2015) 1335--1346.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. M. Jamali and S. Coulombe. 2018. Fast HEVC intra mode decision based on RDO cost prediction. IEEE Trans. Broad. 65, 1 (2019), 109--122.Google ScholarGoogle ScholarCross RefCross Ref
  11. F. Luo, S. Wang, S. Ma, N. Zhang, Y. Zhou, and W. Gao. 2017. Fast intra coding unit size decision for HEVC with GPU based keypoint detection. In Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS’17). 1--4.Google ScholarGoogle Scholar
  12. J. Chen and L. Yu. 2016. Effective HEVC intra coding unit size decision based on online progressive Bayesian classification. In Proceedings of the IEEE International Conference on Multimedia and Expo. (ICME’16). 1--6.Google ScholarGoogle Scholar
  13. X. Liu, Y. Li, D. Liu, P. Wang, and L. T. Yang. 2019. An adaptive CU size decision algorithm for HEVC intra prediction based on complexity classification using machine learning. IEEE Trans. Circ. Syst. Video Technol. 29, 1, (2019) 144--155. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Z. Liu, X. Yu, Y. Gao, S. Chen, X. Ji, and D. Wang. 2016. CU partition mode decision for HEVC hardwired intra encoder using convolution neural network. IEEE Trans. Image Proc. 25, 11 (2016) 5088--5103. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Xu, T. Li, Z. Wang, X. Deng, R. Yang, and Z. Guan. 2018. Reducing complexity of HEVC: A deep learning approach. IEEE Trans. Image Proc. 27, 10 (2018) 5044--5059.Google ScholarGoogle ScholarCross RefCross Ref
  16. Y. Zhang, Z. Pan, N. Li, X. Wang, G. Jiang, and S. Kwong, 2018. Effective data driven coding unit size decision approaches for HEVC intra coding. IEEE Trans. Circ. Syst. Video Technol. 28, 11 (2018) 3208--3222.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. L. L. Wang and W. C. Siu. 2013. Novel adaptive algorithm for intra prediction with compromised modes skipping and signaling processes in HEVC. IEEE Trans. Circ. Syst. Video Technol. 23, 10 (2013) 1686--1694. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. M. Alwani and S. Johar. 2013. A method for fast rough mode decision in HEVC. In Proceedings of the Data Compression Conference. 476--476. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. M. Abdelrasoul, M. S. Sayed, and V. Goulart. 2017. Diagonal-based fast intra-mode decision algorithm for HEVC. IET Image Proc. 11, 10 (2017) 888--898.Google ScholarGoogle ScholarCross RefCross Ref
  20. W. Zhao, T. Onoye, and T. Song. 2015. Hierarchical structure-based fast mode decision for H.265/HEVC. IEEE Trans. Circ. Syst. Video Technol. 25, 10 (2015) 1651--1664.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. J. Lei, D. Li, Z. Pan, Z. Sun, S. Kwong, and C. Hou. 2017. Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding. IEEE Trans. Broad. 63, 1 (2017) 48--58.Google ScholarGoogle ScholarCross RefCross Ref
  22. M. Bichon, J. Le Tanou, M. Ropert, W. Hammidouche, L. Morin, and L. Zhang. 2018. Low complexity joint RDO of prediction units couples for HEVC intra coding. In Proceedings of the IEEE International Conference on Acoustics, Speech &Signal Processing (ICASSP’18). 1733--1737.Google ScholarGoogle Scholar
  23. S. Ryu and J. Kang. 2018. Machine learning-based fast angular prediction mode decision technique in video coding. IEEE Trans. Image Proc. 27, 11 (2018) 5525--5538. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. C. F. Tseng and Y. T. Lai. 2016. Fast coding unit decision and mode selection for intra-frame coding in high-efficiency video coding. IET Image Proc. 10, 3 (2016) 215--221.Google ScholarGoogle ScholarCross RefCross Ref
  25. X. Shang, G. Wang, T. Fan, and Y. Li. 2015. Fast CU size decision and PU mode decision algorithm in HEVC intra coding. In Proceedings of the IEEE International Conference on Image Processing (ICIP’15). 1593--1597.Google ScholarGoogle Scholar
  26. M. Zhang, X. Zhai, and Z. Liu. 2017. Fast and adaptive mode decision and CU partition early termination algorithm for intra-prediction in HEVC, J. Image Video Proc. 2017 86 (2017).Google ScholarGoogle ScholarCross RefCross Ref
  27. F. Chen, D. Jin, Z. Peng, G. Jiang, M. Yu, and H. Chen. 2018. Fast intra coding algorithm for HEVC based on depth range prediction and mode reduction. Multimedia Tools Appl. 77, 10 (2018). Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. X. Liu, Y. Liu, P. Wang, C.-F. Lai, and H.-C. Chao. 2017. An adaptive mode decision algorithm based on video texture characteristics for HEVC intra prediction. IEEE Trans. Circ. Syst. Video Technol. 27, 8 (2017), 1737--1748.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. H. Zhang and Z. Ma. 2014. Fast intra mode decision for high efficiency video coding (HEVC). IEEE Trans. Circ. Syst. Video Technol. 24, 4 (2014) 660--668.Google ScholarGoogle ScholarCross RefCross Ref
  30. L. Shen, K. Li, G. Feng, P. An, and Z. Liu. 2018. Efficient intra mode selection for depth-map coding utilizing spatiotemporal, inter-component and inter-view correlations in 3D-HEVC. IEEE Trans. Image Proc. 27, 9 (2018) 4195--4206.Google ScholarGoogle ScholarCross RefCross Ref
  31. T. Zhang, M. T. Sun, D. Zhao, and W. Gao. 2017. Fast intra-mode and CU size decision for HEVC. IEEE Trans. Circ. Syst. Video Technol. 27, 8 (2017) 1714--1724.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Statistical Early Termination and Early Skip Models for Fast Mode Decision in HEVC INTRA Coding

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!