skip to main content
research-article

Complexity Correlation-Based CTU-Level Rate Control with Direction Selection for HEVC

Published:12 August 2017Publication History
Skip Abstract Section

Abstract

Rate control is a crucial consideration in high-efficiency video coding (HEVC). The estimation of model parameters is very important for coding tree unit (CTU)-level rate control, as it will significantly affect bit allocation and thus coding performance. However, the model parameters in the CTU-level rate control sometimes fails because of inadequate consideration of the correlation between model parameters and complexity characteristic. In this study, we establish a novel complexity correlation-based CTU-level rate control for HEVC. First, we formulate the model parameter estimation scheme as a multivariable estimation problem; second, based on the complexity correlation of the neighbouring CTU, an optimal direction is selected in five directions for reference CTU set selection during model parameter estimation to further improve the prediction accuracy of the complexity of the current CTU. Third, to improve their precision, the relationship between the model parameters and the complexity of the reference CTU set in the optimal direction is established by using least square method (LS), and the model parameters are solved via the estimated complexity of the current CTU. Experimental results show that the proposed algorithm can significantly improve the accuracy of the CTU-level rate control and thus the coding performance; the proposed scheme consistently outperforms HM 16.0 and other state-of-the-art algorithms in a variety of testing configurations. More specifically, up to 8.4% and on average 6.4% BD-Rate reduction is achieved compared to HM 16.0 and up to 4.7% and an average of 3.4% BD-Rate reduction is achieved compared to other algorithms, with only a slight complexity overhead.

References

  1. B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan and T. Wiegand. 2012. High efficiency video coding (HEVC) text specification draft 8. In JCTVCH1004, 8th JCTVC Meeing.Google ScholarGoogle Scholar
  2. G. J. Sullivan, J. R. Ohm, W. J. Han, and T. Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22 (Dec. 2012), 1649--1668. DOI:http://dx.doi.org/10.1109/TCSVT.2012.2221191 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. H. Mansour, P. Nasiopoulos, and V. Krishnamurthy. 2011. Rate and distortion modeling of CGS coded scalable video content. IEEE Trans. Multimedia 13 (Apr. 2011), 165--180. DOI:http://dx.doi.org/10.1109/TMM.2010.2099648 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. B. Yan and M. Wang. 2009. Adaptive distortion-based intra-rate estimation for H.264/AVC rate control. IEEE Signal Process. Lett. 16 (Mar. 2009), 145--148. DOI:http://dx.doi.org/10.1109/LSP.2008.2010813 Google ScholarGoogle ScholarCross RefCross Ref
  5. F. Shao, G. Jiang, W. Lin, M. Yu, and Q. Dai. 2013. Joint bit allocation and rate control for coding multi-view video plus depth based 3D video. IEEE Trans. Multimedia 15 (Dec. 2013), 1843--1854. DOI:http://dx.doi.org/10.1109/TMM.2013.2269897 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. X. Jing, L. P. Chau, and W. C. Siu. 2008. Frame complexity-based rate-quantization model for H.264/AVC intraframe rate control. IEEE Signal Process. Lett. 15 (Mar. 2008), 373--376. DOI:http://dx.doi.org/10.1109/LSP.2008.920010 Google ScholarGoogle ScholarCross RefCross Ref
  7. Z. Wang, J. Ming, and B. Fan. 2008. Fast best neighborhood matching algorithm for intra block error concealment in H.264/AVC. In Congress on Image and Signal Processing. 559--563.Google ScholarGoogle Scholar
  8. W. Lin, M. T. Sun, R. Poovendran, and Z. Zhang. 2008. Activity recognition using a combination of category components and local models for video surveillance. IEEE Trans. Circuits Syst. Video Technol. 18 (Aug. 2008), 1128--1139. DOI:http://dx.doi.org/10.1109/TCSVT.2008.927111 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Z. He and D. O. Wu. 2008. Linear rate control and optimum statistical multiplexing for H.264 video broadcast. IEEE Trans. Multimedia 10 (Nov. 2008), 1237--1249. DOI:http://dx.doi.org/10.1109/TMM.2008.2004903 Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Y. Liu, Z. G. Li, and Y. C. Soh. 2006. Adaptive mad prediction and refined R-Q model for H.264/AVC rate control. In IEEE International Conference on Acoustics Speech and Signal Processing Proceedings. Toulouse, 905--908. Google ScholarGoogle ScholarCross RefCross Ref
  11. Z. G. Li, W. Gao, F. Pan, S. W. Ma, K. P. Lim, G. N. Feng, X. Lin, S. Rahardja, H. Q. Lu, and Y. Lu. 2006. Adaptive rate control for H.264. J. Vis. Commun. Image Represent. 17 (Apr. 2006), 376--406. DOI:http://dx.doi.org/10.1016/j.jvcir.2005.04.004 Google ScholarGoogle ScholarCross RefCross Ref
  12. H. Choi, J. Nam, J. Yoo, D. Sim, and I. V. Bajić. 2012. Rate control based on unified RQ model for HEVC. In Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IECJTC1/SC29/WG118th Meeting.CA,San Jos, Feb.1--10.Google ScholarGoogle Scholar
  13. X. Liang, Q. Wang, Y. Zhou, B. Luo, and A. Men. 2013. A novel R-Q model based rate control scheme in HEVC. In Visual Communications and Image Processing (VCIP). 1--6. Google ScholarGoogle ScholarCross RefCross Ref
  14. B. Li, H. Li, L. Li, and J. Zhang. 2013. Rate control by R-lambda model for HEVC. In ITU-T SG16 Contribution, JCTVC-K0103. 1--5.Google ScholarGoogle Scholar
  15. M. Zhou, B. Li, and Y. Zhang. 2016. Content-adaptive parameters estimation for multi-dimensional rate control. J. Vis. Commun. Image Represent. 34 (Jan. 2016), 204--218. DOI:http://dx.doi.org/10.1016/j.jvcir.2015.11.011 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. S. Li, M. Xu, Z. Wang, and X. Sun. 2016. Optimal bit allocation for CTU level rate control in HEVC. IEEE Trans. Circuits Syst. Video Technol. (Jul. 2016), 1. DOI:http://dx.doi.org/10.1109/TCSVT.2016.2589878 Google ScholarGoogle ScholarCross RefCross Ref
  17. M. Wang, K. N. Ngan, and H. Li. 2016. Low-delay rate control for consistent quality using distortion-based lagrange multiplier. IEEE Trans. Image Process. 25 (Apr. 2016), 2943--2955. DOI:http://dx.doi.org/10.1109/tip.2016.2552646 Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. D. Zhao, Y. Zhou, D. Wang, and J. Mao. 2011. Effective macroblock layer rate control algorithm for H.264/AVC. Comput. Electr. Eng. 37 (Jul. 2011), 550--558. DOI:http://dx.doi.org/10.1016/j.compeleceng.2011.04.009 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. P. Wang, Y. Zhang, H.-M. Hu, and B. Li. 2013. Region-classification-based rate control for flicker suppression of i-frames in HEVC. In IEEE International Conference on Image Processing. Melbourne, Australia, 15--18. Google ScholarGoogle ScholarCross RefCross Ref
  20. Y. Liu, Q. Huang, S. Ma, D. Zhao, W. GAO, S. Ci, and H. Tang. 2011. A novel rate control technique for multiview video plus depth based 3D video coding. IEEE Trans. Broadcast. 57 (Jun. 2011), 562--571. DOI:http://dx.doi.org/10.1109/TBC.2011.2105652 Google ScholarGoogle ScholarCross RefCross Ref
  21. B. Lee, M. Kim, and T. Q. Nguyen. 2014. A frame-level rate control scheme based on texture and nontexture rate models for high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 24 (Mar. 2014), 465--479. DOI:http://dx.doi.org/10.1109/TCSVT.2013.2276880 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Y. Chang and M. Kim. 2013. A joint rate control scheme in a hybrid stereoscopic video codec system for 3DTV broadcasting. IEEE Trans. Broadcast. 59 (Jun. 2013), 265--280. DOI:http://dx.doi.org/10.1109/TBC.2013.2240731 Google ScholarGoogle ScholarCross RefCross Ref
  23. M. Wang, K. N. Ngan, and H. Li. 2015. An efficient frame-content based intra frame rate control for high efficiency video coding. IEEE Signal Process. Lett. 22 (Jul. 2015), 896--900. DOI:http://dx.doi.org/10.1109/LSP.2014.2377032 Google ScholarGoogle ScholarCross RefCross Ref
  24. Y. Liu, Z. G. Li, and Y. C. Soh. 2008. Region-of-interest based resource allocation for conversational video communication of H.264/AVC. IEEE Trans. Circuits Syst. Video Technol. 18 (Jan. 2008), 134--139. DOI:http://dx.doi.org/10.1109/TCSVT.2007.913754 Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. J. Liu, Y. Cho, Z. Guo, and J. Kuo. 2010. Bit allocation for spatial scalability coding of H.264/SVC with dependent rate-distortion analysis. IEEE Trans. Circuits Syst. Video Technol. 20 (Jul. 2010), 967--981. DOI:http://dx.doi.org/10.1109/TCSVT.2010.2045924 Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. B. Li, H. Li, L. Li, and J. Zhang. 2014. Lambda domain rate control algorithm for high efficiency video coding. IEEE Trans. Image Process 23 (Sep. 2014), 3841--3854. Google ScholarGoogle ScholarCross RefCross Ref
  27. C. Yan, Y. Zhang, J. Xu, F. Dai, J. Zhang, Q. Dai, and F. Wu. 2014. Efficient parallel framework for HEVC motion estimation on many-core processors. IEEE Trans. Circuits Syst. Video Technol. 24 (Dec. 2014), 2077--2089. DOI:http://dx.doi.org/10.1109/TCSVT.2014. 2335852Google ScholarGoogle ScholarCross RefCross Ref
  28. M. Zhou, H. M. Hu, and Y. Zhang. 2014. Region-based intra-frame rate-control scheme for high efficiency video coding. In Proceedings of the 2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). 1--4. Google ScholarGoogle ScholarCross RefCross Ref
  29. J. Si, S. Ma, X. Zhang, and W. Gao. 2012. Adaptive rate control for high efficiency video coding. In Visual Communications and Image Processing. 1--6. Google ScholarGoogle ScholarCross RefCross Ref
  30. S. Wang, S. Ma, S. Wang, D. Zhao, and W. Gao. 2013. Rate-COP based rate control for high efficiency video coding. IEEE J. Select. Topics Signal Process. 7 (Jul. 2013), 1101--1111. Google ScholarGoogle ScholarCross RefCross Ref
  31. S. Li, M. Xu, X. Deng, and Z. Wang. 2015. Weight-based r-λ rate control for perceptual HEVC coding on conversational videos. Signal Process. Image Commun. 38 (Oct. 2015), 127--140. DOI:http://dx.doi.org/10.1016/j.image.2015.04.011 Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. W. Lin, M. T. Sun, H. Li, Z. Chen, W. Li, and B. Zhou. 2012. Macroblock classification method for video applications involving motions. IEEE Trans. Broadcast. 58 (Mar. 2012), 34--46. DOI:http://dx.doi.org/10.1109/TBC.2011.2170611 Google ScholarGoogle ScholarCross RefCross Ref
  33. X. Wang and M. Karczewicz. 2013. Intra frame rate control based on SATD. In JCT-VC M0257. Incheon, 2013.Google ScholarGoogle Scholar
  34. Junjun Si, Siwei Ma, and Wen Gao. 2013. Efficient bit allocation and CTU level rate control for High Efficiency Video Coding. Picture Coding Symposium (PCS). 89--92. DOI:10.1109/PCS.2013.6737690 Google ScholarGoogle ScholarCross RefCross Ref
  35. Tiesong Zhao, Zhou Wang, and Sam Kwong. 2013. Flexible mode selection and complexity allocation in high efficiency video coding. IEEE J. Select. Topics Signal Process. 6 (Dec. 2013), 1135--1144. DOI:10.1109/JSTSP.2013.2271421 Google ScholarGoogle ScholarCross RefCross Ref
  36. Feng Cen, Qianli Lu, and Weisheng Xu. 2014. Efficient rate control for intra-frame coding in high efficiency video coding. In Proceedings of the International Conference on Signal Processing and Multimedia Applications. 54--59. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. J. Dong and N. Ling. 2009. A context-adaptive prediction scheme for parameter estimation in H.264/AVC macroblock layer rate control. IEEE Trans. Circuits Syst. Video Technol. 19 (Aug. 2009), 1108--1117. DOI:http://dx.doi.org/10.1109/TCSVT.2009.2020338 Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. HM Reference Software 16.0. 2014. Retrieved from http://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware.Google ScholarGoogle Scholar

Index Terms

  1. Complexity Correlation-Based CTU-Level Rate Control with Direction Selection for HEVC

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!