Abstract
Rate control is a crucial consideration in high-efficiency video coding (HEVC). The estimation of model parameters is very important for coding tree unit (CTU)-level rate control, as it will significantly affect bit allocation and thus coding performance. However, the model parameters in the CTU-level rate control sometimes fails because of inadequate consideration of the correlation between model parameters and complexity characteristic. In this study, we establish a novel complexity correlation-based CTU-level rate control for HEVC. First, we formulate the model parameter estimation scheme as a multivariable estimation problem; second, based on the complexity correlation of the neighbouring CTU, an optimal direction is selected in five directions for reference CTU set selection during model parameter estimation to further improve the prediction accuracy of the complexity of the current CTU. Third, to improve their precision, the relationship between the model parameters and the complexity of the reference CTU set in the optimal direction is established by using least square method (LS), and the model parameters are solved via the estimated complexity of the current CTU. Experimental results show that the proposed algorithm can significantly improve the accuracy of the CTU-level rate control and thus the coding performance; the proposed scheme consistently outperforms HM 16.0 and other state-of-the-art algorithms in a variety of testing configurations. More specifically, up to 8.4% and on average 6.4% BD-Rate reduction is achieved compared to HM 16.0 and up to 4.7% and an average of 3.4% BD-Rate reduction is achieved compared to other algorithms, with only a slight complexity overhead.
- B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan and T. Wiegand. 2012. High efficiency video coding (HEVC) text specification draft 8. In JCTVCH1004, 8th JCTVC Meeing.Google Scholar
- G. J. Sullivan, J. R. Ohm, W. J. Han, and T. Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22 (Dec. 2012), 1649--1668. DOI:http://dx.doi.org/10.1109/TCSVT.2012.2221191 Google Scholar
Digital Library
- H. Mansour, P. Nasiopoulos, and V. Krishnamurthy. 2011. Rate and distortion modeling of CGS coded scalable video content. IEEE Trans. Multimedia 13 (Apr. 2011), 165--180. DOI:http://dx.doi.org/10.1109/TMM.2010.2099648 Google Scholar
Digital Library
- B. Yan and M. Wang. 2009. Adaptive distortion-based intra-rate estimation for H.264/AVC rate control. IEEE Signal Process. Lett. 16 (Mar. 2009), 145--148. DOI:http://dx.doi.org/10.1109/LSP.2008.2010813 Google Scholar
Cross Ref
- F. Shao, G. Jiang, W. Lin, M. Yu, and Q. Dai. 2013. Joint bit allocation and rate control for coding multi-view video plus depth based 3D video. IEEE Trans. Multimedia 15 (Dec. 2013), 1843--1854. DOI:http://dx.doi.org/10.1109/TMM.2013.2269897 Google Scholar
Digital Library
- X. Jing, L. P. Chau, and W. C. Siu. 2008. Frame complexity-based rate-quantization model for H.264/AVC intraframe rate control. IEEE Signal Process. Lett. 15 (Mar. 2008), 373--376. DOI:http://dx.doi.org/10.1109/LSP.2008.920010 Google Scholar
Cross Ref
- Z. Wang, J. Ming, and B. Fan. 2008. Fast best neighborhood matching algorithm for intra block error concealment in H.264/AVC. In Congress on Image and Signal Processing. 559--563.Google Scholar
- W. Lin, M. T. Sun, R. Poovendran, and Z. Zhang. 2008. Activity recognition using a combination of category components and local models for video surveillance. IEEE Trans. Circuits Syst. Video Technol. 18 (Aug. 2008), 1128--1139. DOI:http://dx.doi.org/10.1109/TCSVT.2008.927111 Google Scholar
Digital Library
- Z. He and D. O. Wu. 2008. Linear rate control and optimum statistical multiplexing for H.264 video broadcast. IEEE Trans. Multimedia 10 (Nov. 2008), 1237--1249. DOI:http://dx.doi.org/10.1109/TMM.2008.2004903 Google Scholar
Digital Library
- Y. Liu, Z. G. Li, and Y. C. Soh. 2006. Adaptive mad prediction and refined R-Q model for H.264/AVC rate control. In IEEE International Conference on Acoustics Speech and Signal Processing Proceedings. Toulouse, 905--908. Google Scholar
Cross Ref
- Z. G. Li, W. Gao, F. Pan, S. W. Ma, K. P. Lim, G. N. Feng, X. Lin, S. Rahardja, H. Q. Lu, and Y. Lu. 2006. Adaptive rate control for H.264. J. Vis. Commun. Image Represent. 17 (Apr. 2006), 376--406. DOI:http://dx.doi.org/10.1016/j.jvcir.2005.04.004 Google Scholar
Cross Ref
- H. Choi, J. Nam, J. Yoo, D. Sim, and I. V. Bajić. 2012. Rate control based on unified RQ model for HEVC. In Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IECJTC1/SC29/WG118th Meeting.CA,San Jos, Feb.1--10.Google Scholar
- X. Liang, Q. Wang, Y. Zhou, B. Luo, and A. Men. 2013. A novel R-Q model based rate control scheme in HEVC. In Visual Communications and Image Processing (VCIP). 1--6. Google Scholar
Cross Ref
- B. Li, H. Li, L. Li, and J. Zhang. 2013. Rate control by R-lambda model for HEVC. In ITU-T SG16 Contribution, JCTVC-K0103. 1--5.Google Scholar
- M. Zhou, B. Li, and Y. Zhang. 2016. Content-adaptive parameters estimation for multi-dimensional rate control. J. Vis. Commun. Image Represent. 34 (Jan. 2016), 204--218. DOI:http://dx.doi.org/10.1016/j.jvcir.2015.11.011 Google Scholar
Digital Library
- S. Li, M. Xu, Z. Wang, and X. Sun. 2016. Optimal bit allocation for CTU level rate control in HEVC. IEEE Trans. Circuits Syst. Video Technol. (Jul. 2016), 1. DOI:http://dx.doi.org/10.1109/TCSVT.2016.2589878 Google Scholar
Cross Ref
- M. Wang, K. N. Ngan, and H. Li. 2016. Low-delay rate control for consistent quality using distortion-based lagrange multiplier. IEEE Trans. Image Process. 25 (Apr. 2016), 2943--2955. DOI:http://dx.doi.org/10.1109/tip.2016.2552646 Google Scholar
Digital Library
- D. Zhao, Y. Zhou, D. Wang, and J. Mao. 2011. Effective macroblock layer rate control algorithm for H.264/AVC. Comput. Electr. Eng. 37 (Jul. 2011), 550--558. DOI:http://dx.doi.org/10.1016/j.compeleceng.2011.04.009 Google Scholar
Digital Library
- P. Wang, Y. Zhang, H.-M. Hu, and B. Li. 2013. Region-classification-based rate control for flicker suppression of i-frames in HEVC. In IEEE International Conference on Image Processing. Melbourne, Australia, 15--18. Google Scholar
Cross Ref
- Y. Liu, Q. Huang, S. Ma, D. Zhao, W. GAO, S. Ci, and H. Tang. 2011. A novel rate control technique for multiview video plus depth based 3D video coding. IEEE Trans. Broadcast. 57 (Jun. 2011), 562--571. DOI:http://dx.doi.org/10.1109/TBC.2011.2105652 Google Scholar
Cross Ref
- B. Lee, M. Kim, and T. Q. Nguyen. 2014. A frame-level rate control scheme based on texture and nontexture rate models for high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 24 (Mar. 2014), 465--479. DOI:http://dx.doi.org/10.1109/TCSVT.2013.2276880 Google Scholar
Digital Library
- Y. Chang and M. Kim. 2013. A joint rate control scheme in a hybrid stereoscopic video codec system for 3DTV broadcasting. IEEE Trans. Broadcast. 59 (Jun. 2013), 265--280. DOI:http://dx.doi.org/10.1109/TBC.2013.2240731 Google Scholar
Cross Ref
- M. Wang, K. N. Ngan, and H. Li. 2015. An efficient frame-content based intra frame rate control for high efficiency video coding. IEEE Signal Process. Lett. 22 (Jul. 2015), 896--900. DOI:http://dx.doi.org/10.1109/LSP.2014.2377032 Google Scholar
Cross Ref
- Y. Liu, Z. G. Li, and Y. C. Soh. 2008. Region-of-interest based resource allocation for conversational video communication of H.264/AVC. IEEE Trans. Circuits Syst. Video Technol. 18 (Jan. 2008), 134--139. DOI:http://dx.doi.org/10.1109/TCSVT.2007.913754 Google Scholar
Digital Library
- J. Liu, Y. Cho, Z. Guo, and J. Kuo. 2010. Bit allocation for spatial scalability coding of H.264/SVC with dependent rate-distortion analysis. IEEE Trans. Circuits Syst. Video Technol. 20 (Jul. 2010), 967--981. DOI:http://dx.doi.org/10.1109/TCSVT.2010.2045924 Google Scholar
Digital Library
- B. Li, H. Li, L. Li, and J. Zhang. 2014. Lambda domain rate control algorithm for high efficiency video coding. IEEE Trans. Image Process 23 (Sep. 2014), 3841--3854. Google Scholar
Cross Ref
- C. Yan, Y. Zhang, J. Xu, F. Dai, J. Zhang, Q. Dai, and F. Wu. 2014. Efficient parallel framework for HEVC motion estimation on many-core processors. IEEE Trans. Circuits Syst. Video Technol. 24 (Dec. 2014), 2077--2089. DOI:http://dx.doi.org/10.1109/TCSVT.2014. 2335852Google Scholar
Cross Ref
- M. Zhou, H. M. Hu, and Y. Zhang. 2014. Region-based intra-frame rate-control scheme for high efficiency video coding. In Proceedings of the 2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). 1--4. Google Scholar
Cross Ref
- J. Si, S. Ma, X. Zhang, and W. Gao. 2012. Adaptive rate control for high efficiency video coding. In Visual Communications and Image Processing. 1--6. Google Scholar
Cross Ref
- S. Wang, S. Ma, S. Wang, D. Zhao, and W. Gao. 2013. Rate-COP based rate control for high efficiency video coding. IEEE J. Select. Topics Signal Process. 7 (Jul. 2013), 1101--1111. Google Scholar
Cross Ref
- S. Li, M. Xu, X. Deng, and Z. Wang. 2015. Weight-based r-λ rate control for perceptual HEVC coding on conversational videos. Signal Process. Image Commun. 38 (Oct. 2015), 127--140. DOI:http://dx.doi.org/10.1016/j.image.2015.04.011 Google Scholar
Digital Library
- W. Lin, M. T. Sun, H. Li, Z. Chen, W. Li, and B. Zhou. 2012. Macroblock classification method for video applications involving motions. IEEE Trans. Broadcast. 58 (Mar. 2012), 34--46. DOI:http://dx.doi.org/10.1109/TBC.2011.2170611 Google Scholar
Cross Ref
- X. Wang and M. Karczewicz. 2013. Intra frame rate control based on SATD. In JCT-VC M0257. Incheon, 2013.Google Scholar
- Junjun Si, Siwei Ma, and Wen Gao. 2013. Efficient bit allocation and CTU level rate control for High Efficiency Video Coding. Picture Coding Symposium (PCS). 89--92. DOI:10.1109/PCS.2013.6737690 Google Scholar
Cross Ref
- Tiesong Zhao, Zhou Wang, and Sam Kwong. 2013. Flexible mode selection and complexity allocation in high efficiency video coding. IEEE J. Select. Topics Signal Process. 6 (Dec. 2013), 1135--1144. DOI:10.1109/JSTSP.2013.2271421 Google Scholar
Cross Ref
- Feng Cen, Qianli Lu, and Weisheng Xu. 2014. Efficient rate control for intra-frame coding in high efficiency video coding. In Proceedings of the International Conference on Signal Processing and Multimedia Applications. 54--59. Google Scholar
Digital Library
- J. Dong and N. Ling. 2009. A context-adaptive prediction scheme for parameter estimation in H.264/AVC macroblock layer rate control. IEEE Trans. Circuits Syst. Video Technol. 19 (Aug. 2009), 1108--1117. DOI:http://dx.doi.org/10.1109/TCSVT.2009.2020338 Google Scholar
Digital Library
- HM Reference Software 16.0. 2014. Retrieved from http://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware.Google Scholar
Index Terms
Complexity Correlation-Based CTU-Level Rate Control with Direction Selection for HEVC
Recommendations
R-Lambda model based CTU-level rate control for intra frames in HEVC
In High Efficiency Video Coding (HEVC), the coding efficiency of intra frames is much lower than inter frames. If the bits allocated to intra frames are not sufficient to improve their quality, the quality fluctuation between intra frames and their ...
Optimal CTU-level bit allocation in HEVC for low bit-rate applications
AbstractThe coding efficiency of High Efficiency Video Coding (HEVC) outperforms all the past video coding standards. But for low bit-rate video applications, fewer bits cannot guarantee the reconstructed quality of each coding frame. Rate control is used ...
Low-Complexity Rate-Distortion Optimization Algorithms for HEVC Intra Prediction
MMM 2014: Proceedings of the 20th Anniversary International Conference on MultiMedia Modeling - Volume 8325HEVC achieves a better coding efficiency relative to prior standards, but also involves dramatically increased complexity. The complexity increase for intra prediction is especially intensive due to a highly flexible quad-tree coding structure and a ...






Comments