Abstract
For mobile multimedia systems, advances in battery technology have been much slower than those in memory, graphics, and processing power, making power consumption a major concern in mobile systems. The computational complexity of video codecs, which consists of CPU operations and memory accesses, is one of the main factors affecting power consumption. In this article, we propose a method that achieves near-optimal video quality while respecting user-defined bounds on the complexity needed to decode a video. We specifically focus on the motion compensation process, including motion vector prediction and interpolation, because it is the single largest component of computation-based power consumption. We start by formulating a scenario with a single receiver as a rate-distortion optimization problem and we develop an efficient decoder-complexity-aware video encoding method to solve it. Then we extend our approach to handle multiple heterogeneous receivers, each with a different complexity requirement. We test our method experimentally using the H.264 standard for the single receiver scenario and the H.264 SVC extension for the multiple receiver scenario. Our experimental results show that our method can achieve up to 97% of the optimal solution value in the single receiver scenario, and an average of 97% of the optimal solution value in the multiple receiver scenario. Furthermore, our tests with actual power measurements show a power saving of up to 23% at the decoder when the complexity threshold is halved in the encoder.
- J. C. Bean. 1987. Multiple choice knapsack functions. Tech. Rep. University of Michigan.Google Scholar
- F. Bellard and M. Niedermayer. 2012. FFmpeg. http://www.ffmpeg.org (last accessed 10/14).Google Scholar
- Y. Benmoussa, J. Boukhobza, E. Senn, and D. Benazzouz. 2013. Energy consumption modeling of H.264/AVC video decoding for GPP and DSP. In Proceedings of the Euromicro Conference on Digital System Design (DSD). IEEE, 890--897. Google Scholar
Digital Library
- K. E. Berger and F. Galea. 2013. An efficient parallelization strategy for dynamic programming on GPU. In Proceedings of the 27th International Parallel and Distributed Processing Symposium Workshops PhD Forum (IPDPSW). IEEE, 1797--1806. Google Scholar
Digital Library
- B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan, Y.-K. Wang, and T. Wiegand. 2013. High efficiency video coding (HEVC) text specification draft 10 (for FDIS and Final Call). JCT-VC Doc. JCTVC-L1003.Google Scholar
- J. A. Choi and Y. S. Ho. 2008. Deblocking filter algorithm with low complexity for H.264 video coding. In Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing (PCM'08). Springer-Verlag, Berlin, Heidelberg, 138--147. Google Scholar
Digital Library
- T. A. da Fonseca and R. L. de Queiroz. 2013. Energy-constrained real-time H.264/AVC video coding. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1739--1743.Google Scholar
Cross Ref
- D. Grois and O. Hadar. 2014. Complexity-aware adaptive pre-processing scheme for region-of-interest spatial scalable video coding. IEEE Trans. Circuits and Systems for Video Technology 24, 6, 1025--1039.Google Scholar
Cross Ref
- Y. He, M. Kunstner, S. Gudumasu, R. Eun-Seok, Y. Ye, and X. Xiu. 2013. Power aware HEVC streaming for mobile. In Proceedings of the Conference on Visual Communications and Image Processing (VCIP). IEEE, 1--5.Google Scholar
- D. S. Hirschberg. 1975. A linear space algorithm for computing maximal common subsequences. Commun. ACM 18, 6, 341--343. Google Scholar
Digital Library
- M. Horowitz, A. Joch, F. Kossentini, and A. Hallapuro. 2003. H.264/AVC baseline profile decoder complexity analysis. IEEE Trans. Circ. Syst. Video Tech. 13, 7, 704--716. Google Scholar
Digital Library
- M. Jamali Langroodi, J. Peters, and S. Shirmohammadi. 2013. Complexity aware encoding of the motion compensation process of the H.264/AVC video coding standard. In Proceedings of Network and Operating System Support on Digital Audio and Video Workshop (NOSSDAV'14). ACM, New York, Article 103, 6 pages. Google Scholar
Digital Library
- Joint Video Team. 2009. H.264/AVC reference software version JM 16.2. http://iphome.hhi.de/suehring/tml/. (last accessed 10/14).Google Scholar
- Joint Video Team. 2010. Advanced video coding for generic audiovisual services of ISO/IEC MPEG & ITU-T VCEG. ITU-T Rec. H.264 and ISO/IEC 14496-10 Advanced Video Coding, Edition 5.0 (incl. SVC extension).Google Scholar
- Joint Video Team. 2011. H.264/SVC reference software (JSVM 9.19) and manual. (2011). garcon.ient.rwth-aachen.de. (last accessed 10/14 from CVG Server).Google Scholar
- H. Jung and K. Ryoo. 2013. An intra prediction hardware architecture with low computational complexity for HEVC decoder. In Future Information Communication Technology and Applications, Springer, 549--557.Google Scholar
- S. W. Lee and C.-C. J. Kuo. 2010. Complexity modeling of spatial and temporal compensations in H.264/AVC decoding. IEEE Trans. Circ. Syst. Video Tech. 20, 5, 706--720. Google Scholar
Digital Library
- S. W. Lee and C.-C. J. Kuo. 2011. H.264/AVC entropy decoder complexity analysis and its applications. J. Vis. Commun. Image Represent. 22, 1, 61--72. Google Scholar
Digital Library
- Y. Lee, J. Kim, and C. M. Kyung. 2012. Energy-aware video encoding for image quality improvement in battery-operated surveillance camera. IEEE Trans. VLSI Syst. 20, 2, 310--318. Google Scholar
Digital Library
- Z. Ma, H. Hu, and Y. Wang. 2011. On complexity modeling of H.264/AVC video decoding and its application for energy efficient decoding. IEEE Trans. Multimed. 13, 6, 1240--1255. Google Scholar
Digital Library
- K. Nibbelink, S. Rajopadhye, and R. McConnell. 2007. 0/1 knapsack on hardware: A complete solution. In Proceedings of the International Conference on Application-Specific Systems, Architectures, and Processors. IEEE, 160--167.Google Scholar
- Qualcomm. 2014. Trepn Profiler. https://developer.qualcomm.com/mobile-development/increase-app-performance/trepn-profiler (last accessed 7/14).Google Scholar
- I. E. Richardson. 2004. H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia. John Wiley & Sons, Inc.Google Scholar
- A. Rodriguez, A. Gonzalez, and M. P. Malumbres. 2006. Hierarchical parallelization of an H.264/AVC video encoder. In Proceedings of the 6th International Symposium on Parallel Computing in Electrical Engineering. IEEE, 363--368. Google Scholar
Digital Library
- S. Sankaraiah, H. S. Lam, C. Eswaran, and J. Abdullah. 2011. GOP level parallelism on H.264 video encoder for multicore architecture. In Proceedings of the International Conference on Circuits, System and Simulation (IPCSIT). Vol. 7, IACSIT Press, 127--132.Google Scholar
- H. Schwarz, D. Marpe, and T. Wiegand. 2007. Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17, 9, 1103--1120. Google Scholar
Digital Library
- M. Semsarzadeh, M. Jamali Langroodi, M. R. Hashemi, and S. Shirmohammadi. 2012. Complexity modeling of the motion compensation process of the H.264/AVC video coding standard. In Proceedings of the International Conference on Multimedia and Expo (ICME). IEEE, 925--930. Google Scholar
Digital Library
- M. Viitanen, J. Vanne, T. D. Hamalainen, M. Gabbouj, and J. Lainema. 2012. Complexity analysis of next-generation HEVC decoder. In Proceedings of the International Symposium on Circuits and Systems (ISCAS). IEEE, 882--885.Google Scholar
- Y. Wang, W. Zhang, Z. Zhang, and P. An. 2013. A low complexity deblocking filtering for multiview video coding. IEEE Trans. Consum. Electron. 59, 3, 666--671.Google Scholar
Cross Ref
- T. Wiegand, G. Sullivan, J. Reichel, H. Schwarz, and M. Wien. 2007. Joint draft 10 of SVC amendment. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG Doc. JVT-W201.Google Scholar
- H. K. Zrida, A. Jemai, A. C. Ammari, and M. Abid. 2009. High level H.264/AVC video encoder parallelization for multiprocessor implementation. In Proceedings of the Design, Automation and Test in Europe Conference and Exhibition. IEEE, 940--945. Google Scholar
Digital Library
Index Terms
Decoder-Complexity-Aware Encoding of Motion Compensation for Multiple Heterogeneous Receivers
Recommendations
Complexity Aware Encoding of the Motion Compensation Process of the H.264/AVC Video Coding Standard
NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video WorkshopAdvances in battery technology have not kept pace with other recent advances in mobile multimedia systems with the result that power consumption is a major concern. The computational complexity of video codecs, which consists of CPU operations and ...
Complexity Aware Encoding of the Motion Compensation Process of the H.264/AVC Video Coding Standard
NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video WorkshopAdvances in battery technology have not kept pace with other recent advances in mobile multimedia systems with the result that power consumption is a major concern. The computational complexity of video codecs, which consists of CPU operations and ...
Complexity Modeling of the Motion Compensation Process of the H.264/AVC Video Coding Standard
ICME '12: Proceedings of the 2012 IEEE International Conference on Multimedia and ExpoWith recent advances in computing and communication technologies, ubiquitous access to high quality multimedia content such as high definition video using smart phones, Net books, or tablets is a fact of our daily life. However, power is still a major ...






Comments