Compressed domain spatial adaptation for H.264 video

ABSTRACT

In this paper, we present a metadata-based compressed-domain spatial adaptation scheme for H.264/AVC video. We have enhanced the H.264/AVC encoder with our proposed adaptation strategies in order to reduce video size by cropping individual frames in an intermediary node prior to transmitting that video to heterogeneous devices. In this regard, we exploit the sliced architecture of the video frames within the first version of the H.264/AVC specification and devise different slicing strategies. The compressed-domain bitstream modification is performed at the intermediary nodes, avoiding the need for any cascaded operations. Here, we briefly present our adaptation scheme as well as evaluation results showing the effectiveness of the slicing strategies on the bitrate reduction and processing time. A comparison of our approach with an existing cropping scheme is also presented.

References

1. ISO/IEC 21000-7:2004, Information Technology -- Multimedia Framework -- Part 7: Digital Item Adaptation.
2. R. Iqbal, S. Shirmohammadi, A. El Saddik, J. Zhao, "Compressed domain video processing for adaptation, encryption, and authentication", IEEE MultiMedia, Vol.15, pp. 38--50, 2008.
3. C. Gomila, P. Yin, "New features and applications of the H.264 video coding standard", In Proc. of Intl. Conf. on Info. Tech.: Research and Education, pp. 6 -- 10, 2003.
4. P. Zhang, Y. Lu, Q. Huang, W. Gao, "Mode mapping method for H.264/AVC spatial downscaling transcoding", In Proc. of IEEE ICIP, 2004.
5. J. Cock, S. Notebaert, K. Vermeirsch, P. Lambert, R. Walle, "Efficient Spatial Resolution Reduction Transcoding for H.264/AVC", In Proc. of IEEE ICIP, 2008.
6. Y. Wang, X. Fan, H. Li, Z. Liu, M. Li, "An Attention Based Spatial Adaptation Scheme for H.264 Videos on Mobiles", In Proc. of Multi-Media Modeling Conference, 2006.
7. H. K. Arachchi, S. Dogan, H. Uzuner, A. M. Kondoz, "Utilizing Macroblock SKIP Mode Information to Accelerate Cropping of an H.264/AVC Encoded Video Sequence for User Centric Content Adaptation", In Proc. of Intl. Conf. on Automated Production of Cross Media Content for Multi-Channel Distribution, 2007.
8. Recommendation ITU-T H.264: Advanced Video Coding for Generic Audiovisual Services", International Telecommunication Union, ITU-T, 2003.
9. {online}. http://www.videolan.org/developers/x264.html
10. {online}. http://www.w3.org/TR/xslt

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Video segmentation

      • Computer vision tasks

        • Video summarization

      • Image and video acquisition