skip to main content
research-article

Supporting region-of-interest cropping through constrained compression

Published:02 September 2011Publication History
Skip Abstract Section

Abstract

The ability to create super high-resolution video is becoming relative easy to do either through a single high-definition video camera or panoramic video that automatically stitches multiple views together. As an example of the former, the motion picture industry now has 6000 × 4000 pixel full-rate video cameras available. This means that supporting region-of-interest cropping will become more important in the future. In this article, we propose a mechanism to support region-of-interest adaptation of stored video. The proposed approach creates a compression-compliant stream (e.g., MPEG-2), while still allowing it to be cropped. Fortunately, video standards like MPEG-2 specify the format of a compliant stream, and not the algorithm to get there. As a result, there is an opportunity to allow system researchers and implementers ways to optimize for applications. We show various fundamental tradeoffs that are made in order to support region-of-interest cropping with super high-resolution video which we received from a local motion-picture firm.

References

  1. Agarwal A., Feng, Wu-chi, and Wolfe, C. 2000. A multi-differential video coding algorithm for robust video conferencing. In Proceedings of the SPIE Voice, Video, and Data Communications Conference.Google ScholarGoogle Scholar
  2. Ahmad, I., Wei, X., and Sun, Y. 2005. Video transcoding: an overview of various techniques and research issues. IEEE Trans. Multimedia 7, 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Augustine, J., Rao, S. K., Jouppi, N., and Iyer, S. 2004. Region of interest editing of MPEG-2 video streams in the compressed domain. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE, Los Alamitos, CA, 559--562.Google ScholarGoogle Scholar
  4. Bae, T. M., Thang, T. C., Kim, D. Y., Ro, Y. M., Kang, J. W., and Kim, J. G. 2006. Multiple region-of-interest support in scalable video coding. ETRI J. 28, 2, 239--242.Google ScholarGoogle ScholarCross RefCross Ref
  5. Dugad, R. and Ahuja, N. 2003. A scheme for spatial scalability using nonscalable encoders. IEEE Trans. Circuits Syst. Video Technol. 13, 10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. El-Alfy, H., Jacobs, J., and Davis, L. 2007. Multi-scale video cropping. In Proceedings of the ACM Multimedia. ACM, New York, 97--106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Fan, X., Xie, X., Zhou, H. Q., and Ma, W. Y. 2003. Looking into video frames on small displays. In Proceedings of the ACM Multimedia. ACM, New York, 247--250. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Feng, W., Dang, T., Kassebaum, J., and Bauman, T. 2008. Supporting region-of-interest cropping through constrained compression. In Proceedings of the ACM Multimedia. ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Haskell, B., Puri, A., and Netravali, A. 1996. Digital Video Compression Standard: An Introduction to MPEG-2. Chapman & Hall. http://ffmpeg.mplayerhq.hu.Google ScholarGoogle Scholar
  10. Huang, J., Feng, W., and Walpole, J. 2006. An experimental analysis of DCT-based approaches for fine-grained multiresolution video. ACM Multimedia Syst. J. 11, 6, 513--531.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Lambert, P., De Schrijver, D., Van Deursen, D., De Neve., W., Dhondt, Y., and Van de Walle, R. 2006. A real-time content adaptation framework for exploiting ROI scalability in H.264/AVC. In Advanced Concepts for Intelligent Vision Systems, vol. 4179, 442--453. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Le Gall, D. 1991. MPEG: A video compression standard for multimedia applications. Comm. ACM 34, 4, 46--58. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Lin, C. W., Chen, Y. C., and Sun, M. T. 2003. Dynamic region of interest transcoding for multipoint video conferencing. IEEE Trans. Circuits Syst. Video Technol. 13, 10, 982--992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Mavlankar, A., Baccichet, P., Varodayan, D., and Girod, B. 2007. Optimal slice size for streaming regions of high resolution video with virtual pan/tilt/zoom functionality. In Proceedings of the 15th European Signal Processing Conference (EUSIPCO).Google ScholarGoogle Scholar
  15. Rehan, M. and Agathokilis, P. 2007. Frame accurate video cropping in compressed MPEG domain. In Proceedings of the IEEE Pacific Rim Conference on Communications, Computers, and Signal Processing. IEEE, Los Alamitos, CA, 573--576.Google ScholarGoogle Scholar
  16. Sinha, A., Agarwal, G., and Anbu, A. 2004. Region-of-interest based compressed domain video transcoding. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. vol. 3, IEEE, Los Alamitos, CA, 161--164.Google ScholarGoogle Scholar
  17. Sun, X., Foote, J., Kimber, D., and Manjunath, B. S. 2005. Region of interest extraction and virtual camera control based on panoramic video capturing. IEEE Trans. Multimedia 7, 5, 981--990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Wang, H., El-Maleh, K., and Liang, Y. J. 2006. Real-time region-of-interest video coding using content-adaptive background skipping with dynamic bit reallocation. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. IEEE, Los Alamitos, CA.Google ScholarGoogle Scholar

Index Terms

  1. Supporting region-of-interest cropping through constrained compression

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Multimedia Computing, Communications, and Applications
        ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 7, Issue 3
        August 2011
        117 pages
        ISSN:1551-6857
        EISSN:1551-6865
        DOI:10.1145/2000486
        Issue’s Table of Contents

        Copyright © 2011 ACM

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 2 September 2011
        • Accepted: 1 March 2010
        • Revised: 1 February 2010
        • Received: 1 September 2009
        Published in tomm Volume 7, Issue 3

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!