skip to main content
research-article

Predictive real-time perceptual compression based on eye-gaze-position analysis

Published:18 September 2008Publication History
Skip Abstract Section

Abstract

This article designs a real-time perceptual compression system (RTPCS) based on eye-gaze-position analysis. Our results indicate that the eye-gaze-position containment metric provides more efficient and effective evaluation of an RTPCS than the eye fixation containment. The presented RTPCS is designed for a network communication scenario with a feedback loop delay. The proposed RTPCS uses human visual system properties to compensate for the delay and to provide high ratios of multimedia compression.

References

  1. ASL. 2001. Eyenal (Eye-Analysis) software Manual Windows version for use with ASL Series 5000 and ETS-PC Eye Tracking Systems. Applied Science Group, Inc.Google ScholarGoogle Scholar
  2. Babcock, J. S., Pelz, J. B., and Fairchild, M. D. 2003. Eye tracking observers during color image evaluation tasks. In Proceedings of SPIE 5007, 218--230.Google ScholarGoogle Scholar
  3. Bergstrom, P. 2003. Eye movement controlled image coding. PhD dissertation. Electrical Engineering, Linkoping University, Linkoping, Sweden.Google ScholarGoogle Scholar
  4. Carmy, R. and Itti, L. 2006. Casual saliency effects during natural vision. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 1--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Cormen, T., Leiserson, C., and Rivest, R. 1990. Introduction to Algorithms. MIT Press/McGraw-Hill, Cambridge, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Daly, S. 1998. Engineering observations from spatiovelocity and spatiotemporal visual models. In Proceedings of SPIE 3299, 180--191.Google ScholarGoogle Scholar
  7. Daly, S., Matthews, K., and Ribas-Corbera, J. 2001. As plain as the noise on your face: Adaptive video compression using face detection and visual eccentricity models. J. Electron. Imag. 10, 1, 30--46.Google ScholarGoogle ScholarCross RefCross Ref
  8. Duchowski, A. T. 2000. Acuity-matching resolution degradation through wavelet coefficient scaling. IEEE Trans. Image Process. 9, 8, 1437--1440. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Duchowski, A. T. 2003. Eye Tracking Methodology: Theory and Practice. Springer-Verlag, London, U.K. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Duchowski, A. T. and McCormick, B. H. 1995. Preattentive considerations for gaze-contingent image processing. In Proceedings of SPIE 2411, 128--139.Google ScholarGoogle Scholar
  11. Duchowski, A. T. and Murphy, H. 2001. Gaze-contingent level of detail rendering. In Proceedings of EuroGraphics. EuroGraphics Association.Google ScholarGoogle Scholar
  12. Geisler, W. S. and Perry, J. S. 1998. Real-time foveated multiresolution system for low-bandwidth video communication. In Proceedings of SPIE 3299, 294--305.Google ScholarGoogle Scholar
  13. Irwin, D. 1992. Visual memory within and across fixations. In Eye Movements and Visual Cognition (Springer Series in Neuropsychology), K. Raymer, Ed. Springer-Verlag, New York, 146--165.Google ScholarGoogle Scholar
  14. Khan J. I., Yang, S. S., Patel, D., Komogortsev, O., Oh, W., Guo, Z., Gu, Q., and Mail, P. 2002. Resource adaptive netcentric systems on active network: A self-organizing video stream that automorphs itself while in transit via a quasi-active network. In Proceedings of the 2002 DARPA Active Networks Conference and Exposition (DANCE'02). IEEE Computer Society Press, Los Alamitos, CA, 409--426. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Khan, J. and Komogortsev, O. V. 2006. A hybrid scheme for perceptual object window design with joint scene analysis and eye-gaze tracking for media encoding based on perceptual attention. J. Electron. Imag. 15, 2, 023018-01--023018-12.Google ScholarGoogle ScholarCross RefCross Ref
  16. Komogortsev, O. 2007. Perceptual Test Video Set. Retrieved November 5, 2007, from http://www.cs.txstate.edu/~ok11/videosetpercept.htmGoogle ScholarGoogle Scholar
  17. Komogortsev, O. V. and Khan, J. 2006. Perceptual attention focus prediction for multiple viewers in case of multimedia perceptual compression with feedback delay. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 101--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Komogortsev, O. V. and Khan, J. 2004. Predictive perceptual compression for real time video communication. In Proceedings of the 12th ACM International conference on Multimedia (ACM MM 04). ACM, New York, 220--227. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Kortum, P. and Geisler, W. 1996. Implementation of a foveated image coding system for image bandwidth reduction. In Proceedings of SPIE 2657, 350--360.Google ScholarGoogle Scholar
  20. Kuyel, T., Geisler, W., and Ghosh, J. 1998. Retinally reconstructed images (RRIs): Digital images having a resolution match with the human eye. In Proceedings of SPIE 3299, 603--614.Google ScholarGoogle Scholar
  21. Lee, S., Pattichis, M., and Bovok, A. 2001. Foveated video compression with optimal rate control. IEEE Trans. Image Process., 10, 7, 977--992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Peters, R. and Itti, L., 2006. Computational mechanism for gaze direction in interactive visual environments. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 27--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Shebilske, W. L. and Fisher, D. F. 1983. Understanding extended discourse through the eyes: How and why. In Eye Movements and Psychological Functions: International Views, R. Groner, C. Menz, D. Fisher, and R. Monty, Eds. Lawrence Erlbaum Associates, Hillsdale, NJ, 303--314.Google ScholarGoogle Scholar
  24. Stelmach, L. B. and Tam, W. J. 1994. Processing image sequences based on eye movements. In Proceedings of SPIE 2179, 90--98.Google ScholarGoogle Scholar
  25. Tobii. 2006. Tobii Eye Tracker ClearView analysis software. User Manual. Tobii technology.Google ScholarGoogle Scholar
  26. Yanoff, M. and Durker, J. 1999. Ophthalmology. Mosby International Ltd.Google ScholarGoogle Scholar
  27. Yarbus, L. 1967. Eye movements and vision. Institute for Problems of Information Transmission Academy of Sciences of the USSR, Moscow, USSR.Google ScholarGoogle Scholar

Index Terms

  1. Predictive real-time perceptual compression based on eye-gaze-position analysis

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Multimedia Computing, Communications, and Applications
            ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 4, Issue 3
            August 2008
            136 pages
            ISSN:1551-6857
            EISSN:1551-6865
            DOI:10.1145/1386109
            Issue’s Table of Contents

            Copyright © 2008 ACM

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 18 September 2008
            • Accepted: 1 October 2007
            • Revised: 1 December 2006
            • Received: 1 August 2006
            Published in tomm Volume 4, Issue 3

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!