Abstract
This article designs a real-time perceptual compression system (RTPCS) based on eye-gaze-position analysis. Our results indicate that the eye-gaze-position containment metric provides more efficient and effective evaluation of an RTPCS than the eye fixation containment. The presented RTPCS is designed for a network communication scenario with a feedback loop delay. The proposed RTPCS uses human visual system properties to compensate for the delay and to provide high ratios of multimedia compression.
- ASL. 2001. Eyenal (Eye-Analysis) software Manual Windows version for use with ASL Series 5000 and ETS-PC Eye Tracking Systems. Applied Science Group, Inc.Google Scholar
- Babcock, J. S., Pelz, J. B., and Fairchild, M. D. 2003. Eye tracking observers during color image evaluation tasks. In Proceedings of SPIE 5007, 218--230.Google Scholar
- Bergstrom, P. 2003. Eye movement controlled image coding. PhD dissertation. Electrical Engineering, Linkoping University, Linkoping, Sweden.Google Scholar
- Carmy, R. and Itti, L. 2006. Casual saliency effects during natural vision. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 1--18. Google Scholar
Digital Library
- Cormen, T., Leiserson, C., and Rivest, R. 1990. Introduction to Algorithms. MIT Press/McGraw-Hill, Cambridge, MA. Google Scholar
Digital Library
- Daly, S. 1998. Engineering observations from spatiovelocity and spatiotemporal visual models. In Proceedings of SPIE 3299, 180--191.Google Scholar
- Daly, S., Matthews, K., and Ribas-Corbera, J. 2001. As plain as the noise on your face: Adaptive video compression using face detection and visual eccentricity models. J. Electron. Imag. 10, 1, 30--46.Google Scholar
Cross Ref
- Duchowski, A. T. 2000. Acuity-matching resolution degradation through wavelet coefficient scaling. IEEE Trans. Image Process. 9, 8, 1437--1440. Google Scholar
Digital Library
- Duchowski, A. T. 2003. Eye Tracking Methodology: Theory and Practice. Springer-Verlag, London, U.K. Google Scholar
Digital Library
- Duchowski, A. T. and McCormick, B. H. 1995. Preattentive considerations for gaze-contingent image processing. In Proceedings of SPIE 2411, 128--139.Google Scholar
- Duchowski, A. T. and Murphy, H. 2001. Gaze-contingent level of detail rendering. In Proceedings of EuroGraphics. EuroGraphics Association.Google Scholar
- Geisler, W. S. and Perry, J. S. 1998. Real-time foveated multiresolution system for low-bandwidth video communication. In Proceedings of SPIE 3299, 294--305.Google Scholar
- Irwin, D. 1992. Visual memory within and across fixations. In Eye Movements and Visual Cognition (Springer Series in Neuropsychology), K. Raymer, Ed. Springer-Verlag, New York, 146--165.Google Scholar
- Khan J. I., Yang, S. S., Patel, D., Komogortsev, O., Oh, W., Guo, Z., Gu, Q., and Mail, P. 2002. Resource adaptive netcentric systems on active network: A self-organizing video stream that automorphs itself while in transit via a quasi-active network. In Proceedings of the 2002 DARPA Active Networks Conference and Exposition (DANCE'02). IEEE Computer Society Press, Los Alamitos, CA, 409--426. Google Scholar
Digital Library
- Khan, J. and Komogortsev, O. V. 2006. A hybrid scheme for perceptual object window design with joint scene analysis and eye-gaze tracking for media encoding based on perceptual attention. J. Electron. Imag. 15, 2, 023018-01--023018-12.Google Scholar
Cross Ref
- Komogortsev, O. 2007. Perceptual Test Video Set. Retrieved November 5, 2007, from http://www.cs.txstate.edu/~ok11/videosetpercept.htmGoogle Scholar
- Komogortsev, O. V. and Khan, J. 2006. Perceptual attention focus prediction for multiple viewers in case of multimedia perceptual compression with feedback delay. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 101--108. Google Scholar
Digital Library
- Komogortsev, O. V. and Khan, J. 2004. Predictive perceptual compression for real time video communication. In Proceedings of the 12th ACM International conference on Multimedia (ACM MM 04). ACM, New York, 220--227. Google Scholar
Digital Library
- Kortum, P. and Geisler, W. 1996. Implementation of a foveated image coding system for image bandwidth reduction. In Proceedings of SPIE 2657, 350--360.Google Scholar
- Kuyel, T., Geisler, W., and Ghosh, J. 1998. Retinally reconstructed images (RRIs): Digital images having a resolution match with the human eye. In Proceedings of SPIE 3299, 603--614.Google Scholar
- Lee, S., Pattichis, M., and Bovok, A. 2001. Foveated video compression with optimal rate control. IEEE Trans. Image Process., 10, 7, 977--992. Google Scholar
Digital Library
- Peters, R. and Itti, L., 2006. Computational mechanism for gaze direction in interactive visual environments. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 27--32. Google Scholar
Digital Library
- Shebilske, W. L. and Fisher, D. F. 1983. Understanding extended discourse through the eyes: How and why. In Eye Movements and Psychological Functions: International Views, R. Groner, C. Menz, D. Fisher, and R. Monty, Eds. Lawrence Erlbaum Associates, Hillsdale, NJ, 303--314.Google Scholar
- Stelmach, L. B. and Tam, W. J. 1994. Processing image sequences based on eye movements. In Proceedings of SPIE 2179, 90--98.Google Scholar
- Tobii. 2006. Tobii Eye Tracker ClearView analysis software. User Manual. Tobii technology.Google Scholar
- Yanoff, M. and Durker, J. 1999. Ophthalmology. Mosby International Ltd.Google Scholar
- Yarbus, L. 1967. Eye movements and vision. Institute for Problems of Information Transmission Academy of Sciences of the USSR, Moscow, USSR.Google Scholar
Index Terms
Predictive real-time perceptual compression based on eye-gaze-position analysis
Recommendations
Predictive perceptual compression for real time video communication
MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on MultimediaApproximately 2 degrees in our 140 degree vision span has sharp vision. Many researchers have been fascinated by the idea of eye-tracking integrated perceptual compression of an image or video, yet any practical system has yet to emerge. The unique ...
Perceptual sensitivity-based rate control method for high efficiency video coding
The newest video coding standard--high efficiency video coding (HEVC) optimizes its coding efficiency in terms of sum of square error (SSE), which does not fully consider the perceptual characteristic of the input video. Thus, the HEVC is not effective ...
Depth perceptual region-of-interest based multiview video coding
MultiView Video (MVV) has attracted considerable attention recently since it is capable of providing users with three-dimensional perception and interactive functionalities. However, these MVV data require large mount of storage and bandwidth in network ...






Comments