Abstract
Eye movements can be used to infer the allocation of covert attention. In this article, we propose to model the allocation of attention in a task-dependent manner based on different eye movement conditions, specifically fixation and pursuit. We show that the image complexity at eye fixation points during fixation, and the pursuit direction during pursuit are significant factors in attention allocation. Results of the study are applied to the design of an interactive computer game. Real-time eye movement information is taken as one of inputs for the game. The utility of such eye information for controlling game difficulty is shown.
- Dye, M. and Bavelier, D. 2004. Playing video games enhances visual attention in children. J. Vis. 4, 11, Abstract 40, 40a.Google Scholar
Cross Ref
- Felzenszwalb, P. and Huttenlocher, D. 2004. Efficient graph-based images segmentation. Internat. J. Comput. Vis. 59, 2 (Sept), 167--181. Google Scholar
Digital Library
- Green, C. and Bavelier, D. 2003. Action video game modifies visual selective attention. Nature 423, 534--537.Google Scholar
Cross Ref
- Green, C. and Bavelier, D. 2007. Action-video-game experience alters the spatial resolution of vision. Psychol. Sci. 18, 1, 88--94.Google Scholar
Cross Ref
- Guo, K., Mahmoodi, S., Robertson, R., and Young, M. 2006. Longer fixation duration while viewing face images. Exp. Brain Res. 171, 1, 91--98.Google Scholar
Cross Ref
- Henderson, J. and Hollingworth, A. 1998. Eye movements during scene viewing: an overview. In Eye Guidance in Reading and Scene Perception, G. Underwood, Ed. 269--283.Google Scholar
- Henderson, J., Weeks, P., and Hollingworth, A. 1999. The effects of semantic consistency on eye movements during complex scene viewing. J. Exp. Psychol.: Hum. Perc. Perf. 25, 210--228.Google Scholar
Cross Ref
- Itti, L. and Koch, C. 2000. A saliency-based search mechanism for overt and covert shift of visual attention. Vision Res. 40, 10--12, 1489--1506.Google Scholar
Cross Ref
- Jie, L. and Clark, J. 2005. Microsaccadic eye movements during ocular pursuit. Vision Sciences Society Annual Meeting (VSS) 5, 8, Abstract, 697a.Google Scholar
- Kayser, C., Nielsen, K., and Logothetis, N. 2006. Fixations in natural scenes: interaction of image structure and image content. Vision Res. 46, 16, 2535--2545.Google Scholar
Cross Ref
- Land, M. and Hayhoe, M. 2001. In what ways do eye movements contribute to everyday activities? Vision Res. 41, 3559--3565.Google Scholar
- Loftus, G. 1985. Picture perception: effects of luminance on available information and information-extraction rate. J. Exp. Psychol. Gen 114, 3, 342--356.Google Scholar
Cross Ref
- Loftus, G., Kaufman, L., Nishimoto, T., and Ruthruff, E. 1992. Effects of visual degradation on eye-fixation durations, perceptual processing, and long-term visual memory. In Eye Movements and Visual Cognition: Scene Perception and Reading, K. Reyner, Ed. 203--226.Google Scholar
- Mannan, S., Ruddock, K., and Wooding, D. 1996. The relationship between the locations of spatial features and those fixations made during visual examination of briefly presented images. Spatial Vision 10, 3, 165--188.Google Scholar
Cross Ref
- Mannan, S., Ruddock, K., and Wooding, D. 1997. Fixation sequences made during visual examination of briefly presented 2d images. Spatial Vision 11, 2, 157--178.Google Scholar
Cross Ref
- Oliva, A., Torralba, A., Castelhano, M., and Henderson, J. 2003. Top-down control of visual attention in object detection. In Proceedings of the IEEE International Conference on Image Processing. IEEE Computer Society Press, Los Alamitos, CA, 253--256.Google Scholar
- Parkhurst, D. and Niebur, E. 2003. Scene content selected by active vision. Spatial Vis. 16, 2, 125--154.Google Scholar
Cross Ref
- Pomplun, M. 2006. Saccadic selectivity in complex visual search displays. Vision Res. 46(12), 1886--1900.Google Scholar
Cross Ref
- Raj, R., Geisler, W., Frazor, R., and Bovik, A. 2005. Contrast statistics for foveated visual systems: Fixation selection by minimizing contrast entropy. J. Opt. Soc. Am. A. 22, 10, 2039--2049.Google Scholar
Cross Ref
- Rajashekar, U., Cormack, L., and Bovik, A. 2003. Image features that draw fixations. In Proceedings of the IEEE International Conference on Image Processing. IEEE Computer Society Press, Los Alamitos, CA, 313--316.Google Scholar
- Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 372--422.Google Scholar
Cross Ref
- Reichle, E., Pollatsek, A., Fisher, D., and Rayner, K. 1998. Toward a model of eye movement control in reading. Psychol. Rev. 105, 125--157.Google Scholar
Cross Ref
- Rueda, M., Rothbart, M., McCandliss, B., Saccomanno, L., and Posner, M. 2005. From the cover: Training, maturation, and genetic influences on the development of executive attention. PNAS 102, 14931--14936.Google Scholar
Cross Ref
- Seif El-Nasr, M. and Rao, C. 2004. Visually directing user's attention in interactive 3d environments. International Conference on Computer Graphics and Interactive Technique ACM SIGGRAPH Poster Session. ACM, New York. Google Scholar
Digital Library
- Seif El-Nasr, M. and Yan, S. 2006. Visual attention in 3d video games. In Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (Hollywood, CA). ACM, New York. Google Scholar
Digital Library
- Stiefelhagen, R. and Zhu, J. 2002. Head orientation and gaze direction in meeting. Conference on Human Factors in Computing Systems (CHI2002), 858--859. Google Scholar
Digital Library
- Torralba, A., Oliva, A., Castelhano, M., and Henderson, J. 2006. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychol. Rev. 113, 766--786.Google Scholar
- Turano, K. A., Geruschat, D., and Baker, F. 2003. Oculomotor strategies for the direction of gaze tested with a real-world activity. Vision Res. 43, 333--346.Google Scholar
Cross Ref
- Van Donkelaar, P. and Drew, A. 2002. The allocation of attention during smooth pursuit eye movements. Prog. Brain. Res. 140, 267--277.Google Scholar
Cross Ref
- Vinje, W. and Gallant, J. 2000. Sparse coding and decorrelationin primary visual cortex during natural vision. Science 287, 1273V1276.Google Scholar
- Wolfe, J., Cave, K., and Franzel, S. 1989. Guided search: An alternative to the feature integration model for visual search. J. Exp. Psychol.: Hum. Perc. Perf. 15, 419--433.Google Scholar
Cross Ref
- Yarbus, A. 1967. Eye Movements and Vision. Plenum Press, New York.Google Scholar
Index Terms
Video game design using an eye-movement-dependent model of visual attention
Recommendations
Use of eye movements for video game control
ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technologyWe present a study that explores the use of a commercially available eye tracker as a control device for video games. We examine its use across multiple gaming genres and present games that utilize the eye tracker in a variety of ways. First, we ...
User Eye Fatigue Detection via Eye Movement Behavior
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsIn this study we propose and evaluate a novel approach that allows detection of physical eye fatigue. The proposed approach is based on the analysis of the recorded eye movements via what is called behavioral scores. These easy-to-compute scores can be ...
Rule-based learning for eye movement type detection
MCPMD '18: Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal DataEye movements hold information about human perception, intention, and cognitive state. Various algorithms have been proposed to identify and distinguish eye movements, particularly fixations, saccades, and smooth pursuits. A major drawback of existing ...






Comments