skip to main content
research-article

Video game design using an eye-movement-dependent model of visual attention

Published:18 September 2008Publication History
Skip Abstract Section

Abstract

Eye movements can be used to infer the allocation of covert attention. In this article, we propose to model the allocation of attention in a task-dependent manner based on different eye movement conditions, specifically fixation and pursuit. We show that the image complexity at eye fixation points during fixation, and the pursuit direction during pursuit are significant factors in attention allocation. Results of the study are applied to the design of an interactive computer game. Real-time eye movement information is taken as one of inputs for the game. The utility of such eye information for controlling game difficulty is shown.

References

  1. Dye, M. and Bavelier, D. 2004. Playing video games enhances visual attention in children. J. Vis. 4, 11, Abstract 40, 40a.Google ScholarGoogle ScholarCross RefCross Ref
  2. Felzenszwalb, P. and Huttenlocher, D. 2004. Efficient graph-based images segmentation. Internat. J. Comput. Vis. 59, 2 (Sept), 167--181. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Green, C. and Bavelier, D. 2003. Action video game modifies visual selective attention. Nature 423, 534--537.Google ScholarGoogle ScholarCross RefCross Ref
  4. Green, C. and Bavelier, D. 2007. Action-video-game experience alters the spatial resolution of vision. Psychol. Sci. 18, 1, 88--94.Google ScholarGoogle ScholarCross RefCross Ref
  5. Guo, K., Mahmoodi, S., Robertson, R., and Young, M. 2006. Longer fixation duration while viewing face images. Exp. Brain Res. 171, 1, 91--98.Google ScholarGoogle ScholarCross RefCross Ref
  6. Henderson, J. and Hollingworth, A. 1998. Eye movements during scene viewing: an overview. In Eye Guidance in Reading and Scene Perception, G. Underwood, Ed. 269--283.Google ScholarGoogle Scholar
  7. Henderson, J., Weeks, P., and Hollingworth, A. 1999. The effects of semantic consistency on eye movements during complex scene viewing. J. Exp. Psychol.: Hum. Perc. Perf. 25, 210--228.Google ScholarGoogle ScholarCross RefCross Ref
  8. Itti, L. and Koch, C. 2000. A saliency-based search mechanism for overt and covert shift of visual attention. Vision Res. 40, 10--12, 1489--1506.Google ScholarGoogle ScholarCross RefCross Ref
  9. Jie, L. and Clark, J. 2005. Microsaccadic eye movements during ocular pursuit. Vision Sciences Society Annual Meeting (VSS) 5, 8, Abstract, 697a.Google ScholarGoogle Scholar
  10. Kayser, C., Nielsen, K., and Logothetis, N. 2006. Fixations in natural scenes: interaction of image structure and image content. Vision Res. 46, 16, 2535--2545.Google ScholarGoogle ScholarCross RefCross Ref
  11. Land, M. and Hayhoe, M. 2001. In what ways do eye movements contribute to everyday activities? Vision Res. 41, 3559--3565.Google ScholarGoogle Scholar
  12. Loftus, G. 1985. Picture perception: effects of luminance on available information and information-extraction rate. J. Exp. Psychol. Gen 114, 3, 342--356.Google ScholarGoogle ScholarCross RefCross Ref
  13. Loftus, G., Kaufman, L., Nishimoto, T., and Ruthruff, E. 1992. Effects of visual degradation on eye-fixation durations, perceptual processing, and long-term visual memory. In Eye Movements and Visual Cognition: Scene Perception and Reading, K. Reyner, Ed. 203--226.Google ScholarGoogle Scholar
  14. Mannan, S., Ruddock, K., and Wooding, D. 1996. The relationship between the locations of spatial features and those fixations made during visual examination of briefly presented images. Spatial Vision 10, 3, 165--188.Google ScholarGoogle ScholarCross RefCross Ref
  15. Mannan, S., Ruddock, K., and Wooding, D. 1997. Fixation sequences made during visual examination of briefly presented 2d images. Spatial Vision 11, 2, 157--178.Google ScholarGoogle ScholarCross RefCross Ref
  16. Oliva, A., Torralba, A., Castelhano, M., and Henderson, J. 2003. Top-down control of visual attention in object detection. In Proceedings of the IEEE International Conference on Image Processing. IEEE Computer Society Press, Los Alamitos, CA, 253--256.Google ScholarGoogle Scholar
  17. Parkhurst, D. and Niebur, E. 2003. Scene content selected by active vision. Spatial Vis. 16, 2, 125--154.Google ScholarGoogle ScholarCross RefCross Ref
  18. Pomplun, M. 2006. Saccadic selectivity in complex visual search displays. Vision Res. 46(12), 1886--1900.Google ScholarGoogle ScholarCross RefCross Ref
  19. Raj, R., Geisler, W., Frazor, R., and Bovik, A. 2005. Contrast statistics for foveated visual systems: Fixation selection by minimizing contrast entropy. J. Opt. Soc. Am. A. 22, 10, 2039--2049.Google ScholarGoogle ScholarCross RefCross Ref
  20. Rajashekar, U., Cormack, L., and Bovik, A. 2003. Image features that draw fixations. In Proceedings of the IEEE International Conference on Image Processing. IEEE Computer Society Press, Los Alamitos, CA, 313--316.Google ScholarGoogle Scholar
  21. Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 372--422.Google ScholarGoogle ScholarCross RefCross Ref
  22. Reichle, E., Pollatsek, A., Fisher, D., and Rayner, K. 1998. Toward a model of eye movement control in reading. Psychol. Rev. 105, 125--157.Google ScholarGoogle ScholarCross RefCross Ref
  23. Rueda, M., Rothbart, M., McCandliss, B., Saccomanno, L., and Posner, M. 2005. From the cover: Training, maturation, and genetic influences on the development of executive attention. PNAS 102, 14931--14936.Google ScholarGoogle ScholarCross RefCross Ref
  24. Seif El-Nasr, M. and Rao, C. 2004. Visually directing user's attention in interactive 3d environments. International Conference on Computer Graphics and Interactive Technique ACM SIGGRAPH Poster Session. ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Seif El-Nasr, M. and Yan, S. 2006. Visual attention in 3d video games. In Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (Hollywood, CA). ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Stiefelhagen, R. and Zhu, J. 2002. Head orientation and gaze direction in meeting. Conference on Human Factors in Computing Systems (CHI2002), 858--859. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Torralba, A., Oliva, A., Castelhano, M., and Henderson, J. 2006. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychol. Rev. 113, 766--786.Google ScholarGoogle Scholar
  28. Turano, K. A., Geruschat, D., and Baker, F. 2003. Oculomotor strategies for the direction of gaze tested with a real-world activity. Vision Res. 43, 333--346.Google ScholarGoogle ScholarCross RefCross Ref
  29. Van Donkelaar, P. and Drew, A. 2002. The allocation of attention during smooth pursuit eye movements. Prog. Brain. Res. 140, 267--277.Google ScholarGoogle ScholarCross RefCross Ref
  30. Vinje, W. and Gallant, J. 2000. Sparse coding and decorrelationin primary visual cortex during natural vision. Science 287, 1273V1276.Google ScholarGoogle Scholar
  31. Wolfe, J., Cave, K., and Franzel, S. 1989. Guided search: An alternative to the feature integration model for visual search. J. Exp. Psychol.: Hum. Perc. Perf. 15, 419--433.Google ScholarGoogle ScholarCross RefCross Ref
  32. Yarbus, A. 1967. Eye Movements and Vision. Plenum Press, New York.Google ScholarGoogle Scholar

Index Terms

  1. Video game design using an eye-movement-dependent model of visual attention

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Multimedia Computing, Communications, and Applications
          ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 4, Issue 3
          August 2008
          136 pages
          ISSN:1551-6857
          EISSN:1551-6865
          DOI:10.1145/1386109
          Issue’s Table of Contents

          Copyright © 2008 ACM

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 18 September 2008
          • Accepted: 1 October 2007
          • Revised: 1 July 2007
          • Received: 1 April 2007
          Published in tomm Volume 4, Issue 3

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!