skip to main content
research-article

Robust tracking and remapping of eye appearance with passive computer vision

Published:12 December 2007Publication History
Skip Abstract Section

Abstract

A single-camera iris-tracking and remapping approach based on passive computer vision is presented. Tracking is aimed at obtaining accurate and robust measurements of the iris/pupil position. To this purpose, a robust method for ellipse fitting is used, employing search constraints so as to achieve better performance with respect to the standard RANSAC algorithm. Tracking also embeds an iris localization algorithm (working as a bootstrap multiple-hypotheses generation step), and a blink detector that can detect voluntary eye blinks in human-computer interaction applications. On-screen remapping incorporates a head-tracking method capable of compensating for small user-head movements. The approach operates in real time under different light conditions and in the presence of distractors. An extensive set of experiments is presented and discussed. In particular, an evaluation method for the choice of layout of both hardware components and calibration points is described. Experiments also investigate the importance of providing a visual feedback to the user, and the benefits gained from performing head compensation, especially during image-to-screen map calibration.

References

  1. Beymer, D. and Flickner, M. 2003. Eye gaze tracking using an active stereo head. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Madison, WI. IEEE Computer Society Press, 451--458.Google ScholarGoogle Scholar
  2. Brown, M. and Lowe, D. 2003. Recognising panoramas. In Proceedings of the 9th International Conference on Computer Vision, Nice, France. IEEE Computer Society Press, 1218--1225. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Colombo, C. and Del Bimbo, A. 1997. Interacting through eyes. Robotics Auton. Syst. 19, 3-4, 359--368.Google ScholarGoogle ScholarCross RefCross Ref
  4. Colombo, C., Del Bimbo, A., and Valli, A. 2003. Visual capture and understanding of hand pointing actions in a 3D environment. IEEE Trans. Syst. Man Cybernet. B: Cybernet. 33, 4, 677--686. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Criminisi, A., Reid, I., and Zisserman, A. 1999. A plane measuring device. Image Vision Comput. 17, 8, 625--634.Google ScholarGoogle ScholarCross RefCross Ref
  6. Curwen, R. and Blake, A. 1992. Dynamic contours: Real-Time active splines. In Active Vision, A. Blake and A. Yuille, eds. MIT Press, Cambridge, MA, 21--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Daugman, J. 2004. How iris recognition works. IEEE Trans. Circ. Syst. Video Technol. 14, 1, 21--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Duchowsky, A. 2003. Eye Tracking Methodology: Theory and Practice. Springer, Berlin. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Hansen, W. and Pece, A. 2005. Eye tracking in the wild. Comput. Vision Image Understand. 98, 1, 155--181. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hartley, R. and Zisserman, A. 2004. Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge, UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Ji, Q. and Zhu, Z. 2004. Eye and gaze tracking for interactive graphic display. Mach. Vision Appl. 15, 3, 139--148. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Lucas, B. D. and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, Canada. William Kaufmann, 674--679.Google ScholarGoogle Scholar
  13. Ma, L., Tan, T., Wang, Y., and Zhang, D. 2003. Personal identification based on iris texture analysis. IEEE Trans. Pattern Anal. Mach. Intell. 25, 12, 1519--1533. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Morimoto, C. and Mimica, M. 2005. Eye gaze tracking techniques for interactive applications. Comput. Vision Image Understand. 98, 1, 4--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Shih, S.-W. and Liu, J. 2004. A novel approach to 3-d gaze tracking using stero cameras. IEEE Trans. Syst. Man Cybernet. 34, 1, 234--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Trucco, E. and Razeto, M. 2005. Robust iris location in close-up images of the eye. Pattern Anal. Appl. 8, 3, 247--255. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Wang, J. and Sung, E. 2001. Gaze determination via images of irises. Image Vision Comput. 19, 12, 891--911.Google ScholarGoogle ScholarCross RefCross Ref
  18. Xu, L., Machin, D., and Sheppard, P. 1998. A novel approach to real-time non-intrusive gaze finding. In Proceedings of the 9th British Machine Vision Conference, Southampton, UK. British Machine Vision Association, 58--67.Google ScholarGoogle Scholar

Index Terms

  1. Robust tracking and remapping of eye appearance with passive computer vision

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!