skip to main content
research-article

Estimation of certainty for responses to multiple-choice questionnaires using eye movements

Published:20 November 2008Publication History
Skip Abstract Section

Abstract

To examine the feasibility of estimating the degree of strength of belief (SOB) of responses using eye movements, the scan paths of eye movements were analyzed while subjects reviewed their own responses to multiple choice tasks. All fixation points of eye movements were classified into visual areas, or cells, which corresponded with the positions of answers. Two estimation procedures are proposed using eye-movement data. The first one is identifying SOB using scan-path transitions. By comparing subject's reports of high and low SOB and eye-movement estimations, a significant correct rate of discrimination of SOB was observed. When the threshold of discrimination was controlled, a high rate of correct responses was obtained if it was set at a low level.

The second procedure is conducting SOB discrimination using support vector machines (SVM) trained with features of fixations. Subject's gazing features were analyzed while they reviewed their own responses. A discrimination model for SOB was trained with several combinations of features to see whether performance of a significant level could be obtained. As a result, a trained model with 3 features (which consist of interval time, vertical difference, and length between fixations) can provide significant discrimination performance for SOB.

These results provide evidence that strength of belief can be estimated using eye movements

References

  1. Brooke, J. 1996. SUS: A quick and dirty usability scale. In Usability Evaluation in Industry, P. Jordan, B. Thomas, B. Weerdmeester, and I. McClelland, Eds. Taylor & Francis, London, UK, 189--194.Google ScholarGoogle Scholar
  2. Chang, C. and Lin, C. 2001. LIBSVM: A Library for Support Vector Machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm.Google ScholarGoogle Scholar
  3. Choi, Y. S., Mosely, A. D., and Stark, L. W. 1995. String editing analysis of human visual search. Optometry Vision Sci. 72, 7, 439--451.Google ScholarGoogle ScholarCross RefCross Ref
  4. Google. 2007. Web search help center. http://www.google.com/support/bin/answer.py?answer=504&topic=532.Google ScholarGoogle Scholar
  5. Imai, H. and Takano, Y. 1995. Kioku wo tadoru (Pursuing memory—in Japanese). In Memory, Y. Takano, Ed. University of Tokyo Press, Tokyo, Japan, 29--48.Google ScholarGoogle Scholar
  6. Ishizaki, M. and Den, Y. 2001. Discorse and Dialogue (in Japanese). University of Tokyo Press, Tokyo, Japan.Google ScholarGoogle Scholar
  7. Iwahashi, N. 2003a. Language aquisition by robots—towards new paradigm of language processing. Trans. Japan. Soc. Artif. Intel. 18, 1, 49--58.Google ScholarGoogle Scholar
  8. Iwahashi, N. 2003b. A method for the coupling of belief systems through human-robot language interaction. In Proceedings of the International Conference on Robot-Human Interaction (ROMAN'03). IEEE, 385--390.Google ScholarGoogle ScholarCross RefCross Ref
  9. Jackson, P. and Moulinier, L. 2002. Natural Language Processing for Online Applications. John Benjamins Publishing, The Netherlands.Google ScholarGoogle Scholar
  10. JSVS (Japan Society of Vision Science), Ed. 2001. Shikaku jyouhou syori handobukku (Handbook of Visual Information Processing—in Japanese).Asakura Shoten, Tokyo, Japan.Google ScholarGoogle Scholar
  11. nac Image Technology 2007. Eye mark recorder 8. http://www.eyemark.jp.Google ScholarGoogle Scholar
  12. nac Image Technology 2004. Eye mark data analysis software, model SP506(Ver. 3.21).Google ScholarGoogle Scholar
  13. Nakayama, M. and Takahasi, Y. 2006. An estimation ofcertainty for multiple choice responses using eye-movement. In Electronic Proceedings of the 2nd Conference on Communication by Gaze Interaction—(COGAIN'06). 67--72.Google ScholarGoogle Scholar
  14. Nakayama, M. and Takahasi, Y. 2007. An estimation of response certainty using eye-movements. In Proceedings of European Symposium on Artificial Neural Networks. d-side Publications, 91--96.Google ScholarGoogle Scholar
  15. Noton, D. and Stark, L. 1971. Scanpaths in eye movements during pattern perception. Science 171, 308--311.Google ScholarGoogle ScholarCross RefCross Ref
  16. Palmer, S. 2000. Vision Science—Photons to Phenomenology. The MIT Press, Cambridge, MA, USA.Google ScholarGoogle Scholar
  17. Puolämaki, Y., Salojärvi, J., Savia, E., Simola, J., and Kaski, S. 2005. Combining eye movements and collaborative filtering for proactive information retrieval. In Proceedings of the Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval 2005, A. Heikkil, A. Pietik, and O. Silven, Eds. ACM Press, New York, USA, 145--153. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psych. Bull. 124, 3, 372--422.Google ScholarGoogle ScholarCross RefCross Ref
  19. Salojärvi, J., Puolämaki, K., and Kaski, S. 2004. Relevance feedback from eye movements for proactve information retrieval. In Proceedings of the Workshop on Processing Sensory Information for Proactive System (PSIPS 2004), A. Heikkil, A. Pietik, and O. Silven, Eds. Oulu, Finland.Google ScholarGoogle Scholar
  20. Shigemasu, K. and Ueno, M. 1993. A new item responsemodel with parameters reflecting state of knowledge. Behaviormetrika 20, 2, 161--169.Google ScholarGoogle ScholarCross RefCross Ref
  21. Shimodaira, H., Noma, K., Nakai, M., and Sagayama, S. 2001. Dynamic time-alignment kernel in support vector machine. In Advances in Neural Information Processing Systems 14, Vol. 2, T. G. Dietterich, S. Becker, and Z. Ghahramani, Eds. The MIT Press, Cambridge, MA, 921--928.Google ScholarGoogle Scholar
  22. Shinotsuka, H. 1993. Confidence and accuracy of mental judgments. The Japanese J. Psych. 63, 6, 396--403.Google ScholarGoogle ScholarCross RefCross Ref
  23. Stork, D. G. R., Duda, O., and Hart, P. E. 2001. Pattern Classification, 2 Ed. John Wiley & Sons, Inc. Japanese translation by M. Onoue, New Technology Communications Co, Ltd, Tokyo, Japan. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Tokunaga, T. 1999. Information Retrieval and Natural Language Processing (in Japanese). University of Tokyo Press, Tokyo, Japan.Google ScholarGoogle Scholar
  25. Tsuda, K. 2003. Ka-neru hou no riron to jissai (Theory and practice of kernel method—in Japanese). In Pattern ninsiki to gakusyuu no toukeigaku (Pattern Recognition and Statistics of Learning), S. A. et al., Ed. Iwanami Shoten, Tokyo, Japan.Google ScholarGoogle Scholar
  26. Underwood, G. 2005. Eye fixations on pictures of natural scenes: Getting the gist and identifying the components. In Cognitive Processes in Eye Guidance, G. Underwood, Ed. Oxford University Press, Oxford, UK.Google ScholarGoogle Scholar
  27. Zhang, Y. 2007. An Item Response Model on Probability-Testing (in Japanese). University of Tokyo Press, Tokyo, Japan.Google ScholarGoogle Scholar

Index Terms

  1. Estimation of certainty for responses to multiple-choice questionnaires using eye movements

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Multimedia Computing, Communications, and Applications
        ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 5, Issue 2
        November 2008
        187 pages
        ISSN:1551-6857
        EISSN:1551-6865
        DOI:10.1145/1413862
        Issue’s Table of Contents

        Copyright © 2008 ACM

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 20 November 2008
        • Accepted: 1 December 2007
        • Revised: 1 August 2007
        • Received: 1 April 2007
        Published in tomm Volume 5, Issue 2

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!