Abstract
In collaborative situations, eye gaze is a critical element of behavior which supports and fulfills many activities and roles. In current computer-supported collaboration systems, eye gaze is poorly supported. Even in a state-of-the-art video conferencing system such as the access grid, although one can see the face of the user, much of the communicative power of eye gaze is lost. This article gives an overview of some preliminary work that looks towards integrating eye gaze into an immersive collaborative virtual environment and assessing the impact that this would have on interaction between the users of such a system. Three experiments were conducted to assess the efficacy of eye gaze within immersive virtual environments. In each experiment, subjects observed on a large screen the eye-gaze behavior of an avatar. The eye-gaze behavior of that avatar had previously been recorded from a user with the use of a head-mounted eye tracker. The first experiment was conducted to assess the difference between users' abilities to judge what objects an avatar is looking at with only head gaze being viewed and also with eye- and head-gaze data being displayed. The results from the experiment show that eye gaze is of vital importance to the subjects, correctly identifying what a person is looking at in an immersive virtual environment. The second experiment examined whether a monocular or binocular eye-tracker would be required. This was examined by testing subjects' ability to identify where an avatar was looking from their eye direction alone, or by eye direction combined with convergence. This experiment showed that convergence had a significant impact on the subjects' ability to identify where the avatar was looking. The final experiment looked at the effects of stereo and mono-viewing of the scene, with the subjects being asked to identify where the avatar was looking. This experiment showed that there was no difference in the subjects' ability to detect where the avatar was gazing. This is followed by a description of how the eye-tracking system has been integrated into an immersive collaborative virtual environment and some preliminary results from the use of such a system.
- Argyle, M. 1975. Bodily Communication. Methuen, London.Google Scholar
- Argyle, M. 1988. Bodily Communication, 2nd ed. Methuen, London.Google Scholar
- Argyle, M. and Graham, J. 1977. The central Europe experiment---Looking at persons and looking at things. J. Environ. Psychol. Nonverbal Behav. 1, 1, 6--16.Google Scholar
Cross Ref
- Benford, S. 1995. User embodiment in collaborative virtual environments. In Proceedings of the Conference on Computer-Human Interaction. ACM Press, New York. Google Scholar
Digital Library
- Bente, G. and Kraemer, N. C. 2002. Virtual gestures: Analyzing social presence effects of computermediated and computer-generated nonverbal behavior. In Proceedings of the 5th Annual International Workshop PRESENCE. MIT Press, Cambridge, 233--244.Google Scholar
- Bruce, V. and Yound, A. 1998. In the Eye of the Beholder: The Science of Face Perception. Oxford University Press, Oxford.Google Scholar
- Cruz-Neira, C., Sandin, D. J., and DeFanti, T. A. 1993. Surround-Screen projection-based virtual reality: The design and implementation of the CAVE. In Proceedings of the 20th Annual Conference on Computer Graphics. ACM Press, New York, 135--142. Google Scholar
Digital Library
- Dickerson, P., Rae, J., Stribling, P., Dautenhahn, K., and Werry, I. 2005. Autistic children's co-ordination of gaze and talk: Re-Examining the ‘Asocial’ Autist. In Applying Conversation Analysis, K. Richards and P. Seedhouse, Eds. Palgrave Macmillan, Basingstoke, 19--37.Google Scholar
- Garau, M., Slater, M., Bee, S., and Sasse, M. A. 2001. The impact of eye gaze on communication using humanoid avatars. In Proceedings of the SIG-CHI Conference on Human Factors in Computing Systems. ACM Press, New York. Google Scholar
Digital Library
- Garau, M., Slater, M., Vinayagamoorhty, V., Brogni, A., Steed, A., and Sasse, M. A. 2003. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the SIG-CHI Conference on Human Factors in Computing Systems. ACM Press, New York. Google Scholar
Digital Library
- Goodwin, C. 1980. Restarts, pauses and the achievement of mutual gaze at turn-beginning. Sociol. Inquiry 50, 272--302.Google Scholar
Cross Ref
- Goodwin, C. 1981. Conversational Organisation: Interaction Between Speakers and Hearers. Academic Press, New York.Google Scholar
- Goodwin, C. 1986. Gestures as a resource for the organization of mutual orientation. Semiotica 62, 29--49.Google Scholar
Cross Ref
- Goodwin, C. 2000. Practices of seeing: Visual analysis: An ethnomethodological approach. In Handbook of Visual Analysis, T. van Leeuwen and C. Jewitt, Eds. Sage, London, 157--182.Google Scholar
- Heath, C. 1984. Talk and recipiency: Sequential organization in speech and body movement. In Structures of Social Interaction: Studies in Conversation Analysis, J. Atkinson and J. Heritage, Eds. Cambridge University Press, New york, 247--265.Google Scholar
- Heldal, I. 2005. Successes and failures in copresent situations. Presence: Teleoper. Virtual Environ. 14, 5, 563--579. Google Scholar
Digital Library
- Hindmarsh, J. 2000. Object-Focused interaction in collaborative virtual environments. ACM Trans. Comput.-Hum. Interact. 7, 4, 477--509. Google Scholar
Digital Library
- Kendon, A. 1967. Some functions of gaze-direction in social interaction. Acta Psychologica 26, 22--63.Google Scholar
Cross Ref
- Lee, S. H., Badler, J. B., and Badler, N. I. 2002. Eyes alive. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York, 637--644. Google Scholar
Digital Library
- Lerner, G. 1996. On the place of linguistic resources in the organization of talk in interaction: ‘Second person’ reference in multi-party conversation. Pragmatics 6, 281--294.Google Scholar
Cross Ref
- Lerner, G. 2003. Selecting next speaker: The context-sensitive operation of a context free organization. Lang. Soc. 32, 2, 177--201.Google Scholar
Cross Ref
- Markus, G. and Wurmlin, S. 2003. Blue-C: A spatially immersive display and 3D video portal for telepresence. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Tenchniques. ACM Press, New York. Google Scholar
Digital Library
- Murray, N., Goulermas, J. Y., and Fernando, T. 2003. Visual tracking for a virtual environment. In Proceedings of Human Computer-Interaction International Conference, vol. 1. Lawrence Erlbaum Associates, NJ, 1198--1202.Google Scholar
- Murray, N. and Roberts, D. 2006. Comparison of head gaze and head and eye gaze within an immersive environment. In the 10th IEEE International Symposium on Distributed Simulation and Real Time Applications. IEEE Computer Society, Los Alamitos, CA. Google Scholar
Digital Library
- Rae, J. P. 2001. Organizing participation in interaction: Doing participation framework. Res. Lang. Soc. Inter. 34, 2, 253--278.Google Scholar
Cross Ref
- Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. 1998. The office of the future: A unified approach to image-based modeling and spatially immersive displays. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Tenchniques. ACM Press, New York. Google Scholar
Digital Library
- Roberts, D. J., Wolff, R., Otto, O., Steed, A., Kranzlmueller, D., and Anthes, C. 2004. Supporting social human communication between distributed walk-in displays. In Proceedings of the ACM International Symposium on Virtual Reality, Systems and Technology. ACM Press, New York. Google Scholar
Digital Library
- Schroeder, R., Steed, A., Axelsson, A. S., Heldal, I., Abelin, A., Widestrom, J., Nilsson, A., and Slater, M. 2001. Collaborating in networked immersive spaces: As good as being there together? Comput. Graphics 25, 5, 781--788.Google Scholar
Cross Ref
- Steed, A., Spante, M., Schroeder, R., Heldal, I., and Axelsson, A. S. 2003. Strangers and friends in caves: An exploratory study of collaboration in networked IPT systems for extended periods of time. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics. ACM Press, New York, 51--54. Google Scholar
Digital Library
- Tanger, R., Kauff, P., and Schreer, O. 2004. Immersive meeting point (im.point)---An approach towards immersive media portals. In Proceedings of the Pacific-Rim Conference on Multimedia. Springer, Berlin. Google Scholar
Digital Library
- Taylor, R. M., Hudson, T. C., Seeger, A., Weber, H., Juliano, J., and Helser, A. T. 2001. VRPN: A device-independent, network-transparent VR peripheral system. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology. ACM Press, New York. Google Scholar
Digital Library
- Vinayagamoorhty, V., Garau, M., Steed, A., and Slater, M. 2004. An eye gaze model for dyadic interaction in an immersive virtual environment: Practice and experience. Comput. Graphics Forum 23, 1, 1--11.Google Scholar
Cross Ref
Index Terms
An assessment of eye-gaze potential within immersive virtual environments
Recommendations
Eye, Head and Torso Coordination During Gaze Shifts in Virtual Reality
Humans perform gaze shifts naturally through a combination of eye, head and body movements. Although gaze has been long studied as input modality for interaction, this has previously ignored the coordination of the eyes, head and body. This article ...
Anticipatory Gaze Shifts during Navigation in a Naturalistic Virtual Environment
CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in PlayIn the real world, coupled eye and head movements are used by humans and other animals to orient their gaze toward objects or scenes of interest. In virtual environments a mouse is often used as a proxy for head movements, orienting the camera towards a ...
Comparison of head gaze and head and eye gaze within an immersive environment
DS-RT '06: Proceedings of the 10th IEEE international symposium on Distributed Simulation and Real-Time ApplicationsFor efficient collaboration between participants, eye gaze is seen as being critical for interaction. Teleconferencing systems such as the AcessGrid allow users to meet across geographically disparate rooms but as of now there seems no substitute for ...






Comments