Frames of reference in virtual object rotation

ABSTRACT

It is difficult with most current computer interfaces to rotate a virtual object so that it matches the orientation of another virtual object. Times to perform this simple task can exceed 20 seconds whereas the same kind of rotation can be accomplished with real objects and with some VR interfaces in less than two seconds. In many advanced 3D user interfaces, the hand manipulating a virtual object is not in the same place as the object being manipulated. The available evidence suggests that this is not usually a significant problem for manipulations requiring translations of virtual objects, but it is when rotations are required. We hypothesize that the problems may be caused by frame of reference effects---mismatches between the visual frame of reference and the haptic frame of reference. Here we report two experiments designed to study interactions between visual and haptic reference frames space.In our first study we investigated the effect of rotating the frame of the controller with respect to the frame of the object being rotated. We measured a broad U--shaped relationship. Subjects could tolerate quite large mismatches, but when the orientation mismatch approached 90 degrees performance deteriorated rapidly by up to a factor of 5. In our second experiment we manipulated both rotational and translational correspondence between visual and haptic frames of reference. We predicted that the haptic reference frame might rotate in egocentric coordinates when the input device was in a different location than the virtual object. The experimental results showed a change in the direction predicted; they are consistent with a rotation of the haptic frame of reference, although only by about half the magnitude predicted. Implications for the design of control devices are discussed.

References

1. BALAKRISHNAN, R., AND HINKLEY, K. 1999. The role of kinesthetic refernce frames in two-handed input performance. Proceedings ACM UIST'99 171--178.
2. CHEN, M., S. J. MOUNTFORD, AND SELLEN, A. 1988. A Study in Interactive 3-D Rotation Using 2-D Control Devices. Computer Graphics 22(4): 121--129.
3. COLBY, C. L. 1998. Action-Oriented Spatial Reference Frames in Cortex. Neuron, 20 15--24.
4. GUIARD, Y. 1987. Asymmetric division of labor in human skilled bimanual action. Journal of Motor Behaviour, 19(4) 487--517.
5. HINCKLEY, K., PAUSCH, R., TULIO, J., PROFFITT, D., AND KASSELL, N. 1997. Usability analysis of 3D rotation techniques. Proceedings of ACM UIST'97, 1--10.
6. PANI, J. R. AND DUPREE, D. 1994. Spatial reference systems in the comprehension of rotational motion. Perception, 23, 929--946.
7. PARSONS, L. 1995. Inability to reason about and object's orientation using an axis and angle of rotation. Journal of Experimental Psychology: Human Perception and Performance, 21(6), 1259--1277.
8. SHELTON, A. L., AND MCNAMARA, T. P. 2001. Systems of Spatial Reference in Human Memory. Cognitive Psychology, 43, 274--310.
9. SHEPARD, R. N. AND METZLER, J. 1971 Mental rotation of three dimensional objects. Science, 191, 952--954.
10. SHOEMAKE, K. 1992. ARCBALL: A User Interface for Specifying Three-dimensional Orientation, Graphics Interface '92.
11. WANG, Y., MACKENZIE, C., SUMMERS, V. A., AND BOOTH, K. S. 1998. The structure of object Transportation and Orientation in Human-Computer Interaction. Proceedings of ACM CHI'98, 312--319.
12. WARE, C. AND BAXTER, C. 1989. Bat Brushes: On the uses of six position and orientation parameters in a paint program. SIGCHI. 189 Austin, Texas. Proceedings and Special issue of SIGCHI Bulletin. 155--160.
13. WARE, C. AND ROSE, J. 1999. Rotating Virtual Objects with Real Handles, ACM Transactions on CHI. 6(2) 162--180.
14. WARE, C. 1990. Using hand position for virtual object placement. The Visual Computer, 6, 245--253.
15. ZHAI, C. AND MILGRAM, P. 1998. Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices. Proceedings of ACM CHI'98 Proceedings, 320--327.

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI theory, concepts and models

    • Interaction devices

      • Graphics input devices

  • Interaction design

    • Interaction design theory, concepts and paradigms