Push it real: perceiving causality in virtual interactions

Abstract

With recent advances in real-time graphics technology, more realistic, believable and appealing virtual characters are needed than ever before. Both player-controlled avatars and non-player characters are now starting to interact with the environment, other virtual humans and crowds. However, simulating physical contacts between characters and matching appropriate reactions to specific actions is a highly complex problem, and timing errors, force mismatches and angular distortions are common. To investigate the effect of such anomalies on the perceived realism of two-character interactions, we captured a motion corpus of pushing animations and corresponding reactions and then conducted a series of perceptual experiments. We found that participants could easily distinguish between five different interaction forces, even when only one of the characters was visible. Furthermore, they were sensitive to all three types of anomalous interactions: timing errors of over 150ms were acceptable less than 50% of the time, with early or late reactions being equally perceptible; participants could perceive force mismatches, though over-reactions were more acceptable than under-reactions; finally, angular distortions when a character reacts to a pushing force reduce the acceptability of the interactions, but there is some evidence for a preference of expansion away from the pushing character's body. Our results provide insights to aid in designing motion capture sessions, motion editing strategies and balancing animation budgets.

References

1. Arikan, O., Forsyth, D. A., and O'Brien, J. F. 2005. Pushing people around. In Proc. of SCA '05, 59--66.
2. De Leva, P. 1996. Adjustments to zatsiorsky-seluyanov's segment inertia parameters. Journal of Bomechanics 29, 1223--1230.
3. Ho, E. S. L., Komura, T., and Tai, C.-L. 2010. Spatial relationship preserving character motion adaptation. ACM Trans. Graph. 29, 4 (July), 33:1--33:8.
4. Hodgins, J., Jörg, S., O'Sullivan, C., Park, S. I., and Mahler, M. 2010. The saliency of anomalies in animated human characters. ACM Trans. Appl. Percept. 7, 4 (July), 22:1--22:14.
5. Hoyet, L., Multon, F., Lecuyer, A., and Komura, T. 2010. Can we distinguish biological motions of virtual humans?: perceptual study with captured motions of weight lifting. In Proc. of VRST'10, 87--90.
6. Kim, M., Hyun, K., Kim, J., and Lee, J. 2009. Synchronized multi-character motion editing. ACM Trans. Graph. 28, 3 (July), 79:1--79:9.
7. Komura, T., Ho, E. S. L., and Lau, R. W. H. 2005. Animating reactive motion using momentum-based inverse kinematics: Motion capture and retrieval. CAVW 16, 3-4, 213--223.
8. Kulpa, R., Multon, F., and Arnaldi, B. 2005. Morphology-independent representation of motions for interactive human-like animation. CGF, EG 2005 special issue 24, 3, 343--352.
9. Kwon, T., Cho, Y.-S., Park, S. I., and Shin, S. Y. 2008. Two-character motion analysis and synthesis. IEEE Trans. on Visualization and Computer Graphics 14 (May), 707--720.
10. Laidacker, A., and Barbeau, N. 2011. Living crowds: Ai & animation in assassins creed: Brotherhood. Presented at Game Developers Conference, San Francisco, CA, Feb 28-Mar 4.
11. Lee, K. H., Choi, M. G., and Lee, J. 2006. Motion patches: building blocks for virtual environments annotated with motion data. ACM Trans. Graph. 25, 3 (July), 898--906.
12. Liu, C. K., Hertzmann, A., and Popović, Z. 2006. Composition of complex optimal multi-character motions. In Proc. of SCA'06, 215--222.
13. Majkowska, A., and Faloutsos, P. 2007. Flipping with physics: motion editing for acrobatics. In Proc. of SCA '07, 35--44.
14. McCann, J., and Pollard, N. 2007. Responsive characters from motion fragments. ACM Trans. Graph. 26, 3 (July).
15. Michaels, C. F., and de Vries, M. M. 1998. Higher order and lower order variables in the visual perception of relative pulling force. Journal of Experimental Psychology: Human Perception and Performance 24, 2, 526--546.
16. Michotte, A. 1963. The perception of causality. Basic Books, New York.
17. O'Sullivan, C., Dingliana, J., Giang, T., and Kaiser, M. K. 2003. Evaluating the visual fidelity of physically based animations. ACM Trans. Graph. 22, 3, 527--536.
18. Reitsma, P., and O'Sullivan, C. 2009. Effect of scenario on perceptual sensitivity to errors in animation. ACM Trans. Appl. Percept. 6, 3, 1--16.
19. Reitsma, P., Andrews, J., and Pollard, N. 2008. Effect of character animacy and preparatory motion on perceptual magnitude of errors in ballistic motion. In Proc. of Eurographics '08.
20. Runeson, S., and Frykholm, G. 1983. Kinematic specification of dynamics as an informational basis for person-and-action perception: Expectation, gender recognition, and deceptive intention. Journal of Experimental Psychology: General 112, 4 (Dec.), 585--615.
21. Scholl, B., and Tremoulet, P. 2000. Perceptual causality and animacy. Trends in Cognitive Sciences 4, 8, 299--309.
22. Shum, H. P. H., Komura, T., Shiraishi, M., and Yamazaki, S. 2008. Interaction patches for multi-character animation. ACM Trans. Graph. 27, 5 (Dec.), 114:1--114:8.
23. Shum, H. P., Komura, T., and Yamazaki, S. 2012. Simulating multiple character interactions with collaborative and adversarial goals. IEEE Transactions on Visualization and Computer Graphics 18, 741--752.
24. Sok, K. W., Yamane, K., Lee, J., and Hodgins, J. 2010. Editing dynamic human motions via momentum and force. In Proc. of SCA '10, 11--20.
25. Therien, J., and Bernard, S. 2008. Taming the mob: Creating believable crowds in assassins creed. Presented at Game Developers Conference, San Francisco, CA, Feb 18-22.
26. Yeh, T. Y., Reinman, G., Patel, S. J., and Faloutsos, P. 2009. Fool me twice: Exploring and exploiting error tolerance in physics-based animation. ACM Trans. Graph. 29, 1 (Dec.), 5:1--5:11.
27. Yin, K., Pai, D. K., and Panne, M. V. D. 2005. Data-driven interactive balancing behaviors. In Pacific Graphics 05.
28. Zordan, V. B., and Hodgins, J. K. 2002. Motion capture-driven simulations that hit and react. In Proc. of SCA '02, 89--96.
29. Zordan, V. B., Majkowska, A., Chiu, B., and Fast, M. 2005. Dynamic response for motion capture animation. ACM Trans. Graph. 24, 3 (July), 697--701.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation