Analyzing spatial user behavior in computer games using geographic information systems

ABSTRACT

An important aspect of the production of digital games is user-oriented testing. A central problem facing practitioners is however the increasing complexity of user-game interaction in modern games, which places challenges on the evaluation of interaction using traditional user-oriented approaches. Gameplay metrics are instrumentation data which detail user behavior within the virtual environment of digital games, forming accurate and detailed datasets about user behavior that supplement existing user-testing methods such as playtesting and usability testing. In this paper existing work on gameplay metrics is reviewed, and spatial analysis of gameplay metrics introduced as a new approach in the toolbox of user-experience testing and research. Furthermore, Geographic Information Systems (GIS) are introduced as a tool for performing spatial analysis. A case study is presented with Tomb Raider: Underworld, showcasing the merger of GIS with gameplay metrics analysis and its application to game testing and design.

References

1. Blythe, M. A., Overbeeke, K., Monk, A. F. Wright, P. C.: Funology -- from usability to enjoyment. Springer (2004)
2. Brainard, J. Becker, B.: Case Study: E-Commerce Clickstream Visualization. In Proceedings of IEEE Symposium on Information Visualization (2001), 153--158
3. Börner, K., Penumarthy, S.: Social Diffusion Patterns in Three-Dimensional Virtual Worlds. Information Visualization, 2 (2003), 182--198
4. Cadez, I., Heckerman, D., Meek, C., Smyth, P., White, S.: Visualization of Navigation Patterns on a Web Site Using Model-Based Clustering. In Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2000), 280--284
5. Chittaro, L.&Ieronutti, L.: A visual tool for tracing users' behavior in virtual environments. In Proc. Working Conference on Advanced Visual Interfaces (2004), 40--47
6. Chittaro L., Ranon R., Ieronutti L.: VU-Flow: A Visualization Tool for Analyzing Navigation in Virtual Environments. IEEE Transactions on Visualization and Computer Graphics, 12, 6 (2006), 1475--1485
7. Davis, J.; Steury, K., Pagulayan, R.: A survey method for assessing perceptions of a game: The consumer playtest in game design. Game Studies: The International Journal of Computer Game Research, 5 (2005)
8. De Kort, Y., Ijsselssteijn, W: People, places and play: Player experience in a socio-spatial context. ACM Computers in Entertainment 6, 2, article no. 18 (2007)
9. DeMers, M. N.: Fundamentals of Geographical Information Systems, Wiley&Sons (2008)
10. DeRosa, P.: Tracking Player Feedback to Improve Game Design. Gamasutra, Aug. 7 (2007)
11. Desurvire, H., Caplan, M., Toth, J. A.: Using heuristics to evaluate the playability of games. In CHI '04 extended abstracts on Human factors in computing systems (2004)
12. Dumas, J. S. 2003. User-Based Evaluations. In The HCI handbook. Lawrence Erlbaum Associates (2003), 1093--1117
13. Hilbert, D. M. and Redish, J. C.: A practical guide to usability testing. Intellect books (1999)
14. Hoobler, N., Humphreys, G., Agrawala, M.: Visualizing Competitive Behaviors in Multi-User Virtual Environments. In Proc. of the IEEE Visualization Conference (2004), 163--170
15. Hurst, A., Hudson, S. E., Mankoff, J.: Dynamic detection of novice vs. skilled use without a task model. In Proceedings of CHI 2007, ACM press (2007), 271--280
16. Isbister, K., Schaffer, N.: Game Usability: Advancing the Player Experience. Morgan Kaufman (2008)
17. Jørgensen, A. H.: Marrying HCI/Usability and Computer Games: A Preliminary Look. In Proceedings of NordiCHI, Tampere, Finland (2004)
18. Kim, J. H., Gunn, D. V., Schuh, E., Phillips, B. C., Pagulayan, R. J., Wixon, D.: Tracking Real-Time User Experience (TRUE): A comprehensive instrumentation solution for complex systems. In Proceedings of CHI, Florence, Italy (2008), 443--451
19. Korhonen, H., Koivisto, E. M. I.: Playability Heuristics for Mobile Multi-Player Games. In Proceedings of DIMEA (2007)
20. Kort, J., Steen, M. G. D., de Poot, H., ter Hofte, H., Mulder, I.: Studying usage of complex applications. In Proceedings of Measuring Behavior. Noldus Information Technology (2005).
21. Kuniavsky, M.: Observing the User Experience: A Practitioner's Guide to User Research. Morgan Kaufman (2003)
22. Longley, P.; Goodchild, M. F., Macquire, D.&Rhind, D.: Geographic Information Systems and Science. Wiley (2005)
23. Medlock, M. C., Wixon, D., Terrano, M., Romero, R. L., Fulton, B.: Using the RITE method to improve products: A definition and a case study. In Proceedings of UPA (2002)
24. Mellon, L.: Metrics in MMP Development and Operations. Presentation at the GDC, Los Angeles, USA (2004)
25. Nørgaard, M., Rau, J.: User Testing in the Combat Zone. In Proceedings of ACE, Toronto, Ontario (2007)
26. Pagulayan, R. J., Keeker, K., Wixon, D., Romero, R. L., Fuller, T.: User-centered design in games. In The HCI handbook. Lawrence Erlbaum Associates (2003), 883--906
27. Pagulayan R., Keeker, K.: Measuring Pleasure and Fun: Playtesting. In Wilson C. (Ed.): Handbook of Formal and Informal Interaction Design Methods. Morgan Kaufmann Publishers (2007)
28. Renaud, K. and Gray, P.: Making sense of low-level usage data to understand user activities. In Proceedings of SAICSIT 2004, ACM Press (2004), 115--124
29. Rouse, R. Game Design: Theory and Practice. Wordware publishing Inc. (2001)
30. Schultz, C. P.: Game Testing All in One. Course Technology PTR (2005)
31. Swain, C. 2008. Master Metrics: The Science Behind the Art of Game Design. Presentation at NLGD Conference, Utrecht, Holland (2008)
32. Thompson, C.: Halo 3: How Microsoft Labs Invented a New Science of Play. Wired Magazine 15, 9 (2007)
33. Tychsen, A., Canossa, A.: Defining Personas in Games Using Metrics. In proceedings of Future Play 2008, Toronto, Canada. ACM publishers (2008), 73--80
34. Tychsen, A., Newman, K., Brolund, T., Hitchens, M.: Cross-format analysis of the gaming experience in multi-player role playing games. In DIGRA 2007, Tokyo, Japan (2007), 49--58
35. Whiteside, J., Archer, N. P., Wixon, D., Good, M.: How Do People Really Use Text Editors? In Proceedings of the SIGOA Conference, ACM Press (1982), 29--40
36. Williams, D.; Yee, N., Caplan, S. E.: Who plays, how much, and why? Debunking the stereotypical gamer profile. Journal of Computer-Mediated Communication 13 (2005), 993--1018

Index Terms

• Applied computing

  • Computers in other domains

    • Personal computers and PC applications

      • Computer games

• Computing methodologies

  • Artificial intelligence

    • Philosophical/theoretical foundations of artificial intelligence

      • Cognitive science

  • Modeling and simulation

    • Model development and analysis

      • Model verification and validation

• Human-centered computing

  • Human computer interaction (HCI)

  • Visualization

    • Visualization application domains

      • Geographic visualization

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Massively multiplayer online games

    • Spatial-temporal systems

• Software and its engineering

  • Software organization and properties

    • Contextual software domains

      • Virtual worlds software

        • Interactive games