Analyzing user behavior via gameplay metrics

ABSTRACT

User-oriented research in the game industry is undergoing a change from relying on informal user-testing methods adapted directly from productivity software development to integrating modern approaches to usability- and user experience testing. Gameplay metrics analysis form one of these novel techniques, being based on instrumentation methods in HCI. Gameplay metrics are instrumentation data about the user behavior and user-game interaction, and can be collected during testing, production and the live period of the lifetime of a digital game. The use of instrumentation data is relatively new to commercial game development, offering a powerful supplement to existing user-oriented testing methods. This presentation will introduce a metrics solution and a series of case studies of games from major Danish game developer IO Interactive of EIDOS.

References

1. Bateman, C., Boon, R.: 21st Century Game Design. Charles River Media (2005)
2. Davis, J.; Steury, K., Pagulayan, R.: A survey method for assessing perceptions of a game: The consumer playtest in game design. Game Studies: The International Journal of Computer Game Research, 5 (2005)
3. DeRosa, P.: Tracking Player Feedback to Improve Game Design. Gamasutra, Aug. 7 (2007)
4. Dumas, J. S. 2003. User-Based Evaluations. In: The HCI handbook. Lawrence Erlbaum Associates (2003), 1093--1117
5. Gilleade, K. M., Dix, A.: Using frustration in the design of adaptive videogames. In: Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, Singapore (2004), 228--232
6. Ijsselsteijn, W., de Kort, Y., Poels, K., Jugelionis, A., Bellotti, F.: Characterizing and Measuring User Experiences in Digital Games. In: Proceedings of ACE, Toronto, Ontario (2007)
7. Isbister, K., Schaffer, N.: Game Usability: Advancing the Player Experience. Morgan Kaufman (2008)
8. Jørgensen, A. H.: Marrying HCI/Usability and Computer Games: A Preliminary Look, Proceedings of NordiCHI, Tampere, Finland (2004)
9. Kim, J. H., Gunn, D. V., Schuh, E., Phillips, B. C., Pagulayan, R. J., Wixon, D.: Tracking Real-Time User Experience (TRUE): A comprehensive instrumentation solution for complex systems. In Proceedings of CHI, Florence, Italy (2008), 443--451
10. Kuniavsky, M.: Observing the User Experience: A Practitioner's Guide to User Research. Morgan Kaufman (2003)
11. Medlock, M. C., Wixon, D., Terrano, M., Romero, R. L., Fulton, B.: Using the RITE method to improve products: A definition and a case study. In: Proceedings of UPA (2002)
12. Nørgaard, M., Rau, J.: User Testing in the Combat Zone. In: Proceedings of ACE, Toronto, Ontario (2007)
13. Pagulayan, R. J., Keeker, K., Wixon, D., Romero, R. L., Fuller, T.: User-centered design in games. In: The HCI handbook. Lawrence Erlbaum Associates (2003), 883--906
14. Pagulayan, R. J., Steury, K. R., Fulton, B., Romero, R. L.: Designing for fun: user-testing case studies. In: Blythe, M. A., Overbeeke, K., Monk, A. F. Wright, P. C. (Eds.): Funology: From usability to enjoyment. Human-Computer Interaction series. Kluwer Academic Publishers (2005). 14
15. Schultz, C. P.: Game Testing All in One. Course Technology PTR (2005)
16. Swain, C. 2008. Master Metrics: The Science Behind the Art of Game Design. Presentation at NLGD Conference, Utrecht, Holland (2008)
17. Tychsen, A., Canossa, A.: Defining Personas in Games Using Metrics. In: proceedings of Future Play 2008, Toronto, Canada. ACM publishers (2008), 73--80

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information systems applications

    • Decision support systems

      • Expert systems