Playtesting with a Purpose

ABSTRACT

Playtesting, or using play to guide game design, gives designers feedback about whether their game is meeting their goals and the player's expectations. We report a case study of designing, deploying, and iterating on a series of playtesting workshops for novice game designers. We identify common missteps made by novice designers and address these missteps through the concept of purposefulness, understanding why you are playtesting as well as how to playtest. We ground our workshops in the development of rich player experience goals, which inform playtest design, data collection and iteration. We show that by applying methods taught in our workshops, novice game designers leveraged playtest methods and tools, employed playtesting and data collection methods appropriate for their goals, and effectively applied playtest data in iterative design. We conclude with lessons learned and next steps in our research on playtesting.

References

1. Abuhamdeh, S. and Csikszentmihalyi, M. 2012. The Importance of Challenge for the Enjoyment of Intrinsically Motivated, Goal-Directed Activities. Personality and Social Psychology Bulletin 38, 317--330.
2. Ambinder, M. 2011. Biofeedback in Gameplay: How Valve Measures Physiology to Enhance Gaming Experience. http://www.valvesoftware.com/publications/2011/V alveBiofeedback-Ambinder.pdf.
3. Anthropy, A. and Clark, N. 2014. A Game Design Vocabulary: Exploring the Foundational Principles Behind Good Game Design. Pearson Education.
4. Barr, P., Noble, J., and Biddle, R. 2007. Video game values: Human'computer interaction and games. Interacting with Computers 19, 2, 180--195.
5. Brockmyer, J.H., Fox, C.M., Curtiss, K.A., McBroom, E., Burkhart, K.M., and Pidruzny, J.N. 2009. The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45, 4, 624--634.
6. Cabrera, E. 2014. League of Legends - The Potential of A/B Testing. gamasutra.com. http://www.gamasutra.com/blogs/EduardoCabrera/ 20141020/227964/League_of_Legends__The_Pote ntial_of_AB_Testing.php.
7. Choi, J., Forlizzi, J., Christel, M., Bates, M., and Hammer, J. 2015. Compositions: Moving from Ideation to Prototyping. Games + Learning + Society 11.
8. Csikszentmihalyi, M. 1990. Flow: The psychology of optimal performance. Cambridge University Press.
9. Desurvire, H. and El-Nasr, M.S. 2013. Methods for game user research: Studying player behavior to enhance game design. IEEE Computer Graphics and Applications 33, 4, 82--87.
10. Desurvire, H. and Wiberg, C. 2009. Game usability heuristics (PLAY) for evaluating and designing better games: the next iteration. Online communities and social computing. Springer Berlin Heidelberg, 557--566..
11. El-Nasr, M.S., Drachen, A., and Canossa, A. 2013. Game Analytics: Maximizing the Value of Player Data. Springer Science & Business Media.
12. Fullerton, T. 2014. Game Design Workshop: A Playcentric Approach to Creating Innovative Games, Third Edition. CRC Press.
13. Hull, R. and Reid, J. 2003. Designing engaging experiences with children and artists. Funology: From usability to enjoyment, 179--188.
14. Hunicke, R., LeBlanc, M., and Zubek, R. 2004. MDA: A Formal Approach to Game Design and Game Research. Workshop on Challenges in Game AI, 1--4.
15. Isbister, K. and Schaffer, N. 2008. Game Usability: Advancing the Player Experience. CRC Press.
16. Jennett, C., Cox, A.L., Cairns, P., et al. 2008. Measuring and defining the experience of immersion in games. International Journal of Human Computer Studies 66, 9, 641--661.
17. Jr, M.W., Sathiyanarayanan, P., Nagappan, M., Zimmermann, T., and Bird, C. 2016. "What Went Right and What Went Wrong": An Analysis of 155 Postmortems from Game Development. Proceedings of the 38th International Conference on Software Engineering Companion, ACM Press. 280--289.
18. Lankoski, P. and Björk, S. 2015. Game Research Methods: An Overview. Lulu.com. http://press.etc.cmu.edu/files/Game-ResearchMethods_Lankoski-Bjork-etal-web.pdf.
19. Lewis-Evans, B. 2013. Intro to Games User Research Methods. http://www.slideshare.net/Gortag/intro-to-gamesuser-research-methods-march-2013.
20. Lewis, C. and Mack, R. 1982. Learning to use a text processing system. Proceedings of the 1982 conference on Human factors in computing systems CHI '82, ACM Press. 387--392.
21. Lucero, A. and Arrasvuori, J. 2010. PLEX Cards : A Source of Inspiration When Designing for Playfulness. Fun and Games 15, 17, 28--37.
22. McMahan, A. 2003. Immersion, Engagement, and Presence. The video game theory reader Immersion, 67--86.
23. Medlock, M.C., Lead, U.T., Studios, M.G., et al. 2002. Using the RITE method to improve products?; a definition and a case study. Usability Professionals Association.
24. Pagulayan, R.J., Keeker, K., Fuller, T., Wixon, D., Romero, R.L., and Gunn, D. V. 2002. User centered design in games, 1--46.
25. Patton, M.Q. 2005. Qualitative Research. In Encyclopedia of Statistics in Behavioral Science, 1633--1636.
26. Pulsipher, L. Game Playtesting: the Heart of Game Design - Udemy. udemy.com. https://www.udemy.com/game-playtesting/.
27. Salen, K. and Zimmerman, E. 2004. Rules of Play: Game Design Fundamentals.MIT Press.
28. Salen, K. and Zimmerman, E. 2005. Game Design and Meaningful Play. In Handbook of computer game studies The MIT Press. 59--79.
29. Schell, J. 2015. The Art of Game Design: A Book of Lenses. CRC Press.
30. Vorderer, P., Klimmt, C., and Ritterfeld, U. 2004. Enjoyment: At the Heart of Media Entertainment. Communication Theory 14, 4, 388--408.
31. Zimmerman, E. 2003. Play as Research: the iterative design process. In Design Research: Methods and Perspectives. 176--184.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information systems applications

    • Decision support systems

      • Expert systems

• Social and professional topics

  • Professional topics

    • Computing education

      • Computing education programs

        • Computer science education

        • Information science education