User studies: a strategy towards a successful industry-academic relationship

ABSTRACT

Game industry-academic relationships are traditionally related to technology development and education, but more research-oriented partnerships outside of direct technology development and education are forming. With these types of partnerships come stumbling blocks that must be resolved for successful outcomes. Meanwhile, user-oriented research is becoming an essential component in game production due to its utility in guiding the quality of game products. Academia can help inform user studies, which calls for industry-academic partnerships. This opportunity has enabled and stimulated the collaboration between Simon Fraser University and Bardel Entertainment in Vancouver, British Columbia. This paper discusses the importance of game industry and academic collaboration, current opportunities, and strategies based on the SFU-Bardel partnership. Two in-progress projects are detailed: developing novel user testing methods and guidance on design through navigation analysis and playtesting sessions.

References

1. Aarseth, E. 2002. The dungeon and the ivory tower: vive la difference ou liaison dangereuse? Game Studies, 2, 1 (2002). http://www.gamestudies.org/0102/editorial.html.
2. Adams, J. D., Chiang, E. P., and Starkey, K. 2000. Industry-university cooperative research centers. Journal of Technology Transfer, 26, 1--2 (2001), 73--86.
3. Barnes, T., Pashby, I., and Gibbons, A. 2002. Effective University-Industry Interaction: A Multi-case Evaluation of Collaborative R&D Projects. European Management Journal, 20, 3 (2002), 272--285.
4. Berman, E. 2000. The economic impact of industry-funded university R&D. Research Policy, 19 (2000), 349--355.
5. Centre for Digital Media: Great Northern Way Campus. http://mdm.gnwc.ca/.
6. Cutumisu, M., Onuczko, C., McNaughton, M., Roy, T., Schaeffer, J., Schumacher, A., Siegel, J., Szafron, D., Waugh, K., Carbonaro, M., Duff, H., and Gillis, S. 2007. ScriptEase: A Generative/Adaptive Programming Paradigm for Game Scripting. Science of Computer Programming, 67, 1 (June 2007), 32--58.
7. DFC Intelligence. 2009. Game Development at Research Triangle Park. DFC Industry Report, 3.
8. DigiPen: Institute of Technology. https://www.digipen.edu/.
9. Drachen, A. and Canossa, A. 2008. Defining Personas in Games Using Metrics. In Proceedings of the Future Play (Toronto, Canada, 2008). ACM, New York, NY, 73--80.
10. Drachen, A., and Canossa, A. 2009. Analyzing user behavior via gameplay metrics. In Proceedings of the 2009 Conference on Future Play (Vancouver, BC, 2009). ACM Press, New York, NY, 19--20.
11. Drachen, A., Canossa, A., & Yannakakis, G. 2009. Player modeling using self-organization in Tomb Raider: Underworld. Paper presented at the IEEE Computational Intelligence in Games.
12. Elmuti, D., Abebe, M., and Nicolosi, M. 2005. An overview of strategic alliances between universities and corporations. The Journal of Workplace Learning, 17, 1--2 (2005), 115--129.
13. El-Nasr, M., Zupko, J., and Miron, K. 2005. Intelligent lighting for a better gaming experience. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (Portland, Oregon, 2005). ACM Press, New York, NY, 1140--1141.
14. Full Sail University. http://www.fullsail.edu.
15. GAMBIT: Singapore-MIT GAMBIT Game Lab. http://gambit.mit.edu/.
16. Haro, S. 2009. Post mortem: Game mechanics without rules in Habbo Hotel. Presented at Game Developers Conference.
17. Henderson, J., McAdam, R., and Leonard, D. 2006. Reflecting on a TQM based university/industry partnership. Management Decision, 44, 10 (2006), 1422--1440.
18. Hopson, J. 2006, November 10. We're not listening: An open letter to academic game researchers. Gamasutra. http://www.gamasutra.com/view/feature/1783/were_not_listening_an_open_.php.
19. Isbister, K., & Schaffer, N. 2008. Game Usability: Advancing the Player Experience. Morgan Kaufman Publishers.
20. Jacobson, J., Le Renard, M., Lugrin, J., and Cavazza, M. 2005. The CaveUT system: immersive entertainment based on a game engine. In Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology (Valencia, Spain, 2005). ACM Press, New York, NY, 184--187.
21. James, D. 2009. Metrics for a Brave New Whirled. Game Developers Conference: Worlds in Motion.
22. Joslin, S., Brown, R., and Drennan, P. 2002. The gameplay visualization manifesto: a framework for logging and visualization of online gameplay data. Computers in Entertainment, 4, 3 (July/September, 2002), No. 6.
23. Joslin, S., Brown, R., and Drennan, P. 2006. Modelling quest data for game designers. In Proceedings of the 2006 international conference on Game research and development (Perth, Autralia, 2006). Murdoch University, Australia, 184--190.
24. Kim, J. H., Gunn, D. V., E., S., Phillips, B. C., Pagulayan, R. J., & Wixon, D. 2008. Tracking Real-Time User Experience (TRUE): A comprehensive instrumentation solution for complex systems. Paper presented at Computer-Human Interaction (CHI).
25. King, D. and Chen, S. 2009. Metrics for Social Games. In Proceedings of the Social Games Summit (San Francisco, USA, 2009).
26. Kovacs, D., Mitchell, J., Drone, S., and Zorin, D. 2009. Real-time creased approximate subdivision surfaces. In Proceedings of the 2009 symposium on Interactive 3D graphics and games (Boston, Massachusetts, 2009). ACM Press, New York, NY, 155--160.
27. Mellon, L. 2009. Applying metrics driven development to MMO costs and risks. Versant Corporation.
28. National Science Foundation. 1982. University-Industry Research Relationships: Myths, Realities and Potentials. 14^th Annual Report. Washington, DC: US Government Printing Office.
29. North Carolina State University, Digital Games Research Center. http://dgrc.ncsu.edu/.
30. Pagulayan, R. J., Keeker, K., Wixon, D., Romero, R. L., & Fuller, T. 2003. User-centered design in games. The HCI Handbook, 883--906. Lawrence Erlbaum Associates.
31. Perkmann, M., and Walsh, K. 2007. University-industry relationships and open innovation: Towards a research agenda. International Journal of Management Reviews, 9, 4 (2007), 259--280.
32. Perkmann, M., and Walsh, K. 2008. How firms source knowledge from universities: partnerships versus contracting. In Creating Wealth from Knowledge: Meeting the Innovation Challenge, J. Bessant, and T. Venables, Eds. Cheltenham: Edward Elgar.
33. Poyago-Theotoky, J., Beath, J., and Siegel, D. S. 2002. Universities and Fundamental Research: Reflections on the Growth of University-Industry Partnerships. Oxford Review of Economic Policy, 18, 1 (2002), 10--21.
34. Salvucci, S., Cilia, M., and Buchmann, A. 2007. A practical approach for enabling online analysis of event streams. In Proceedings of the 2007 inaugural international conference on Distributed event-based systems (Toronto, Ontario, 2007). ACM Press, New York, NY, 158--163.
35. Santoro, M. 2000. Success breeds success: the linkage between relationship intensity and tangible outcomes in industry-university collaborative ventures. The Journal of High Technology Management Research, 11, 2 (2000), 255--273.
36. Swain, C. 2009. Improving academic-industry collaboration for game research and education. In Proceedings of the 4^th International Conference on Foundations of Digital Games (Orlando, Florida, 2009). ACM, New York, NY, 191--198.
37. Thawonmas, R., Kashifuji, Y., & Chen, K. T. 2008. Design of MMORPG Bots Based on Behavior Analysis. Paper presented at the Advances in Computer Entertainment Technology.
38. Tychsen, A. and Canossa, A. 2008. Defining personas in games using metrics. In Proceedings of the 2008 Conference on Future Play (Toronto, Ontario, 2008). ACM Press, New York, NY, 73--80.
39. University of Southern California GamePipe Laboratory. http://gamepipe.usc.edu/USC_GamePipe_Laboratory/Home.html.
40. Whitten, J. L., Bentley, L. D., Dittman, K. C. 2003. Systems Analysis and Design Methods. McGraw-Hill, New York.
41. Williams, D., Yee, N., & Caplan, S. E. 2008. Who plays, how much, and why? Debunking the stereotypical gamer profile. Journal of Computer-Mediated Communication, 13, 993--1018.

Index Terms

• General and reference

  • Document types

    • General conference proceedings