An analysis and critique of Research through Design: towards a formalization of a research approach

ABSTRACT

The field of HCI is experiencing a growing interest in Research through Design (RtD), a research approach that employs methods and processes from design practice as a legitimate method of inquiry. We are interested in expanding and formalizing this research approach, and understanding how knowledge, or theory, is generated from this type of design research. We conducted interviews with 12 leading HCI design researchers, asking them about design research, design theory, and RtD specifically. They were easily able to identify different types of design research and design theory from contemporary and historical design research efforts, and believed that RtD might be one of the most important contributions of design researchers to the larger research community. We further examined three historical RtD projects that were repeatedly mentioned in the interviews, and performed a critique of current RtD practices within the HCI research and interaction design communities. While our critique summarizes the problems, it also shows possible directions for further developments and refinements of the approach.

References

1. Binder, T. and Johan Redström, J. Exemplary Design Research. In Proceedings of Wonder ground, (2006) Design Research Society.
2. Boehner, K., Vertesi, J., Sengers, P., and Dourish, P. How HCI Interprets the Probes. In Proceedings of CHI, (2007) ACM Press, 1077--1086.
3. Buchanan, R. Wicked Problems in Design Thinking. In The Idea of Design. V. Margolin and R. Buchanan (eds). MIT Press, 1995, 3--20.
4. Carroll, J. M. and Campbell, R. L. Artifacts as Psychological Theories: The Case of Human-Computer Interaction. IBM Research, 1988.
5. Carroll, J. M. and Kellogg, W. A. Artifact as Theory-Nexus: Hermeneutics Meets Theory-Based Design. In Proceedings of CHI, (1989) ACM Press, 7--14.
6. Crabtree, A., Rodden, T., Tolmie, P. and Button, G. Ethnography Considered Harmful. In Proceedings of CHI, (2009) ACM Press, 879--888.
7. Djajadiningrat, T., Wensveen, S., Frens, J., and Overbeeke, K. Tangible Objects: redressing the balance between appearance and action. In Personal and Ubiquitous Computing, 8, (2004) 294--309.
8. Dourish, P. Implications for Design. In Proceedings of CHI, (2006) ACM Press, 541--550.
9. Edmondson, A. C. and McManus, S. E. Methodological Fit in Management Field Research. Academy of Management Review, 32, 4 (2007), 1155--1179.
10. The Equator Project, http://www.equator.ac.uk, accessed September, 2009.
11. Fallman, D. Why Research-Oriented Design Isn't Design-Oriented Research. In Proceedings of NordiCHI, (2005) Umea Institute of Design, Umea University.
12. Forlizzi, J. The Product Ecology: Understanding Social Product Use and Supporting Design Culture. International Journal of Design, 2, 1 (2008), 11--20.
13. Forlizzi, J. and Battarbee, K. Understanding experience in interactive systems. In Proceedings of DIS, (2004) AMC Press, 261--268.
14. Forlizzi, J., Zimmerman, J. and Stolterman, E. From Design Research to Theory: Evidence of a Maturing Field. In Proceedings of IASDR, (2009)
15. Frayling, C. Research in Art and Design. Royal College of Art Research Papers, 1, 1 (1993), 1--5.
16. Friedman, K. Theory construction in design research: criteria: approaches, and methods. Design Studies, 24 (2003), 507--522.
17. Gaver, B., Dunne, T. and Pacenti, E. Cultural Probes. Interactions, 6, 1 (January/February 1999), 21--29.
18. Gaver, B. and Martin, H. Alternatives: Exploring Information Appliances through Conceptual Design Proposals. In Proceedings of CHI, (2000) ACM Press, 209--216.
19. Gaver, W. W., Bowers, J., Boucher, A., Gellerson, H., Pennington, S., Schmidt, A., Steed, A., Villars, N. and Walker, B. The Drift Table: Designing for Ludic Engagement. In Extended Abstracts of CHI, (2004) ACM Press, 885--900.
20. Giller, V., Tscheligi, M., Sefelin, R., Mäkelä, A., Puskala, A., and Karvonen, K. Maypole highlights: Image makers. Interactions, 6, 6 (1999), 12--15.
21. Iacucci, G., Kuutti, K. and Ranta M. On the move with a magic thing: role playing in concept design of mobile services and devices. In Proceedings of DIS, (2002) ACM Press, 193--202.
22. Ishii, H., Mazalek, A., Lee, J. Bottles as a Minimal Interface to Access Digital Information. In Extended Abstracts of CHI, (2001) ACM Press, 187--188.
23. Ishii, H., and Ullmer, B. Tangible Bits: Towards Seamless Interfaces Between People, Bits, and Atoms. In Proceedings of CHI, (1997) ACM Press, 234--241.
24. Kankainen, A. UCPCD: User-Centered Product Concept Development. In Proceedings of DUX, (2003) ACM Press, 1--13.
25. Koskinen, I., Binder, T. and Redström, J. Lab, Field, Gallery, and Beyond. Artifact, 2, 1 (2009), 46--57.
26. Long, J. Theory in Human-Computer Interaction? In Proceedings of IEEE Colloquium on Theory in Human-Computer Interaction (HCI), (1991) IEEE Press, 2/1--2/6.
27. Löwgren, J., and Stolterman, E. (2004) Thoughtful Interaction Design: A Design Perspective on Information Technology. Boston, MA: MIT Press.
28. Mautner, T. A. (1996). Dictionary of Philosophy. Oxford, UK: Blackwell Press.
29. Newman, W., Gaver, W., Kellogg, W., Lovejoy, T. and Rouncefield, M. Chi Conference Panel: The Status of Ethnography in Systems Design. In Proceedings of CHI, (2009) ACM Press.
30. Overbeeke, K. C. J. and Wensveen, S. S. A. G. From Perception to Experience, from Affordances to Irresistibles. In Proceedings of DPPI, (2003) ACM Press, 92--97.
31. Rittel, H. W. J. and Webber, M. M. Dilemmas in a General Theory of Planning. Policy Sciences, 4 (1973), 155--169.
32. Schön, D. The Reflective Practitioner. Temple Smith, London, 1983.
33. Sengers, P. and Gaver, B. Staying open to interpretation: engaging multiple meanings in design and evaluation. In Proceedings of DIS, (2006) ACM Press, 99--108.
34. Simon, H. The Sciences of the Artificial: 3rd Edition. MIT Press, Cambridge, MA, USA, 1996.
35. 35. Stolterman, S. The Nature of Design Practice and Implications for Interaction Design Research. International Journal of Design, 2, 1 (2008), 55--65.
36. Swann, C. Action Research and the Practice of Design. Design Issues, 18, 1 (2002), 49--61.
37. Taylor, A. S. and Swan, L. Artful Systems in the Home. In Proceedings of CHI, (2005) ACM Press, 641--650.
38. Tufte, E. Envisioning Information. (1990). Cheshire, CT: Graphics Press.
39. Wakkary, R., and Tanenbaum, K. A Sustainable Identity: The Creativity of an Everyday Designer. In Proceedings of CHI, (2009) ACM Press, 365--374.
40. Weick, K. E. Theory Construction as Disciplined Imagination. The Academy of Management Review, 14, 4(1989), 516--531.
41. Wensveen, S. A. G., Djajadiningrat, J. P. and Overbeeke, C. J. Interaction Frogger: A Design Framework to Couple Action and Function through Feedback and Feedforward. In Proceedings of DIS, (2004) ACM Press, 177--184.
42. Whittaker, S., Bellotti, V., Gwizdka, J. Email as personal information management. Communications of the ACM, 49, 1 (2006), 68--73.
43. Wolf, T. V., Rode, J. A., Sussman, J. and Kellogg, W. A. Dispelling Design as the 'Black Art' of CHI. In Proceedings of CHI, (2006) ACM Press, 521--530.
44. Zimmerman, J. Designing for the self: making products that help people become the person they desire to be. In Proceedings of CHI, (2009) ACM Press, 395--404.
45. Zimmerman, J., Forlizzi, J. and Evenson, S. Research through Design as a Method for Interaction Design Research in HCI. In Proceedings of CHI, (2007) ACM Press, 493--502.
46. Zimmerman, J. and Forlizzi, J. The Role of Design Artifacts in Design Theory Construction. Artifact, 2, 1 (2008), 41--45.

Index Terms

• Human-centered computing